-- Logs begin at Wed 2022-02-16 04:54:00 UTC, end at Wed 2022-02-16 05:53:42 UTC. -- Feb 16 05:19:31.786581 dv-cinder-829473-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 16 05:19:31.797699 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 16 05:19:31.797699 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Feb 16 05:19:31 2022] *** Feb 16 05:19:31.797699 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 16 05:19:31.797699 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 16 05:19:31.797699 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: nodename: dv-cinder-829473-2-iscsi Feb 16 05:19:31.797699 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: machine: x86_64 Feb 16 05:19:31.797699 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: clock source: unix Feb 16 05:19:31.797699 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: pcre jit disabled Feb 16 05:19:31.797699 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: detected number of CPU cores: 4 Feb 16 05:19:31.797699 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: current working directory: / Feb 16 05:19:31.797699 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: detected binary path: /usr/bin/uwsgi-core Feb 16 05:19:31.797699 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: your processes number limit is 47680 Feb 16 05:19:31.797699 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: your memory page size is 4096 bytes Feb 16 05:19:31.797699 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: detected max file descriptor number: 2048 Feb 16 05:19:31.797699 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: lock engine: pthread robust mutexes Feb 16 05:19:31.797699 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: thunder lock: enabled Feb 16 05:19:31.798910 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 16 05:19:31.798910 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 16 05:19:31.845003 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: Python main interpreter initialized at 0x55802e1c29c0 Feb 16 05:19:31.845003 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: python threads support enabled Feb 16 05:19:31.845003 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: your server socket listen backlog is limited to 100 connections Feb 16 05:19:31.845003 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: your mercy for graceful operations on workers is 90 seconds Feb 16 05:19:31.845519 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: mapped 403077 bytes (393 KB) for 2 cores Feb 16 05:19:31.845519 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: *** Operational MODE: preforking *** Feb 16 05:19:31.845715 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: *** uWSGI is running in multiple interpreter mode *** Feb 16 05:19:31.845715 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: spawned uWSGI master process (pid: 79183) Feb 16 05:19:31.845922 dv-cinder-829473-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 16 05:19:31.851170 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: spawned uWSGI worker 1 (pid: 79197, cores: 1) Feb 16 05:19:31.851170 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: spawned uWSGI worker 2 (pid: 79198, cores: 1) Feb 16 05:19:31.851170 dv-cinder-829473-2-iscsi devstack@keystone.service[79183]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 16 05:19:37.858898 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 05:19:37.858898 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: from cryptography.utils import int_from_bytes Feb 16 05:19:37.859654 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 05:19:37.859654 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: from cryptography.utils import int_from_bytes Feb 16 05:19:37.860071 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 05:19:37.860071 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: from cryptography.utils import int_from_bytes Feb 16 05:19:37.860179 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 05:19:37.860179 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: from cryptography.utils import int_from_bytes Feb 16 05:19:37.905379 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 16 05:19:37.905534 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 16 05:19:37.905599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 16 05:19:37.905685 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 16 05:19:37.905758 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] command line args: [] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 16 05:19:37.905822 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] command line args: [] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 16 05:19:37.906080 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 16 05:19:37.906174 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 16 05:19:37.906235 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ================================================================================ {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 16 05:19:37.906292 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ================================================================================ {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 16 05:19:37.906453 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] admin_token = **** {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.906530 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] admin_token = **** {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.906669 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] config_dir = [] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.906748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] config_dir = [] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.906814 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.906878 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.907047 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] config_source = [] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.907126 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] config_source = [] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.907192 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] debug = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.907250 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] debug = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.907397 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.907595 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.907689 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.908686 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.908686 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.908686 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.908686 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] list_limit = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.908945 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] log_config_append = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.908945 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.909058 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] log_dir = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.909116 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.909472 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] log_file = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.909691 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.909800 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.910105 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.910299 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.910488 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.910725 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.910926 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] list_limit = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.911123 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.911319 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] log_config_append = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.911549 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.911741 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.911941 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.912142 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] log_dir = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.912142 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] log_file = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.912519 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.912762 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.912969 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.913173 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.913364 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.913609 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.913808 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.913983 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.914183 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.914331 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.914496 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.914636 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.914774 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.914939 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.915079 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.915217 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.915379 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.915524 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.915524 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.915814 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.75/identity {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.915953 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.916090 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] publish_errors = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.916226 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.916356 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.916495 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.916633 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.916768 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.916904 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.917093 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.917243 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.917243 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.917542 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.75/identity {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.917679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] standard_threads = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.917808 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] publish_errors = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.917944 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.918129 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.918268 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.918399 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.919075 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.919220 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.919350 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] use_journal = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.919350 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] use_json = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.919600 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.919858 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] use_stderr = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.919998 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.920137 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] use_syslog = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.920267 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] standard_threads = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.920410 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.920542 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.920677 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.920814 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.920955 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.921085 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.921085 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] use_journal = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.921380 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.921511 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] use_json = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.921651 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.921794 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] use_stderr = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.921794 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] use_syslog = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.922039 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.922167 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 05:19:37.922295 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.922423 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.922562 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.922693 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.922828 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.922958 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.923086 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.923214 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.923419 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.923570 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.923700 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.923829 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.923958 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.924087 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.924227 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.924357 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.924492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.924622 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.924751 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.924892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.925023 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.925152 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.925320 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.925458 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.925593 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.925731 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.925862 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.925997 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.926128 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.926257 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.926384 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.926520 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.926650 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.926784 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.926914 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.927054 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.927189 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.927327 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.927457 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.927587 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.927715 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.927844 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.927979 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.928118 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.928248 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.928376 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.928511 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.928647 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.928776 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.928922 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.929068 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.929205 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.929367 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.929512 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.929649 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.929859 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.929992 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.930120 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.930250 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.930384 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.930514 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.930651 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.930791 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.930920 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.931054 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.931183 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.931312 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.931449 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.931579 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.931707 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.931842 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.932080 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.932480 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.932624 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.932761 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.932891 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.933037 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.933167 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.933380 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.933529 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.933660 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.933789 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.933917 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.934046 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.934237 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.934972 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.935130 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.935264 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.935405 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.935534 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.935934 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.936072 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.936203 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.936333 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.936462 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.936703 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.936913 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.937083 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.937397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.937609 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.937780 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.937977 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.938211 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.938392 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.938624 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.938795 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.939024 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.939194 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.939428 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.939596 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.939794 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.939990 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.940185 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.940381 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.940619 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.940834 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.941014 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.941252 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.941454 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.941651 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.941816 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.941981 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.942159 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.942296 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.942427 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.942593 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.942736 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.942876 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.943017 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.943148 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.943321 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.943456 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.943593 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.943731 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.943871 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.944002 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.944133 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.944263 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.944392 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.944522 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.944522 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.944817 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.944956 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.945098 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.945235 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.945401 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.945544 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.945676 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.945806 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.945936 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.945936 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.945936 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.945936 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.945936 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.946605 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.946742 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.946874 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.947020 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.947168 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.947336 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.947504 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.947640 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.947771 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.947901 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.948041 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.948173 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.948303 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.948433 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.948562 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.948692 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.948841 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.948973 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.949104 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.949233 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.949397 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.949544 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.949544 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.949812 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.949944 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.950081 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.950214 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.950344 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.950474 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.950612 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.950759 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.950898 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.951029 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.951167 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.951167 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.951422 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.951554 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.951684 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.951814 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.951945 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.952075 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.952215 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] auth.external = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.952347 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.952477 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.952619 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.952751 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.952883 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.953021 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.953154 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.953347 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] auth.password = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.953500 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.957492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] auth.token = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.957775 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.957948 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.958122 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.958268 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.958401 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.958547 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.958679 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] auth.external = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.958808 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.958944 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.959086 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.959219 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.959357 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.959488 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.959619 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.959750 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] auth.password = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.959888 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] credential.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.960028 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] auth.token = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.960159 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.960289 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.960429 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.960561 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.960772 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.960922 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.961055 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.961184 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.961351 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.961496 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.961630 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.961759 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.961889 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.962019 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.962148 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.962296 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] credential.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.962427 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.962569 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.962708 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.962840 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.962976 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.963119 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.963252 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.963381 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.963510 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.963641 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.963772 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.963910 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.964042 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.964203 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.964403 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] federation.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.964568 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.964702 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.964847 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.964979 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.965110 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.965240 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.965538 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.965679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.965841 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.965975 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.966113 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.966256 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.966386 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.966516 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.966726 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.966861 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.966991 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] federation.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.967120 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.967251 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.967381 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.967519 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.967650 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.967781 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.967911 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.968041 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.968182 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.968320 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.968460 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.968592 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.968721 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.968852 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.968993 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.969132 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.969291 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.969428 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.969559 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.969689 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.969818 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.969969 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.970102 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.970232 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.970362 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.970491 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.970621 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.970759 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.970891 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.971029 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.971162 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.971291 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.971421 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.971562 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.971700 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.971840 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.971971 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.972103 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.972232 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.972371 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.972601 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.972762 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.972895 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.973025 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.973025 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.973301 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.973438 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.973569 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.973712 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.973852 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.973852 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.974109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.974240 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.974370 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.974498 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.974628 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.974766 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.974897 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.975027 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.975156 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.975293 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.975424 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.975571 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.975701 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.975830 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.975959 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.976089 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.976218 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.976356 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.976488 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.976617 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.976747 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.976876 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.977006 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.977143 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.977322 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.977471 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.977602 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.977732 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.977861 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.978003 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.978136 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.978266 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.978397 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.978527 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.978663 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.978802 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.978940 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.979074 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.979215 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.979345 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.979476 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.979614 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.979747 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.979747 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.979992 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.979992 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.980247 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.980247 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.980503 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.980634 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.980764 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.980895 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.981567 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.981717 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.981849 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.981979 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.982108 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.982108 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.982353 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.982490 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.982623 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.982753 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.982883 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.983013 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.983141 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.983279 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.983421 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.983551 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.983681 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.983810 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.983940 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.984078 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.984210 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.984340 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.984470 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.984599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.984730 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.984874 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.985006 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.985148 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.985317 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.985456 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.985587 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.985724 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.985857 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.985987 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.986116 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.986246 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.986375 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.986513 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.986645 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.986774 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.986911 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.987053 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.987190 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.987322 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.987452 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.987581 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.987711 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.987848 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.987987 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.988119 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.988249 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.988379 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.988509 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.988639 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.988777 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.988919 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.989051 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.989180 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.989330 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.989469 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.989614 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.989747 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.989877 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.990007 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.990136 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.990265 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.990403 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.990534 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.990673 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.990802 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.990932 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.991062 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.991199 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.991330 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.991460 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.991589 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.991719 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.991847 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.991985 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.992117 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] resource.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.992247 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.992376 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.992521 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.992653 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.992859 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.992991 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.993123 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.993253 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.993453 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.993599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.993741 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.993874 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.994010 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.994148 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.994285 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.994421 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.994576 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] resource.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.994714 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.994850 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.994987 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] role.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.995122 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.995259 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] role.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.995404 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.995542 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.995678 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.995814 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.995950 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.996086 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.996232 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.996380 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.996517 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.996683 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.997360 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.997499 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.997647 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.997835 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.997978 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] role.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.998114 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.998250 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] role.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.998387 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.998531 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.998668 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.998804 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.998956 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.999092 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.999229 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.999377 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.999523 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.999663 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.999799 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.999935 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:37.999935 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.000202 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.000340 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.000477 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.000613 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.000759 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.000903 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.001041 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.001176 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.001370 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.001512 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.001650 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.001797 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.001942 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.002080 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.002216 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.002216 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.002473 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.002628 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.002766 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.002901 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.003036 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.003171 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.003307 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.003450 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.003589 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.003725 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.003862 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.003998 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.004133 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.004277 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.004424 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.004560 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.004697 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.004833 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.004969 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.005113 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.005250 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.005410 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] token.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.005556 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.005694 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.005834 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.005978 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.006117 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.006259 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.006406 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.006542 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.006678 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.006823 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.006960 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.007096 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.007233 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.007368 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.007504 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.007651 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.007790 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] token.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.007927 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.008062 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.008198 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.008344 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.008489 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.008626 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.008763 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.008900 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.009037 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.009173 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.009355 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.009505 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.009645 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.009782 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.009919 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.010063 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.010063 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.010334 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.010471 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.010607 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.connection = **** {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.010752 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.010898 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.011037 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.011181 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.011319 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.011455 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.011591 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.011728 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.011864 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.012009 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.012157 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.012328 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.012472 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.012609 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.012609 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.012923 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.connection = **** {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.013072 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.013219 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.013398 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.013537 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.013674 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.013810 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.013957 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.014104 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.014253 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.014390 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.014526 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.014662 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.014813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.014952 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.015089 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.015227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.015364 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.015500 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.015713 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.015853 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.015990 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79198) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 16 05:19:38.016138 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.016138 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.016138 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.016138 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.016138 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.016138 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.016138 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.016138 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 05:19:38.016138 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 16 05:19:38.021905 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.022138 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.022315 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.022466 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.022621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.022773 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.031943 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.032265 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.063120 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.063400 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.063568 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.063713 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.117384 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.117907 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.167247 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.167550 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.168485 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.169284 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.236781 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.237054 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.237210 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.237422 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.237422 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.237705 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.237863 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.238007 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.238158 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.238301 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.238301 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.238301 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.261439 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.261695 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.261845 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.261990 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.262131 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.262863 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.263024 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.263177 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.263320 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.263460 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.263460 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.263725 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.263725 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.263725 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.274647 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.274863 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.287442 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.287681 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.287894 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.288082 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.288082 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.288355 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.288497 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.288648 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.288792 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.288933 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.289087 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79197) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.289229 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.289229 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.289229 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79198) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 16 05:19:38.305946 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.306157 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 16 05:19:38.306495 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.306697 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 16 05:19:38.306967 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.307482 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.307710 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.307828 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.308020 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 16 05:19:38.308120 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.308293 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.308455 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 16 05:19:38.308725 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.308985 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.309774 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.310033 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.319086 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.319362 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.319624 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.319898 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.320828 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.321111 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.321404 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.321692 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.328565 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.330473 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.331790 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.332070 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.332347 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.332621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.332898 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.333153 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.333447 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.333719 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.333898 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.333984 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.334187 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.334273 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.334473 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.334558 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.334879 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.335151 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.335409 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.335676 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.335949 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.336223 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.336494 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.336760 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.363873 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.365514 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.365795 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.366450 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.368074 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.368360 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.370965 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.371244 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.374170 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.374457 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.473089 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.474853 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.480583 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.480869 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.482989 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.483278 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.485836 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.486122 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.486398 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.486674 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.486993 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.487214 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.487478 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.487736 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.487899 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.488056 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.488301 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.488581 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.488853 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.489124 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.489419 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.489848 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.506679 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.506958 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.508691 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.508971 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.511438 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.513494 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.515162 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.515456 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.517151 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.517469 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.520385 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.522478 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.523939 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.526033 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.528672 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.528978 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.529280 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.529572 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.529868 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.530102 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.530245 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.530383 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.530520 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.530727 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.531009 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.531356 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.549612 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.549903 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.550180 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.550442 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.550882 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.551168 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.551446 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.551720 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.558518 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.560316 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.560856 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.561134 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.562163 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.562442 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.564151 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.564436 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.564733 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.565033 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.573680 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.573822 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.573822 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.573822 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.573822 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.573822 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.579107 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.579396 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.579677 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.579967 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.580251 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.580352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.580527 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.580611 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.580809 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.580897 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.581160 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.581468 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.581755 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.582042 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.599075 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.600294 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.602311 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.603582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.605755 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.607097 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.607379 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.608682 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.608982 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.609284 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.609565 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.610376 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.610663 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.610945 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.616766 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.618176 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.618383 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.619827 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.621725 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.622016 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.622300 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.622576 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.623182 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.623475 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.623758 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.624032 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.631606 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.631914 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.632194 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.633097 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.633410 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.633692 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.640749 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79197) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.641038 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.641335 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.641587 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.641855 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.642135 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.642288 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79198) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 16 05:19:38.642440 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.642580 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.642718 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.642856 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.642993 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.643152 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.643293 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.643440 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.643631 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.643779 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.643917 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.644055 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.644192 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.644330 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.644468 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79197) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.644613 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.644613 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.644905 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.645041 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.645336 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.645607 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79198) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 16 05:19:38.683053 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55802e1c29c0 pid: 79197 (default app) Feb 16 05:19:38.684941 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55802e1c29c0 pid: 79198 (default app) Feb 16 05:19:38.686969 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013ab6a-e2d9-4652-9ce4-bfe94158ae0a None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:38.687270 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013ab6a-e2d9-4652-9ce4-bfe94158ae0a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:38.687546 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013ab6a-e2d9-4652-9ce4-bfe94158ae0a None None] PATH_INFO: `/v3` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:38.691740 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1/1] 10.222.0.75 () {50 vars in 791 bytes} [Wed Feb 16 05:19:38 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:19:47.150142 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777e7bd-355d-492d-983c-dd5202af54c2 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:47.150711 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777e7bd-355d-492d-983c-dd5202af54c2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:47.150711 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777e7bd-355d-492d-983c-dd5202af54c2 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:47.155760 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1/2] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:19:47 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:19:47.161469 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ece439-876c-434b-8cd1-323f1108d563 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:47.161875 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ece439-876c-434b-8cd1-323f1108d563 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:47.162058 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ece439-876c-434b-8cd1-323f1108d563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:47.192697 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG oslo_db.sqlalchemy.engines [None req-95ece439-876c-434b-8cd1-323f1108d563 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 05:19:47.372411 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG passlib.handlers.bcrypt [None req-95ece439-876c-434b-8cd1-323f1108d563 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79197) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 16 05:19:47.372813 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG passlib.handlers.bcrypt [None req-95ece439-876c-434b-8cd1-323f1108d563 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79197) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 16 05:19:47.427727 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-95ece439-876c-434b-8cd1-323f1108d563 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:19:47.429234 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-95ece439-876c-434b-8cd1-323f1108d563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:19:47.547519 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 2/3] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:19:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 05:19:47.712586 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777e7bd-355d-492d-983c-dd5202af54c2 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:47.747192 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG oslo_db.sqlalchemy.engines [None req-4777e7bd-355d-492d-983c-dd5202af54c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79198) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 05:19:47.873511 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777e7bd-355d-492d-983c-dd5202af54c2 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:47.877840 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ce0b9-301b-46d4-9152-1c0fb34ba2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:47.878519 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ce0b9-301b-46d4-9152-1c0fb34ba2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:47.878802 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ce0b9-301b-46d4-9152-1c0fb34ba2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:47.879076 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ce0b9-301b-46d4-9152-1c0fb34ba2c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:47.887681 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ce0b9-301b-46d4-9152-1c0fb34ba2c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:47.938964 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7b2ce0b9-301b-46d4-9152-1c0fb34ba2c9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 16 05:19:47.939301 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ce0b9-301b-46d4-9152-1c0fb34ba2c9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:47.948650 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 2/4] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:19:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 05:19:47.955255 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ece439-876c-434b-8cd1-323f1108d563 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:47.969184 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ece439-876c-434b-8cd1-323f1108d563 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:47.973453 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff00c4-8d8c-4ab0-a80c-90be622b8c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:47.974539 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff00c4-8d8c-4ab0-a80c-90be622b8c81 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:47.974818 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff00c4-8d8c-4ab0-a80c-90be622b8c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:47.975094 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff00c4-8d8c-4ab0-a80c-90be622b8c81 admin admin] PATH_INFO: `/v3/projects/b93c4f51f61141d6b4554752db1f615b` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:47.976560 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff00c4-8d8c-4ab0-a80c-90be622b8c81 admin admin] RBAC: Authorizing `identity:get_project(project_id=b93c4f51f61141d6b4554752db1f615b)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:48.028814 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.common.rbac_enforcer.enforcer [None req-07ff00c4-8d8c-4ab0-a80c-90be622b8c81 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 16 05:19:48.029150 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff00c4-8d8c-4ab0-a80c-90be622b8c81 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:48.033770 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 3/5] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:19:47 2022] GET /identity/v3/projects/b93c4f51f61141d6b4554752db1f615b => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:19:50.302591 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f13506-a28e-4371-b6a4-d695eae932cc None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:50.303099 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f13506-a28e-4371-b6a4-d695eae932cc None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:50.303180 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f13506-a28e-4371-b6a4-d695eae932cc None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:50.308146 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 3/6] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:19:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:19:50.313382 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42261de-698c-4b76-9f0a-73620b57d6a8 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:50.313797 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42261de-698c-4b76-9f0a-73620b57d6a8 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:50.313928 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42261de-698c-4b76-9f0a-73620b57d6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:50.333222 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c42261de-698c-4b76-9f0a-73620b57d6a8 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:19:50.334811 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c42261de-698c-4b76-9f0a-73620b57d6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:19:50.343074 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 4/7] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:19:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 05:19:50.365979 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f13506-a28e-4371-b6a4-d695eae932cc None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:50.378293 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f13506-a28e-4371-b6a4-d695eae932cc None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:50.382495 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b5a8f-8d85-4f31-befd-86d2eaf474fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:50.383120 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b5a8f-8d85-4f31-befd-86d2eaf474fa admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:50.383403 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b5a8f-8d85-4f31-befd-86d2eaf474fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:50.383680 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b5a8f-8d85-4f31-befd-86d2eaf474fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:50.391861 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b5a8f-8d85-4f31-befd-86d2eaf474fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:50.393686 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b5a8f-8d85-4f31-befd-86d2eaf474fa admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:50.402241 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 4/8] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:19:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 05:19:50.407239 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42261de-698c-4b76-9f0a-73620b57d6a8 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:50.415969 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42261de-698c-4b76-9f0a-73620b57d6a8 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:50.420758 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf53d85-0686-4d58-9a5b-e11716648ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:50.421640 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf53d85-0686-4d58-9a5b-e11716648ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:50.421920 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf53d85-0686-4d58-9a5b-e11716648ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:50.422192 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf53d85-0686-4d58-9a5b-e11716648ce8 admin admin] PATH_INFO: `/v3/users/45cb725950b24d83bf85741c6aa46ba7` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:50.423559 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf53d85-0686-4d58-9a5b-e11716648ce8 admin admin] RBAC: Authorizing `identity:get_user(user_id=45cb725950b24d83bf85741c6aa46ba7)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:50.425426 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf53d85-0686-4d58-9a5b-e11716648ce8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:50.426950 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 5/9] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:19:50 2022] GET /identity/v3/users/45cb725950b24d83bf85741c6aa46ba7 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:19:52.799733 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5b4ba-8062-4234-9041-1f35de5daac0 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:52.800246 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5b4ba-8062-4234-9041-1f35de5daac0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:52.800336 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5b4ba-8062-4234-9041-1f35de5daac0 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:52.802052 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 5/10] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:19:52.807496 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493cd98-4e8c-47b9-8b7a-26cb5d939026 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:52.807879 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493cd98-4e8c-47b9-8b7a-26cb5d939026 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:52.808052 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493cd98-4e8c-47b9-8b7a-26cb5d939026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:52.826079 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-a493cd98-4e8c-47b9-8b7a-26cb5d939026 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:19:52.827261 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a493cd98-4e8c-47b9-8b7a-26cb5d939026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:19:52.834789 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 6/11] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:19:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:19:52.858397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5b4ba-8062-4234-9041-1f35de5daac0 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:52.870238 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5b4ba-8062-4234-9041-1f35de5daac0 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:52.872617 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87944fc8-35a8-44ce-80aa-1832b15aad03 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:52.873012 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87944fc8-35a8-44ce-80aa-1832b15aad03 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:52.873314 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87944fc8-35a8-44ce-80aa-1832b15aad03 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:52.875353 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 7/12] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:19:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:19:52.875582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabe025-77d5-40b1-841a-63c76764e012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:52.876304 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabe025-77d5-40b1-841a-63c76764e012 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:52.876585 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabe025-77d5-40b1-841a-63c76764e012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:52.876852 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabe025-77d5-40b1-841a-63c76764e012 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:52.880449 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cca4e5-6e47-4fb2-b877-d569088923d9 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:52.880731 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cca4e5-6e47-4fb2-b877-d569088923d9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:52.881006 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cca4e5-6e47-4fb2-b877-d569088923d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:52.893373 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabe025-77d5-40b1-841a-63c76764e012 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:19:52.898924 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-29cca4e5-6e47-4fb2-b877-d569088923d9 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:19:52.900117 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-0eabe025-77d5-40b1-841a-63c76764e012 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:19:52.900211 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-29cca4e5-6e47-4fb2-b877-d569088923d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:19:52.901352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 6/13] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:19:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:19:52.906902 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabe025-77d5-40b1-841a-63c76764e012 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:52.907787 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 8/14] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:19:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 05:19:52.916579 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabe025-77d5-40b1-841a-63c76764e012 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:52.921458 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98152b63-c7cf-411a-8c25-cd9e1c42cd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:52.922008 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98152b63-c7cf-411a-8c25-cd9e1c42cd4c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:52.922283 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98152b63-c7cf-411a-8c25-cd9e1c42cd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:52.922554 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98152b63-c7cf-411a-8c25-cd9e1c42cd4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:52.923282 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98152b63-c7cf-411a-8c25-cd9e1c42cd4c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:19:52.923582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98152b63-c7cf-411a-8c25-cd9e1c42cd4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:52.925316 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-98152b63-c7cf-411a-8c25-cd9e1c42cd4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:19:52.925316 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Feb 16 05:19:52.925316 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: Feb 16 05:19:52.926222 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98152b63-c7cf-411a-8c25-cd9e1c42cd4c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:52.930174 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cca4e5-6e47-4fb2-b877-d569088923d9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:52.939741 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cca4e5-6e47-4fb2-b877-d569088923d9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:52.940655 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 7/15] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:19:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:19:52.944299 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0f3f7-2894-433a-ae8f-882099ed4b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:52.944925 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0f3f7-2894-433a-ae8f-882099ed4b7d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:52.945205 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0f3f7-2894-433a-ae8f-882099ed4b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:52.945513 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d0f3f7-2894-433a-ae8f-882099ed4b7d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:52.945815 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98152b63-c7cf-411a-8c25-cd9e1c42cd4c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:52.953427 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d0f3f7-2894-433a-ae8f-882099ed4b7d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:52.954787 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98152b63-c7cf-411a-8c25-cd9e1c42cd4c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:52.955209 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d0f3f7-2894-433a-ae8f-882099ed4b7d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:52.959029 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f882e2-dc89-4b23-9704-86567c642efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:52.959832 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f882e2-dc89-4b23-9704-86567c642efa admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:52.960108 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f882e2-dc89-4b23-9704-86567c642efa admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:52.960376 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f882e2-dc89-4b23-9704-86567c642efa admin admin] PATH_INFO: `/v3/users/45cb725950b24d83bf85741c6aa46ba7` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:52.962150 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f882e2-dc89-4b23-9704-86567c642efa admin admin] RBAC: Authorizing `identity:get_user(user_id=45cb725950b24d83bf85741c6aa46ba7)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:52.963891 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 9/16] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:19:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 05:19:52.964008 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f882e2-dc89-4b23-9704-86567c642efa admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:52.965665 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 8/17] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:19:52 2022] GET /identity/v3/users/45cb725950b24d83bf85741c6aa46ba7 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:19:52.969097 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0f3f7-2894-433a-ae8f-882099ed4b7d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:52.970333 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f882e2-dc89-4b23-9704-86567c642efa admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:52.977487 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d0f3f7-2894-433a-ae8f-882099ed4b7d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:52.979410 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f882e2-dc89-4b23-9704-86567c642efa admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:52.982303 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b04fe-120d-4b7f-ad7f-17278fe60bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:52.983049 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b04fe-120d-4b7f-ad7f-17278fe60bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:52.983328 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b04fe-120d-4b7f-ad7f-17278fe60bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:52.983601 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b04fe-120d-4b7f-ad7f-17278fe60bd4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:52.984283 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e89c4-7457-4da9-a68a-76c754a57387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:52.984739 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b04fe-120d-4b7f-ad7f-17278fe60bd4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:52.985002 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e89c4-7457-4da9-a68a-76c754a57387 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:52.985311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e89c4-7457-4da9-a68a-76c754a57387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:52.985590 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e89c4-7457-4da9-a68a-76c754a57387 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:52.986447 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b04fe-120d-4b7f-ad7f-17278fe60bd4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:52.986819 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e89c4-7457-4da9-a68a-76c754a57387 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:52.987959 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 10/18] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:19:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:19:52.988540 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e89c4-7457-4da9-a68a-76c754a57387 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:52.990163 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 9/19] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:19:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:19:52.995930 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b04fe-120d-4b7f-ad7f-17278fe60bd4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:53.006563 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b04fe-120d-4b7f-ad7f-17278fe60bd4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:53.011100 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373dd512-67df-4d28-9d21-0bc186beabc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:53.011766 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dd512-67df-4d28-9d21-0bc186beabc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:53.012074 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dd512-67df-4d28-9d21-0bc186beabc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:53.012344 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373dd512-67df-4d28-9d21-0bc186beabc8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:53.013205 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373dd512-67df-4d28-9d21-0bc186beabc8 admin admin] RBAC: Adding query filter params (role.id=9ba4a5967ed243178927661616f08901, scope.domain.id=default, user.id=45cb725950b24d83bf85741c6aa46ba7) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:19:53.013542 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373dd512-67df-4d28-9d21-0bc186beabc8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:53.015389 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-373dd512-67df-4d28-9d21-0bc186beabc8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:19:53.015389 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Feb 16 05:19:53.015389 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: Feb 16 05:19:53.016584 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373dd512-67df-4d28-9d21-0bc186beabc8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:53.024137 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 11/20] 10.222.0.75 () {56 vars in 1343 bytes} [Wed Feb 16 05:19:52 2022] GET /identity/v3/role_assignments?user.id=45cb725950b24d83bf85741c6aa46ba7&scope.domain.id=default&role.id=9ba4a5967ed243178927661616f08901 => generated 233 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:19:55.698546 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166baf97-2d35-4b55-bb60-5cc179d70ad8 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:55.701850 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae15c2-0e76-4446-be3e-54b5ecf3a5ca None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:55.702611 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae15c2-0e76-4446-be3e-54b5ecf3a5ca None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:55.703125 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae15c2-0e76-4446-be3e-54b5ecf3a5ca None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:55.705532 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166baf97-2d35-4b55-bb60-5cc179d70ad8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:55.706062 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166baf97-2d35-4b55-bb60-5cc179d70ad8 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:55.708350 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 12/21] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:19:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:19:55.708740 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 10/22] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:19:55 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:19:55.710362 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee722c-069f-4fdb-b584-cec85a344d72 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:55.710875 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee722c-069f-4fdb-b584-cec85a344d72 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:55.711350 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee722c-069f-4fdb-b584-cec85a344d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:55.726849 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568029a3-73eb-41d2-af24-8bb6f18a44c6 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:55.727442 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568029a3-73eb-41d2-af24-8bb6f18a44c6 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:55.727949 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568029a3-73eb-41d2-af24-8bb6f18a44c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:55.736131 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-4fee722c-069f-4fdb-b584-cec85a344d72 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:19:55.737629 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4fee722c-069f-4fdb-b584-cec85a344d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:19:55.759598 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 13/23] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:19:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:19:55.781223 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG passlib.handlers.bcrypt [None req-568029a3-73eb-41d2-af24-8bb6f18a44c6 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79198) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 16 05:19:55.781957 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG passlib.handlers.bcrypt [None req-568029a3-73eb-41d2-af24-8bb6f18a44c6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79198) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 16 05:19:55.803417 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee722c-069f-4fdb-b584-cec85a344d72 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:55.813104 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee722c-069f-4fdb-b584-cec85a344d72 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:55.817858 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132f9ba-1ffd-46ba-9b39-a2b9ed19bac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:55.818860 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132f9ba-1ffd-46ba-9b39-a2b9ed19bac4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:55.819335 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132f9ba-1ffd-46ba-9b39-a2b9ed19bac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:55.819789 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132f9ba-1ffd-46ba-9b39-a2b9ed19bac4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:55.833871 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132f9ba-1ffd-46ba-9b39-a2b9ed19bac4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:19:55.841542 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-c132f9ba-1ffd-46ba-9b39-a2b9ed19bac4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:19:55.842913 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 14/24] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:19:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:19:55.847910 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-568029a3-73eb-41d2-af24-8bb6f18a44c6 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:19:55.848965 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132f9ba-1ffd-46ba-9b39-a2b9ed19bac4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:55.849721 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-568029a3-73eb-41d2-af24-8bb6f18a44c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:19:55.863165 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132f9ba-1ffd-46ba-9b39-a2b9ed19bac4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:55.876821 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c180d36-7c58-4217-9bf0-3af70a7b69be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:55.878052 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c180d36-7c58-4217-9bf0-3af70a7b69be admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:55.878992 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c180d36-7c58-4217-9bf0-3af70a7b69be admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:55.880426 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 11/25] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:19:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:19:55.880966 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c180d36-7c58-4217-9bf0-3af70a7b69be admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:55.881962 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c180d36-7c58-4217-9bf0-3af70a7b69be admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:19:55.882504 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c180d36-7c58-4217-9bf0-3af70a7b69be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:55.883774 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-0c180d36-7c58-4217-9bf0-3af70a7b69be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:19:55.883774 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Feb 16 05:19:55.883774 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: Feb 16 05:19:55.885100 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c180d36-7c58-4217-9bf0-3af70a7b69be admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:55.898895 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 15/26] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:19:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:19:55.904785 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568029a3-73eb-41d2-af24-8bb6f18a44c6 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:55.919059 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568029a3-73eb-41d2-af24-8bb6f18a44c6 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:55.920904 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c180d36-7c58-4217-9bf0-3af70a7b69be admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:55.933508 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4a66c-07c5-4bd0-803f-95a5d22ea7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:55.937067 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4a66c-07c5-4bd0-803f-95a5d22ea7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:55.937550 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4a66c-07c5-4bd0-803f-95a5d22ea7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:55.939099 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4a66c-07c5-4bd0-803f-95a5d22ea7a9 admin admin] PATH_INFO: `/v3/users/45cb725950b24d83bf85741c6aa46ba7` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:55.942322 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c180d36-7c58-4217-9bf0-3af70a7b69be admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:55.943366 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4a66c-07c5-4bd0-803f-95a5d22ea7a9 admin admin] RBAC: Authorizing `identity:get_user(user_id=45cb725950b24d83bf85741c6aa46ba7)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:55.946156 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4a66c-07c5-4bd0-803f-95a5d22ea7a9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:55.948310 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 12/27] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:19:55 2022] GET /identity/v3/users/45cb725950b24d83bf85741c6aa46ba7 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:19:55.954303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4a66c-07c5-4bd0-803f-95a5d22ea7a9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:55.956507 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff2aba-7fca-49bd-99a4-4776a017ec21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:55.957492 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2aba-7fca-49bd-99a4-4776a017ec21 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:55.957911 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2aba-7fca-49bd-99a4-4776a017ec21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:55.958342 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff2aba-7fca-49bd-99a4-4776a017ec21 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:55.969927 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4a66c-07c5-4bd0-803f-95a5d22ea7a9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:55.977639 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff2aba-7fca-49bd-99a4-4776a017ec21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:55.979891 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff2aba-7fca-49bd-99a4-4776a017ec21 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:55.982525 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea59c7-502b-4235-aa6e-054f727bb4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:55.983301 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea59c7-502b-4235-aa6e-054f727bb4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:55.983578 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea59c7-502b-4235-aa6e-054f727bb4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:55.983851 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea59c7-502b-4235-aa6e-054f727bb4f3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:55.989943 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea59c7-502b-4235-aa6e-054f727bb4f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:55.991826 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea59c7-502b-4235-aa6e-054f727bb4f3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:55.993575 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 13/28] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:19:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:19:55.999651 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea59c7-502b-4235-aa6e-054f727bb4f3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:56.002136 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-33ff2aba-7fca-49bd-99a4-4776a017ec21 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:19:56.003841 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 16/29] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:19:56.009144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff2aba-7fca-49bd-99a4-4776a017ec21 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:56.018415 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea59c7-502b-4235-aa6e-054f727bb4f3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:56.019957 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff2aba-7fca-49bd-99a4-4776a017ec21 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:56.028356 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93da743-f7aa-4d24-92ef-589ef2a64046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:56.029221 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93da743-f7aa-4d24-92ef-589ef2a64046 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:56.029528 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93da743-f7aa-4d24-92ef-589ef2a64046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:56.029798 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93da743-f7aa-4d24-92ef-589ef2a64046 admin admin] PATH_INFO: `/v3/domains/default/users/45cb725950b24d83bf85741c6aa46ba7/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:56.031290 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29173459-5207-4478-945a-9a50501c0590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:56.031945 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29173459-5207-4478-945a-9a50501c0590 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:56.032228 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29173459-5207-4478-945a-9a50501c0590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:56.032505 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29173459-5207-4478-945a-9a50501c0590 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:56.037444 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29173459-5207-4478-945a-9a50501c0590 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:19:56.037781 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29173459-5207-4478-945a-9a50501c0590 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:56.038459 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93da743-f7aa-4d24-92ef-589ef2a64046 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=45cb725950b24d83bf85741c6aa46ba7, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:56.038834 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-29173459-5207-4478-945a-9a50501c0590 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:19:56.038834 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Feb 16 05:19:56.038834 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: Feb 16 05:19:56.039759 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29173459-5207-4478-945a-9a50501c0590 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:56.040220 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-f93da743-f7aa-4d24-92ef-589ef2a64046 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:19:56.040220 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Feb 16 05:19:56.040220 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: Feb 16 05:19:56.042571 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93da743-f7aa-4d24-92ef-589ef2a64046 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:56.064214 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 17/30] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:19:56.070012 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29173459-5207-4478-945a-9a50501c0590 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:56.093284 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29173459-5207-4478-945a-9a50501c0590 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:56.170103 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff95a3f-8c81-4233-a544-008ac67621f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:56.170776 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff95a3f-8c81-4233-a544-008ac67621f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:56.171110 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff95a3f-8c81-4233-a544-008ac67621f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:56.171332 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff95a3f-8c81-4233-a544-008ac67621f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:56.172052 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff95a3f-8c81-4233-a544-008ac67621f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:56.173081 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-7ff95a3f-8c81-4233-a544-008ac67621f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:19:56.173081 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Feb 16 05:19:56.173081 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: Feb 16 05:19:56.174345 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff95a3f-8c81-4233-a544-008ac67621f5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:56.268644 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 14/31] 10.222.0.75 () {58 vars in 1382 bytes} [Wed Feb 16 05:19:55 2022] PUT /identity/v3/domains/default/users/45cb725950b24d83bf85741c6aa46ba7/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:19:56.270823 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d08ec1-d183-4527-82d3-f6cc437624aa None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:56.271318 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d08ec1-d183-4527-82d3-f6cc437624aa None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:56.271807 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d08ec1-d183-4527-82d3-f6cc437624aa None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:56.277312 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 15/32] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:19:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:19:56.291131 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb23a62-ff18-42fa-824e-9833b268594b None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:56.291742 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb23a62-ff18-42fa-824e-9833b268594b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:56.292212 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb23a62-ff18-42fa-824e-9833b268594b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:56.336083 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-9cb23a62-ff18-42fa-824e-9833b268594b None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:19:56.338060 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9cb23a62-ff18-42fa-824e-9833b268594b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:19:56.357328 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 16/33] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:19:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 05:19:56.402841 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb23a62-ff18-42fa-824e-9833b268594b None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:56.421385 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb23a62-ff18-42fa-824e-9833b268594b None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:56.429168 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 18/34] 10.222.0.75 () {60 vars in 1162 bytes} [Wed Feb 16 05:19:56 2022] POST /identity/v3/projects => generated 301 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:19:56.432856 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4489220-8b3f-4fad-9c53-ecaee5f43ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:56.434476 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4489220-8b3f-4fad-9c53-ecaee5f43ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:56.434997 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4489220-8b3f-4fad-9c53-ecaee5f43ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:56.435463 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4489220-8b3f-4fad-9c53-ecaee5f43ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:56.436458 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4489220-8b3f-4fad-9c53-ecaee5f43ee0 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:56.437954 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-f4489220-8b3f-4fad-9c53-ecaee5f43ee0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:19:56.437954 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Feb 16 05:19:56.437954 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: Feb 16 05:19:56.439230 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4489220-8b3f-4fad-9c53-ecaee5f43ee0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:56.473039 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 17/35] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:19:56 2022] POST /identity/v3/roles => generated 219 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:19:56.937969 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff8059-63ec-4fe5-8240-57e122171bd8 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:56.938962 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff8059-63ec-4fe5-8240-57e122171bd8 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:56.939442 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff8059-63ec-4fe5-8240-57e122171bd8 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:56.941436 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 19/36] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:19:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:19:56.948324 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0ceeb-9db0-450b-8595-a954dfd1f501 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:56.949192 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0ceeb-9db0-450b-8595-a954dfd1f501 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:56.949846 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0ceeb-9db0-450b-8595-a954dfd1f501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:56.976777 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-96b0ceeb-9db0-450b-8595-a954dfd1f501 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:19:56.978022 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-96b0ceeb-9db0-450b-8595-a954dfd1f501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:19:57.075143 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 18/37] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:19:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:19:57.100426 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff8059-63ec-4fe5-8240-57e122171bd8 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:57.118383 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff8059-63ec-4fe5-8240-57e122171bd8 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:57.126210 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a772fa8-95db-4f4e-946f-085ce45ffa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:57.127110 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a772fa8-95db-4f4e-946f-085ce45ffa6c admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:57.127585 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a772fa8-95db-4f4e-946f-085ce45ffa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:57.128122 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a772fa8-95db-4f4e-946f-085ce45ffa6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:57.129087 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a772fa8-95db-4f4e-946f-085ce45ffa6c admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:57.130502 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-3a772fa8-95db-4f4e-946f-085ce45ffa6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:19:57.130502 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Feb 16 05:19:57.130502 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: Feb 16 05:19:57.131733 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a772fa8-95db-4f4e-946f-085ce45ffa6c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:57.143611 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09bc56-0235-4a70-b5a9-9826e5554ac5 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:57.143908 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09bc56-0235-4a70-b5a9-9826e5554ac5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:57.144293 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09bc56-0235-4a70-b5a9-9826e5554ac5 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:57.146275 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 19/38] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:19:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 05:19:57.151223 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c88ce0-1137-43b5-b4fc-2e3f3efd8edf None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:57.151514 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c88ce0-1137-43b5-b4fc-2e3f3efd8edf None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:57.151782 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c88ce0-1137-43b5-b4fc-2e3f3efd8edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:57.153386 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 20/39] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:19:57 2022] POST /identity/v3/roles => generated 225 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:19:57.172671 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-04c88ce0-1137-43b5-b4fc-2e3f3efd8edf None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:19:57.174322 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-04c88ce0-1137-43b5-b4fc-2e3f3efd8edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:19:57.183400 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 20/40] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:19:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:19:57.207459 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a772fa8-95db-4f4e-946f-085ce45ffa6c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:57.218816 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a772fa8-95db-4f4e-946f-085ce45ffa6c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:57.224463 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9275e6-2a17-4e7b-bf48-480f0c647bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:57.225235 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9275e6-2a17-4e7b-bf48-480f0c647bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:57.225550 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9275e6-2a17-4e7b-bf48-480f0c647bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:57.225823 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9275e6-2a17-4e7b-bf48-480f0c647bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:57.226883 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9275e6-2a17-4e7b-bf48-480f0c647bb2 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:57.229086 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9275e6-2a17-4e7b-bf48-480f0c647bb2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:57.247901 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 21/41] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:19:57 2022] POST /identity/v3/roles => generated 223 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:19:57.585960 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29d84d-b550-4b27-b2b5-9b4e00c88230 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:57.586254 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29d84d-b550-4b27-b2b5-9b4e00c88230 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:57.586531 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29d84d-b550-4b27-b2b5-9b4e00c88230 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:57.588299 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 21/42] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:19:57.593458 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21562711-0d44-4f0d-8757-202b1704e3a2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:57.593745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21562711-0d44-4f0d-8757-202b1704e3a2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:57.594045 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21562711-0d44-4f0d-8757-202b1704e3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:57.613001 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-21562711-0d44-4f0d-8757-202b1704e3a2 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:19:57.614545 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-21562711-0d44-4f0d-8757-202b1704e3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:19:57.622817 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 22/43] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:19:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:19:57.645817 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29d84d-b550-4b27-b2b5-9b4e00c88230 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:57.657677 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b29d84d-b550-4b27-b2b5-9b4e00c88230 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:57.661799 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2183c3-e77f-43fe-8510-9a359f87b500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:57.662563 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2183c3-e77f-43fe-8510-9a359f87b500 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:57.662843 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2183c3-e77f-43fe-8510-9a359f87b500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:57.663118 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2183c3-e77f-43fe-8510-9a359f87b500 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:57.664277 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2183c3-e77f-43fe-8510-9a359f87b500 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:57.666018 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2183c3-e77f-43fe-8510-9a359f87b500 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:57.667791 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 22/44] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:19:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:19:57.672838 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21562711-0d44-4f0d-8757-202b1704e3a2 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:57.682305 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21562711-0d44-4f0d-8757-202b1704e3a2 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:57.687243 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1daa75-7405-4ada-933d-a2dd186a9ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:57.687892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1daa75-7405-4ada-933d-a2dd186a9ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:57.688180 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1daa75-7405-4ada-933d-a2dd186a9ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:57.688458 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1daa75-7405-4ada-933d-a2dd186a9ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:57.689176 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1daa75-7405-4ada-933d-a2dd186a9ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:57.691166 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1daa75-7405-4ada-933d-a2dd186a9ce9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:57.716129 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 23/45] 10.222.0.75 () {60 vars in 1162 bytes} [Wed Feb 16 05:19:57 2022] POST /identity/v3/projects => generated 312 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:19:58.950409 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e431ed-f227-4821-b963-ae548103d7fd None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:58.950909 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e431ed-f227-4821-b963-ae548103d7fd None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:58.950909 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e431ed-f227-4821-b963-ae548103d7fd None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:58.952631 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 23/46] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:19:58.958474 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100981a2-677b-485b-bcf4-b3f57862818a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:58.958891 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100981a2-677b-485b-bcf4-b3f57862818a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:58.959146 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100981a2-677b-485b-bcf4-b3f57862818a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:58.976456 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-100981a2-677b-485b-bcf4-b3f57862818a None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:19:58.977709 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-100981a2-677b-485b-bcf4-b3f57862818a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:19:59.032097 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 24/47] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:19:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 05:19:59.055400 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e431ed-f227-4821-b963-ae548103d7fd None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:59.067450 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e431ed-f227-4821-b963-ae548103d7fd None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:59.071584 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cdbe1-ad0a-40c3-9730-0c6cc1f6012b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:59.072344 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cdbe1-ad0a-40c3-9730-0c6cc1f6012b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:59.072627 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cdbe1-ad0a-40c3-9730-0c6cc1f6012b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:59.072898 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244cdbe1-ad0a-40c3-9730-0c6cc1f6012b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:59.082759 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244cdbe1-ad0a-40c3-9730-0c6cc1f6012b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:19:59.089422 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-244cdbe1-ad0a-40c3-9730-0c6cc1f6012b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:19:59.091219 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 24/48] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:19:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:19:59.096411 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100981a2-677b-485b-bcf4-b3f57862818a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:59.105190 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100981a2-677b-485b-bcf4-b3f57862818a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:59.110189 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2469e-5844-4ada-aceb-95f1a35aa5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:59.110838 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2469e-5844-4ada-aceb-95f1a35aa5cf admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:59.111120 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2469e-5844-4ada-aceb-95f1a35aa5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:59.111396 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2469e-5844-4ada-aceb-95f1a35aa5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:59.112147 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2469e-5844-4ada-aceb-95f1a35aa5cf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:19:59.112455 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2469e-5844-4ada-aceb-95f1a35aa5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:59.114138 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2469e-5844-4ada-aceb-95f1a35aa5cf admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:59.122218 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 25/49] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:19:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:19:59.127284 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cdbe1-ad0a-40c3-9730-0c6cc1f6012b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:59.137367 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244cdbe1-ad0a-40c3-9730-0c6cc1f6012b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:59.141735 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286917b-0a0d-4ca6-8a63-20f0409ca174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:59.142559 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286917b-0a0d-4ca6-8a63-20f0409ca174 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:59.142841 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286917b-0a0d-4ca6-8a63-20f0409ca174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:59.143115 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286917b-0a0d-4ca6-8a63-20f0409ca174 admin admin] PATH_INFO: `/v3/users/45cb725950b24d83bf85741c6aa46ba7` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:59.144310 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286917b-0a0d-4ca6-8a63-20f0409ca174 admin admin] RBAC: Authorizing `identity:get_user(user_id=45cb725950b24d83bf85741c6aa46ba7)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:59.146182 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286917b-0a0d-4ca6-8a63-20f0409ca174 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:59.147738 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 25/50] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:19:59 2022] GET /identity/v3/users/45cb725950b24d83bf85741c6aa46ba7 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:19:59.153165 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2469e-5844-4ada-aceb-95f1a35aa5cf admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:59.162412 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2469e-5844-4ada-aceb-95f1a35aa5cf admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:59.166679 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a733d-3b9b-4e3f-a9cd-eec778bdf6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:59.167436 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a733d-3b9b-4e3f-a9cd-eec778bdf6be admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:59.167715 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a733d-3b9b-4e3f-a9cd-eec778bdf6be admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:59.168584 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a733d-3b9b-4e3f-a9cd-eec778bdf6be admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:59.169779 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a733d-3b9b-4e3f-a9cd-eec778bdf6be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:59.171468 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a733d-3b9b-4e3f-a9cd-eec778bdf6be admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:59.172985 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 26/51] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:19:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:19:59.178344 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286917b-0a0d-4ca6-8a63-20f0409ca174 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:19:59.187931 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286917b-0a0d-4ca6-8a63-20f0409ca174 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:19:59.192155 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6f29f-9621-4be0-8bed-8952c7e7cc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:19:59.192769 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6f29f-9621-4be0-8bed-8952c7e7cc06 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:19:59.193052 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6f29f-9621-4be0-8bed-8952c7e7cc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:19:59.193349 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6f29f-9621-4be0-8bed-8952c7e7cc06 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:19:59.194184 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6f29f-9621-4be0-8bed-8952c7e7cc06 admin admin] RBAC: Adding query filter params (role.id=9ba4a5967ed243178927661616f08901, scope.domain.id=default, user.id=45cb725950b24d83bf85741c6aa46ba7) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:19:59.194471 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6f29f-9621-4be0-8bed-8952c7e7cc06 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:19:59.195459 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-b5e6f29f-9621-4be0-8bed-8952c7e7cc06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:19:59.195459 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Feb 16 05:19:59.195459 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: Feb 16 05:19:59.196598 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6f29f-9621-4be0-8bed-8952c7e7cc06 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:19:59.203615 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 26/52] 10.222.0.75 () {56 vars in 1343 bytes} [Wed Feb 16 05:19:59 2022] GET /identity/v3/role_assignments?user.id=45cb725950b24d83bf85741c6aa46ba7&scope.domain.id=default&role.id=9ba4a5967ed243178927661616f08901 => generated 530 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:00.028143 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dbcc7-9aac-4a94-b13f-9c387513ca82 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:00.028621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dbcc7-9aac-4a94-b13f-9c387513ca82 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:00.028621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dbcc7-9aac-4a94-b13f-9c387513ca82 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:00.030408 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 27/53] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:00.035487 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc9de8-f607-4b36-b5ad-081361597058 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:00.035867 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc9de8-f607-4b36-b5ad-081361597058 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:00.036053 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc9de8-f607-4b36-b5ad-081361597058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:00.053968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-12fc9de8-f607-4b36-b5ad-081361597058 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:00.055171 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-12fc9de8-f607-4b36-b5ad-081361597058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:00.062905 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 27/54] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:00.085826 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dbcc7-9aac-4a94-b13f-9c387513ca82 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:00.098218 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dbcc7-9aac-4a94-b13f-9c387513ca82 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:00.102713 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a311261-6747-4d4f-a7a7-40de6af0be67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:00.103466 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a311261-6747-4d4f-a7a7-40de6af0be67 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:00.103747 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a311261-6747-4d4f-a7a7-40de6af0be67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:00.104022 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a311261-6747-4d4f-a7a7-40de6af0be67 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:00.105179 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a311261-6747-4d4f-a7a7-40de6af0be67 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:00.107542 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a311261-6747-4d4f-a7a7-40de6af0be67 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:00.109067 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 28/55] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:00.113971 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc9de8-f607-4b36-b5ad-081361597058 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:00.122880 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc9de8-f607-4b36-b5ad-081361597058 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:00.127231 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a9215-5def-4eae-a5c3-e6bab108b003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:00.127872 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a9215-5def-4eae-a5c3-e6bab108b003 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:00.128158 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a9215-5def-4eae-a5c3-e6bab108b003 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:00.128438 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a9215-5def-4eae-a5c3-e6bab108b003 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:00.129142 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a9215-5def-4eae-a5c3-e6bab108b003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:00.130195 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-c69a9215-5def-4eae-a5c3-e6bab108b003 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:20:00.130195 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Feb 16 05:20:00.130195 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: Feb 16 05:20:00.131408 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69a9215-5def-4eae-a5c3-e6bab108b003 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:00.158913 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 28/56] 10.222.0.75 () {60 vars in 1161 bytes} [Wed Feb 16 05:20:00 2022] POST /identity/v3/projects => generated 298 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:20:02.477801 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cc3da-84e9-4916-bbc7-cf5189a27b0e None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:02.478310 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cc3da-84e9-4916-bbc7-cf5189a27b0e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:02.478392 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cc3da-84e9-4916-bbc7-cf5189a27b0e None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:02.480108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 29/57] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:02.485226 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b45d0-7699-4027-a16a-d0cf379741f6 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:02.485647 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b45d0-7699-4027-a16a-d0cf379741f6 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:02.485807 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b45d0-7699-4027-a16a-d0cf379741f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:02.503062 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-632b45d0-7699-4027-a16a-d0cf379741f6 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:02.504248 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-632b45d0-7699-4027-a16a-d0cf379741f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:02.562104 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 29/58] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:02.586995 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cc3da-84e9-4916-bbc7-cf5189a27b0e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:02.599702 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cc3da-84e9-4916-bbc7-cf5189a27b0e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:02.606852 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2797c9e-f46a-4445-9e9d-79242e3f01d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:02.607669 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2797c9e-f46a-4445-9e9d-79242e3f01d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:02.608061 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2797c9e-f46a-4445-9e9d-79242e3f01d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:02.608431 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2797c9e-f46a-4445-9e9d-79242e3f01d6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:02.610220 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2797c9e-f46a-4445-9e9d-79242e3f01d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:02.612008 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2797c9e-f46a-4445-9e9d-79242e3f01d6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:02.614131 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 30/59] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:02.619375 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b45d0-7699-4027-a16a-d0cf379741f6 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:02.628917 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b45d0-7699-4027-a16a-d0cf379741f6 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:02.633329 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46787e09-be85-42e1-9f3d-3ecc07c598dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:02.633979 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46787e09-be85-42e1-9f3d-3ecc07c598dc admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:02.634263 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46787e09-be85-42e1-9f3d-3ecc07c598dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:02.634539 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46787e09-be85-42e1-9f3d-3ecc07c598dc admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:02.635253 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46787e09-be85-42e1-9f3d-3ecc07c598dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:02.636263 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-46787e09-be85-42e1-9f3d-3ecc07c598dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:20:02.636263 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Feb 16 05:20:02.636263 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: Feb 16 05:20:02.637533 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46787e09-be85-42e1-9f3d-3ecc07c598dc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:02.661249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 30/60] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Feb 16 05:20:02 2022] POST /identity/v3/users => generated 275 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:20:06.008648 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffe9f4-5c9d-4426-8742-9f48f2a32d38 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.009137 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffe9f4-5c9d-4426-8742-9f48f2a32d38 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.009137 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffe9f4-5c9d-4426-8742-9f48f2a32d38 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.011187 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 31/61] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:06.023820 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab7d37-d450-49f0-84f8-278b54abaab2 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.024682 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab7d37-d450-49f0-84f8-278b54abaab2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.025137 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab7d37-d450-49f0-84f8-278b54abaab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.053677 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-48ab7d37-d450-49f0-84f8-278b54abaab2 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:06.055220 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-48ab7d37-d450-49f0-84f8-278b54abaab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:06.068429 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 31/62] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:06.092541 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffe9f4-5c9d-4426-8742-9f48f2a32d38 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.109993 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffe9f4-5c9d-4426-8742-9f48f2a32d38 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.114539 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc546c-3ecf-4702-a463-b4f2517199d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.115322 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc546c-3ecf-4702-a463-b4f2517199d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.115603 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc546c-3ecf-4702-a463-b4f2517199d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.115877 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc546c-3ecf-4702-a463-b4f2517199d7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.138961 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc546c-3ecf-4702-a463-b4f2517199d7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:06.146169 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-8bcc546c-3ecf-4702-a463-b4f2517199d7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 05:20:06.147976 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 32/63] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:06.153455 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab7d37-d450-49f0-84f8-278b54abaab2 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.166314 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab7d37-d450-49f0-84f8-278b54abaab2 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.175934 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a279c73-e238-459b-8f5f-ed85ad5ab6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.176857 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a279c73-e238-459b-8f5f-ed85ad5ab6da admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.177376 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a279c73-e238-459b-8f5f-ed85ad5ab6da admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.177849 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a279c73-e238-459b-8f5f-ed85ad5ab6da admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.178819 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a279c73-e238-459b-8f5f-ed85ad5ab6da admin admin] RBAC: Adding query filter params (name=member) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:06.179318 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a279c73-e238-459b-8f5f-ed85ad5ab6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:06.181144 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a279c73-e238-459b-8f5f-ed85ad5ab6da admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:06.199145 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 32/64] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:06.204747 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc546c-3ecf-4702-a463-b4f2517199d7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.218250 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc546c-3ecf-4702-a463-b4f2517199d7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.228334 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29ad96-4558-4f7b-9ec5-9dd94d3e47f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.229199 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29ad96-4558-4f7b-9ec5-9dd94d3e47f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.229511 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29ad96-4558-4f7b-9ec5-9dd94d3e47f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.229786 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29ad96-4558-4f7b-9ec5-9dd94d3e47f9 admin admin] PATH_INFO: `/v3/users/0b70b6c41753412b8476b0e0d01f68b6` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.251797 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29ad96-4558-4f7b-9ec5-9dd94d3e47f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=0b70b6c41753412b8476b0e0d01f68b6)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:06.254057 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29ad96-4558-4f7b-9ec5-9dd94d3e47f9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:06.256067 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 33/65] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/users/0b70b6c41753412b8476b0e0d01f68b6 => generated 275 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:06.261362 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a279c73-e238-459b-8f5f-ed85ad5ab6da admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.274480 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a279c73-e238-459b-8f5f-ed85ad5ab6da admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.285511 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c70082-05f4-4a33-8dd3-9d34e133086e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.286402 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c70082-05f4-4a33-8dd3-9d34e133086e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.286905 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c70082-05f4-4a33-8dd3-9d34e133086e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.287377 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c70082-05f4-4a33-8dd3-9d34e133086e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.304953 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c70082-05f4-4a33-8dd3-9d34e133086e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:06.307335 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c70082-05f4-4a33-8dd3-9d34e133086e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:06.323058 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 33/66] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:06.329151 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29ad96-4558-4f7b-9ec5-9dd94d3e47f9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.342843 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29ad96-4558-4f7b-9ec5-9dd94d3e47f9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.352260 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216093c-6bcd-4163-9e9e-9b9e04635c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.353129 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216093c-6bcd-4163-9e9e-9b9e04635c74 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.353449 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216093c-6bcd-4163-9e9e-9b9e04635c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.353724 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216093c-6bcd-4163-9e9e-9b9e04635c74 admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.358025 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216093c-6bcd-4163-9e9e-9b9e04635c74 admin admin] RBAC: Authorizing `identity:get_project(project_id=a04bbe2fdd09464e83b9c4e39549e8ad)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:06.360174 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216093c-6bcd-4163-9e9e-9b9e04635c74 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:06.362249 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 34/67] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:06.367816 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75404075-c0ad-4742-8942-fef738c2ab86 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.368069 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216093c-6bcd-4163-9e9e-9b9e04635c74 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.368166 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75404075-c0ad-4742-8942-fef738c2ab86 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.368376 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75404075-c0ad-4742-8942-fef738c2ab86 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.370354 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 34/68] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:06.379160 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4352c5-c6db-4ec3-aadc-2a611754890d None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.379690 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4352c5-c6db-4ec3-aadc-2a611754890d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.380423 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4352c5-c6db-4ec3-aadc-2a611754890d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.382356 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216093c-6bcd-4163-9e9e-9b9e04635c74 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.392244 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa67eac-9bb3-4bbe-8649-1e7c1cb3db9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.393103 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa67eac-9bb3-4bbe-8649-1e7c1cb3db9d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.393594 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa67eac-9bb3-4bbe-8649-1e7c1cb3db9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.394045 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa67eac-9bb3-4bbe-8649-1e7c1cb3db9d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.395065 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa67eac-9bb3-4bbe-8649-1e7c1cb3db9d admin admin] RBAC: Adding query filter params (role.id=3bbfe5a5163345b2b0d0cee3ea713919, scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad, user.id=0b70b6c41753412b8476b0e0d01f68b6) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:06.396364 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa67eac-9bb3-4bbe-8649-1e7c1cb3db9d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:06.398498 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa67eac-9bb3-4bbe-8649-1e7c1cb3db9d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:06.406408 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 35/69] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/role_assignments?user.id=0b70b6c41753412b8476b0e0d01f68b6&scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad&role.id=3bbfe5a5163345b2b0d0cee3ea713919 => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:06.407719 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fda045-16c6-40f2-90b0-381e616f3494 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.408009 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fda045-16c6-40f2-90b0-381e616f3494 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.408290 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fda045-16c6-40f2-90b0-381e616f3494 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.409956 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-6a4352c5-c6db-4ec3-aadc-2a611754890d None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:06.410243 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 36/70] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:06.411561 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6a4352c5-c6db-4ec3-aadc-2a611754890d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:06.418188 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25b0c7-9030-4eab-9498-d336aff6e3f2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.418188 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25b0c7-9030-4eab-9498-d336aff6e3f2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.418188 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25b0c7-9030-4eab-9498-d336aff6e3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.427630 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 35/71] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 05:20:06.454568 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4352c5-c6db-4ec3-aadc-2a611754890d None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.454816 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-4d25b0c7-9030-4eab-9498-d336aff6e3f2 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:06.456019 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4d25b0c7-9030-4eab-9498-d336aff6e3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:06.467920 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4352c5-c6db-4ec3-aadc-2a611754890d None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.473412 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 37/72] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:06.475186 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952e21b-188a-4106-809f-9044b057092d None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.475664 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952e21b-188a-4106-809f-9044b057092d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.476144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7952e21b-188a-4106-809f-9044b057092d None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.478197 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 38/73] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:06.485295 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b5629-069d-42bd-9b66-bb4f2ef34334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.485295 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b5629-069d-42bd-9b66-bb4f2ef34334 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.485295 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b5629-069d-42bd-9b66-bb4f2ef34334 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.485295 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b5629-069d-42bd-9b66-bb4f2ef34334 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.491226 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a06997-f85d-4549-a699-bf77197aab25 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.491777 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a06997-f85d-4549-a699-bf77197aab25 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.492228 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a06997-f85d-4549-a699-bf77197aab25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.502416 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b5629-069d-42bd-9b66-bb4f2ef34334 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:06.509810 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-370b5629-069d-42bd-9b66-bb4f2ef34334 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:20:06.511290 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 36/74] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:06.512870 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b5629-069d-42bd-9b66-bb4f2ef34334 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.519932 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-47a06997-f85d-4549-a699-bf77197aab25 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:06.521344 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-47a06997-f85d-4549-a699-bf77197aab25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:06.524650 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b5629-069d-42bd-9b66-bb4f2ef34334 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.529835 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaed1ec-eb95-4fb3-82c8-c56138b5117e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.530277 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 39/75] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 05:20:06.531147 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a06997-f85d-4549-a699-bf77197aab25 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.531389 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaed1ec-eb95-4fb3-82c8-c56138b5117e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.531872 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaed1ec-eb95-4fb3-82c8-c56138b5117e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.532339 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaed1ec-eb95-4fb3-82c8-c56138b5117e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.556255 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a06997-f85d-4549-a699-bf77197aab25 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.564167 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaed1ec-eb95-4fb3-82c8-c56138b5117e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:06.567884 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8df675-c863-4e44-af9d-98426d9d90c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.568857 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8df675-c863-4e44-af9d-98426d9d90c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.569384 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8df675-c863-4e44-af9d-98426d9d90c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.569864 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8df675-c863-4e44-af9d-98426d9d90c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.570829 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8df675-c863-4e44-af9d-98426d9d90c4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:06.571394 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8df675-c863-4e44-af9d-98426d9d90c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:06.571808 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-9aaed1ec-eb95-4fb3-82c8-c56138b5117e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 05:20:06.573056 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 37/76] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:06.574371 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8df675-c863-4e44-af9d-98426d9d90c4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:06.574504 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaed1ec-eb95-4fb3-82c8-c56138b5117e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.587042 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 40/77] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:06.587736 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaed1ec-eb95-4fb3-82c8-c56138b5117e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.587880 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8df675-c863-4e44-af9d-98426d9d90c4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.596869 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a0330-0268-41d2-8a48-be2c775699c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.598159 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a0330-0268-41d2-8a48-be2c775699c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.598616 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a0330-0268-41d2-8a48-be2c775699c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.600294 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a0330-0268-41d2-8a48-be2c775699c7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.605536 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8df675-c863-4e44-af9d-98426d9d90c4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.614915 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0b135-0b3b-4709-9a7c-b08fd313fbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.615901 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0b135-0b3b-4709-9a7c-b08fd313fbdf admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.616342 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0b135-0b3b-4709-9a7c-b08fd313fbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.616800 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0b135-0b3b-4709-9a7c-b08fd313fbdf admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.619041 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a0330-0268-41d2-8a48-be2c775699c7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:06.620321 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0b135-0b3b-4709-9a7c-b08fd313fbdf admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:06.620658 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0b135-0b3b-4709-9a7c-b08fd313fbdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:06.622574 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0b135-0b3b-4709-9a7c-b08fd313fbdf admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:06.626881 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-030a0330-0268-41d2-8a48-be2c775699c7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 05:20:06.633002 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 41/78] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:06.634127 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0b135-0b3b-4709-9a7c-b08fd313fbdf admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.638418 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 38/79] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:06.643302 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a0330-0268-41d2-8a48-be2c775699c7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.653931 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0b135-0b3b-4709-9a7c-b08fd313fbdf admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.654454 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a0330-0268-41d2-8a48-be2c775699c7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.658595 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a988c-2d04-47ae-946b-5a3f30beb038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.659661 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a988c-2d04-47ae-946b-5a3f30beb038 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.659777 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a6381-5499-48ca-b15e-b43ed7f56258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.660214 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a988c-2d04-47ae-946b-5a3f30beb038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.660649 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a6381-5499-48ca-b15e-b43ed7f56258 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.660778 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a988c-2d04-47ae-946b-5a3f30beb038 admin admin] PATH_INFO: `/v3/users/45cb725950b24d83bf85741c6aa46ba7` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.660936 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a6381-5499-48ca-b15e-b43ed7f56258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.661217 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a6381-5499-48ca-b15e-b43ed7f56258 admin admin] PATH_INFO: `/v3/users/0b70b6c41753412b8476b0e0d01f68b6` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.662494 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a988c-2d04-47ae-946b-5a3f30beb038 admin admin] RBAC: Authorizing `identity:get_user(user_id=45cb725950b24d83bf85741c6aa46ba7)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:06.662608 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a6381-5499-48ca-b15e-b43ed7f56258 admin admin] RBAC: Authorizing `identity:get_user(user_id=0b70b6c41753412b8476b0e0d01f68b6)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:06.664573 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a988c-2d04-47ae-946b-5a3f30beb038 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:06.664724 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02a6381-5499-48ca-b15e-b43ed7f56258 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:06.666575 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 42/80] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/users/45cb725950b24d83bf85741c6aa46ba7 => generated 247 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:06.666889 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 39/81] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/users/0b70b6c41753412b8476b0e0d01f68b6 => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:06.667940 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a988c-2d04-47ae-946b-5a3f30beb038 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.672688 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a6381-5499-48ca-b15e-b43ed7f56258 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.681004 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a988c-2d04-47ae-946b-5a3f30beb038 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.682953 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a6381-5499-48ca-b15e-b43ed7f56258 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.686579 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b7c5f-c0e5-4e76-ac3f-f9945693f298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.687581 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b7c5f-c0e5-4e76-ac3f-f9945693f298 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.687821 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a83e3-a0a9-450a-b855-fb4a1d74aeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.688298 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b7c5f-c0e5-4e76-ac3f-f9945693f298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.688448 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a83e3-a0a9-450a-b855-fb4a1d74aeaf admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.688871 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b7c5f-c0e5-4e76-ac3f-f9945693f298 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.689071 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a83e3-a0a9-450a-b855-fb4a1d74aeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.689521 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a83e3-a0a9-450a-b855-fb4a1d74aeaf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.689973 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b7c5f-c0e5-4e76-ac3f-f9945693f298 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:06.690371 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b7c5f-c0e5-4e76-ac3f-f9945693f298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:06.692191 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b7c5f-c0e5-4e76-ac3f-f9945693f298 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:06.699192 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a83e3-a0a9-450a-b855-fb4a1d74aeaf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:06.701522 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a83e3-a0a9-450a-b855-fb4a1d74aeaf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:06.706328 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 43/82] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:06.706328 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b7c5f-c0e5-4e76-ac3f-f9945693f298 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.721780 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 40/83] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:06.722845 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a83e3-a0a9-450a-b855-fb4a1d74aeaf admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.724199 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b7c5f-c0e5-4e76-ac3f-f9945693f298 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.731636 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632ae15-2c19-47a4-aa41-3d697cde054b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.732782 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632ae15-2c19-47a4-aa41-3d697cde054b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.733208 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632ae15-2c19-47a4-aa41-3d697cde054b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.733674 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632ae15-2c19-47a4-aa41-3d697cde054b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.734857 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a83e3-a0a9-450a-b855-fb4a1d74aeaf admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.739437 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf3ae5-a233-4d49-8acf-fbd984b219e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.740379 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf3ae5-a233-4d49-8acf-fbd984b219e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.740741 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf3ae5-a233-4d49-8acf-fbd984b219e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.741020 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf3ae5-a233-4d49-8acf-fbd984b219e8 admin admin] PATH_INFO: `/v3/users/0b70b6c41753412b8476b0e0d01f68b6` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.742266 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf3ae5-a233-4d49-8acf-fbd984b219e8 admin admin] RBAC: Authorizing `identity:get_user(user_id=0b70b6c41753412b8476b0e0d01f68b6)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:06.743372 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632ae15-2c19-47a4-aa41-3d697cde054b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:06.744464 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf3ae5-a233-4d49-8acf-fbd984b219e8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:06.745628 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632ae15-2c19-47a4-aa41-3d697cde054b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:06.746123 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 41/84] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/users/0b70b6c41753412b8476b0e0d01f68b6 => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:06.746981 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf3ae5-a233-4d49-8acf-fbd984b219e8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.756437 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf3ae5-a233-4d49-8acf-fbd984b219e8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.757246 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 44/85] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:06.758258 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632ae15-2c19-47a4-aa41-3d697cde054b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.761133 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba39201-68d4-4e41-9c3c-c0643fde1562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.762119 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba39201-68d4-4e41-9c3c-c0643fde1562 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.762556 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba39201-68d4-4e41-9c3c-c0643fde1562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.762969 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba39201-68d4-4e41-9c3c-c0643fde1562 admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.764215 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba39201-68d4-4e41-9c3c-c0643fde1562 admin admin] RBAC: Authorizing `identity:get_project(project_id=a04bbe2fdd09464e83b9c4e39549e8ad)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:06.766491 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba39201-68d4-4e41-9c3c-c0643fde1562 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:06.768516 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 42/86] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:06.773414 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba39201-68d4-4e41-9c3c-c0643fde1562 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.773811 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632ae15-2c19-47a4-aa41-3d697cde054b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.783420 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e893ccf-c4d6-428c-9875-ccd527b20d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.783858 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba39201-68d4-4e41-9c3c-c0643fde1562 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.784509 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e893ccf-c4d6-428c-9875-ccd527b20d81 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.785008 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e893ccf-c4d6-428c-9875-ccd527b20d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.785513 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e893ccf-c4d6-428c-9875-ccd527b20d81 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.788466 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c7e46-01e7-4c6e-b1d4-14e49681163e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.789367 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c7e46-01e7-4c6e-b1d4-14e49681163e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.789651 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c7e46-01e7-4c6e-b1d4-14e49681163e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.789924 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c7e46-01e7-4c6e-b1d4-14e49681163e admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.791142 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c7e46-01e7-4c6e-b1d4-14e49681163e admin admin] RBAC: Authorizing `identity:get_project(project_id=a04bbe2fdd09464e83b9c4e39549e8ad)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:06.793398 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c7e46-01e7-4c6e-b1d4-14e49681163e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:06.795703 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 43/87] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:06.796065 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e893ccf-c4d6-428c-9875-ccd527b20d81 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:06.796459 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c7e46-01e7-4c6e-b1d4-14e49681163e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.798433 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e893ccf-c4d6-428c-9875-ccd527b20d81 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:06.806618 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c7e46-01e7-4c6e-b1d4-14e49681163e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.809014 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 45/88] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:06.810564 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e893ccf-c4d6-428c-9875-ccd527b20d81 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.812079 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327164f-8f8a-4ef5-b8e2-45023b9e63b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.812726 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327164f-8f8a-4ef5-b8e2-45023b9e63b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.813014 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327164f-8f8a-4ef5-b8e2-45023b9e63b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.813318 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327164f-8f8a-4ef5-b8e2-45023b9e63b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.814231 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327164f-8f8a-4ef5-b8e2-45023b9e63b1 admin admin] RBAC: Adding query filter params (role.id=997c650af0d54f31940fbb188fe4172c, scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad, user.id=0b70b6c41753412b8476b0e0d01f68b6) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:06.814598 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327164f-8f8a-4ef5-b8e2-45023b9e63b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:06.816537 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4327164f-8f8a-4ef5-b8e2-45023b9e63b1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:06.822360 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e893ccf-c4d6-428c-9875-ccd527b20d81 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.833286 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 44/89] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/role_assignments?user.id=0b70b6c41753412b8476b0e0d01f68b6&scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad&role.id=997c650af0d54f31940fbb188fe4172c => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:06.833286 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327164f-8f8a-4ef5-b8e2-45023b9e63b1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.833556 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dda16-96d0-4c06-90c2-76a1a6574186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.833556 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dda16-96d0-4c06-90c2-76a1a6574186 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.833556 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dda16-96d0-4c06-90c2-76a1a6574186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.834037 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43dda16-96d0-4c06-90c2-76a1a6574186 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.840761 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dda16-96d0-4c06-90c2-76a1a6574186 admin admin] RBAC: Adding query filter params (role.id=9ba4a5967ed243178927661616f08901, scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad, user.id=45cb725950b24d83bf85741c6aa46ba7) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:06.841060 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dda16-96d0-4c06-90c2-76a1a6574186 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:06.843545 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43dda16-96d0-4c06-90c2-76a1a6574186 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:06.849977 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327164f-8f8a-4ef5-b8e2-45023b9e63b1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.854234 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 46/90] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/role_assignments?user.id=45cb725950b24d83bf85741c6aa46ba7&scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad&role.id=9ba4a5967ed243178927661616f08901 => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:06.855319 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496d2d5-e3a1-438b-badf-8e0c881e797f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.856792 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496d2d5-e3a1-438b-badf-8e0c881e797f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.857080 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496d2d5-e3a1-438b-badf-8e0c881e797f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.857487 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496d2d5-e3a1-438b-badf-8e0c881e797f admin admin] PATH_INFO: `/v3/projects/a9fc84966fad42aa832160dd8c7f9892` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.858843 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496d2d5-e3a1-438b-badf-8e0c881e797f admin admin] RBAC: Authorizing `identity:get_project(project_id=a9fc84966fad42aa832160dd8c7f9892)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:06.861169 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496d2d5-e3a1-438b-badf-8e0c881e797f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:06.863456 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 45/91] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/projects/a9fc84966fad42aa832160dd8c7f9892 => generated 312 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:06.869483 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dda16-96d0-4c06-90c2-76a1a6574186 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:06.880555 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43dda16-96d0-4c06-90c2-76a1a6574186 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:06.885556 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecab83-b72c-4e36-88a3-d2ea5d3ad19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:06.886282 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecab83-b72c-4e36-88a3-d2ea5d3ad19f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:06.886575 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecab83-b72c-4e36-88a3-d2ea5d3ad19f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:06.886856 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecab83-b72c-4e36-88a3-d2ea5d3ad19f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:06.888284 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecab83-b72c-4e36-88a3-d2ea5d3ad19f admin admin] RBAC: Adding query filter params (role.id=3bbfe5a5163345b2b0d0cee3ea713919, scope.project.id=a9fc84966fad42aa832160dd8c7f9892, user.id=0b70b6c41753412b8476b0e0d01f68b6) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:06.888602 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecab83-b72c-4e36-88a3-d2ea5d3ad19f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:06.890664 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecab83-b72c-4e36-88a3-d2ea5d3ad19f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:06.897753 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 47/92] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:06 2022] GET /identity/v3/role_assignments?user.id=0b70b6c41753412b8476b0e0d01f68b6&scope.project.id=a9fc84966fad42aa832160dd8c7f9892&role.id=3bbfe5a5163345b2b0d0cee3ea713919 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:07.009755 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709195b-1b59-4085-a830-44b35783c4dd None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:07.010099 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709195b-1b59-4085-a830-44b35783c4dd None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:07.010332 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709195b-1b59-4085-a830-44b35783c4dd None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:07.012532 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 46/93] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:07.018575 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365646e-1af7-41f9-bfb5-7f54e6aad645 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:07.019063 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365646e-1af7-41f9-bfb5-7f54e6aad645 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:07.019063 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365646e-1af7-41f9-bfb5-7f54e6aad645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:07.051990 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-1365646e-1af7-41f9-bfb5-7f54e6aad645 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:07.053206 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-1365646e-1af7-41f9-bfb5-7f54e6aad645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:07.063207 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 48/94] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:07.088556 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709195b-1b59-4085-a830-44b35783c4dd None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:07.103720 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709195b-1b59-4085-a830-44b35783c4dd None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:07.108803 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc59d97-7578-47a4-8641-01136a6ab332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:07.109652 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc59d97-7578-47a4-8641-01136a6ab332 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:07.109995 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc59d97-7578-47a4-8641-01136a6ab332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:07.110274 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc59d97-7578-47a4-8641-01136a6ab332 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:07.111659 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc59d97-7578-47a4-8641-01136a6ab332 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:07.113573 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc59d97-7578-47a4-8641-01136a6ab332 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:07.115481 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 47/95] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:07.121389 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365646e-1af7-41f9-bfb5-7f54e6aad645 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:07.132347 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365646e-1af7-41f9-bfb5-7f54e6aad645 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:07.139310 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85944f81-4dd9-44e6-ab6f-8b5f26b0ca79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:07.139755 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85944f81-4dd9-44e6-ab6f-8b5f26b0ca79 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:07.140097 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85944f81-4dd9-44e6-ab6f-8b5f26b0ca79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:07.140382 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85944f81-4dd9-44e6-ab6f-8b5f26b0ca79 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:07.141932 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85944f81-4dd9-44e6-ab6f-8b5f26b0ca79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:07.142197 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-85944f81-4dd9-44e6-ab6f-8b5f26b0ca79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:20:07.142197 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Feb 16 05:20:07.142197 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: Feb 16 05:20:07.143495 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85944f81-4dd9-44e6-ab6f-8b5f26b0ca79 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:07.183477 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 49/96] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Feb 16 05:20:07 2022] POST /identity/v3/users => generated 289 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:20:09.207707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61474186-1c14-4202-95ec-c8f786c313a8 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:09.208322 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61474186-1c14-4202-95ec-c8f786c313a8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:09.208322 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61474186-1c14-4202-95ec-c8f786c313a8 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:09.210068 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 48/97] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:09.215449 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fe821-5c34-4a89-b8d9-60648f3fc0b9 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:09.215842 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fe821-5c34-4a89-b8d9-60648f3fc0b9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:09.216023 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4fe821-5c34-4a89-b8d9-60648f3fc0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:09.237946 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-3a4fe821-5c34-4a89-b8d9-60648f3fc0b9 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:09.239159 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3a4fe821-5c34-4a89-b8d9-60648f3fc0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:09.251721 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 50/98] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:09.282113 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61474186-1c14-4202-95ec-c8f786c313a8 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:09.299755 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61474186-1c14-4202-95ec-c8f786c313a8 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:09.309895 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d189d-a8b5-4293-bf86-8cf6e9c401dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:09.310965 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d189d-a8b5-4293-bf86-8cf6e9c401dc admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:09.311475 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d189d-a8b5-4293-bf86-8cf6e9c401dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:09.311951 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d189d-a8b5-4293-bf86-8cf6e9c401dc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:09.326351 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d189d-a8b5-4293-bf86-8cf6e9c401dc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:09.334042 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-0b7d189d-a8b5-4293-bf86-8cf6e9c401dc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 05:20:09.335824 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 49/99] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:09.342616 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fe821-5c34-4a89-b8d9-60648f3fc0b9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:09.354553 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4fe821-5c34-4a89-b8d9-60648f3fc0b9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:09.365678 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e2e67-f66b-4c6e-b8aa-47dd8168aa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:09.366358 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e2e67-f66b-4c6e-b8aa-47dd8168aa87 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:09.366637 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e2e67-f66b-4c6e-b8aa-47dd8168aa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:09.366912 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e2e67-f66b-4c6e-b8aa-47dd8168aa87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:09.367682 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e2e67-f66b-4c6e-b8aa-47dd8168aa87 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:09.367987 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e2e67-f66b-4c6e-b8aa-47dd8168aa87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:09.369688 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e2e67-f66b-4c6e-b8aa-47dd8168aa87 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:09.385220 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 51/100] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:09.391491 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d189d-a8b5-4293-bf86-8cf6e9c401dc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:09.407154 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d189d-a8b5-4293-bf86-8cf6e9c401dc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:09.413071 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cc321-b21a-4c96-a572-159e50ecd8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:09.413974 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cc321-b21a-4c96-a572-159e50ecd8df admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:09.414255 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cc321-b21a-4c96-a572-159e50ecd8df admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:09.414529 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cc321-b21a-4c96-a572-159e50ecd8df admin admin] PATH_INFO: `/v3/users/0b70b6c41753412b8476b0e0d01f68b6` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:09.415759 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cc321-b21a-4c96-a572-159e50ecd8df admin admin] RBAC: Authorizing `identity:get_user(user_id=0b70b6c41753412b8476b0e0d01f68b6)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:09.417973 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cc321-b21a-4c96-a572-159e50ecd8df admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:09.420549 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 50/101] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:09 2022] GET /identity/v3/users/0b70b6c41753412b8476b0e0d01f68b6 => generated 275 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:09.425733 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e2e67-f66b-4c6e-b8aa-47dd8168aa87 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:09.438964 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e2e67-f66b-4c6e-b8aa-47dd8168aa87 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:09.445852 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41daabf9-c687-4fa7-a350-cb4eda5b4447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:09.446705 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daabf9-c687-4fa7-a350-cb4eda5b4447 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:09.446990 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daabf9-c687-4fa7-a350-cb4eda5b4447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:09.447267 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41daabf9-c687-4fa7-a350-cb4eda5b4447 admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:09.448524 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41daabf9-c687-4fa7-a350-cb4eda5b4447 admin admin] RBAC: Authorizing `identity:get_project(project_id=a04bbe2fdd09464e83b9c4e39549e8ad)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:09.450706 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41daabf9-c687-4fa7-a350-cb4eda5b4447 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:09.452539 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 52/102] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:09 2022] GET /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:09.458136 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cc321-b21a-4c96-a572-159e50ecd8df admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:09.470772 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cc321-b21a-4c96-a572-159e50ecd8df admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:09.478437 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1be235-5ec6-4a26-a049-31da8b7e01d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:09.479338 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1be235-5ec6-4a26-a049-31da8b7e01d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:09.479689 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1be235-5ec6-4a26-a049-31da8b7e01d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:09.479964 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1be235-5ec6-4a26-a049-31da8b7e01d4 admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad/users/0b70b6c41753412b8476b0e0d01f68b6/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:09.482635 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1be235-5ec6-4a26-a049-31da8b7e01d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04bbe2fdd09464e83b9c4e39549e8ad, user_id=0b70b6c41753412b8476b0e0d01f68b6, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:09.485570 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1be235-5ec6-4a26-a049-31da8b7e01d4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:09.522569 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 51/103] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:20:09 2022] PUT /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad/users/0b70b6c41753412b8476b0e0d01f68b6/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:20:09.670505 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0082ca-ecf1-4633-b3e3-4245c4213974 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:09.671256 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0082ca-ecf1-4633-b3e3-4245c4213974 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:09.671256 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0082ca-ecf1-4633-b3e3-4245c4213974 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:09.672871 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 53/104] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:09.678715 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec2710-b37a-47c7-ad01-bfaa71634b79 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:09.679003 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec2710-b37a-47c7-ad01-bfaa71634b79 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:09.679282 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec2710-b37a-47c7-ad01-bfaa71634b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:09.705837 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-20ec2710-b37a-47c7-ad01-bfaa71634b79 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:09.707146 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-20ec2710-b37a-47c7-ad01-bfaa71634b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:09.797742 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 52/105] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:09.841679 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0082ca-ecf1-4633-b3e3-4245c4213974 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:09.855296 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0082ca-ecf1-4633-b3e3-4245c4213974 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:09.860457 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8992fd-6d65-4ac4-bf75-083a5c9c9156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:09.861274 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8992fd-6d65-4ac4-bf75-083a5c9c9156 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:09.861559 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8992fd-6d65-4ac4-bf75-083a5c9c9156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:09.861834 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8992fd-6d65-4ac4-bf75-083a5c9c9156 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:09.875985 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8992fd-6d65-4ac4-bf75-083a5c9c9156 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:09.883220 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-8d8992fd-6d65-4ac4-bf75-083a5c9c9156 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 05:20:09.884617 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 54/106] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Feb 16 05:20:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:09.890887 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec2710-b37a-47c7-ad01-bfaa71634b79 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:09.900091 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec2710-b37a-47c7-ad01-bfaa71634b79 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:09.908624 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb33fdc-cf4b-4716-8201-032d9b5a7fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:09.909311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb33fdc-cf4b-4716-8201-032d9b5a7fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:09.909643 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb33fdc-cf4b-4716-8201-032d9b5a7fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:09.909877 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb33fdc-cf4b-4716-8201-032d9b5a7fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:09.910679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb33fdc-cf4b-4716-8201-032d9b5a7fc4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:09.910987 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb33fdc-cf4b-4716-8201-032d9b5a7fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:09.912682 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb33fdc-cf4b-4716-8201-032d9b5a7fc4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:09.915816 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd7779-ca4d-4da6-a38b-e46f79340709 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:09.916102 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd7779-ca4d-4da6-a38b-e46f79340709 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:09.916375 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd7779-ca4d-4da6-a38b-e46f79340709 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:09.918940 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 55/107] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 05:20:09.924502 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52529b-969f-4c7a-a748-9202026175e2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:09.924804 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52529b-969f-4c7a-a748-9202026175e2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:09.925061 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52529b-969f-4c7a-a748-9202026175e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:09.941123 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 53/108] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:09.946704 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb33fdc-cf4b-4716-8201-032d9b5a7fc4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:09.956092 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-0b52529b-969f-4c7a-a748-9202026175e2 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:09.957307 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0b52529b-969f-4c7a-a748-9202026175e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:09.963183 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb33fdc-cf4b-4716-8201-032d9b5a7fc4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:09.984019 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d55771-c9a5-4753-8fbf-f2bb334abba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:09.985685 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 56/109] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:09.986270 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d55771-c9a5-4753-8fbf-f2bb334abba4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:09.986605 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d55771-c9a5-4753-8fbf-f2bb334abba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:09.986881 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d55771-c9a5-4753-8fbf-f2bb334abba4 admin admin] PATH_INFO: `/v3/users/0b70b6c41753412b8476b0e0d01f68b6` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:09.988321 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d55771-c9a5-4753-8fbf-f2bb334abba4 admin admin] RBAC: Authorizing `identity:get_user(user_id=0b70b6c41753412b8476b0e0d01f68b6)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:09.990664 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d55771-c9a5-4753-8fbf-f2bb334abba4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:09.992489 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 54/110] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:09 2022] GET /identity/v3/users/0b70b6c41753412b8476b0e0d01f68b6 => generated 275 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:09.997841 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52529b-969f-4c7a-a748-9202026175e2 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:10.008761 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52529b-969f-4c7a-a748-9202026175e2 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:10.013915 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fb84d-53f9-4e8a-92a0-7bdf26d8db6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:10.014819 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fb84d-53f9-4e8a-92a0-7bdf26d8db6e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:10.015105 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fb84d-53f9-4e8a-92a0-7bdf26d8db6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:10.015429 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85fb84d-53f9-4e8a-92a0-7bdf26d8db6e admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:10.017786 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85fb84d-53f9-4e8a-92a0-7bdf26d8db6e admin admin] RBAC: Authorizing `identity:get_project(project_id=a04bbe2fdd09464e83b9c4e39549e8ad)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:10.020011 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85fb84d-53f9-4e8a-92a0-7bdf26d8db6e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:10.021821 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 57/111] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:09 2022] GET /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:10.027587 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d55771-c9a5-4753-8fbf-f2bb334abba4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:10.038208 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fb84d-53f9-4e8a-92a0-7bdf26d8db6e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:10.039109 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d55771-c9a5-4753-8fbf-f2bb334abba4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:10.049915 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c98d4-45eb-4ccb-9ef9-a8b0c0e70151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:10.050791 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c98d4-45eb-4ccb-9ef9-a8b0c0e70151 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:10.051072 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c98d4-45eb-4ccb-9ef9-a8b0c0e70151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:10.051346 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c98d4-45eb-4ccb-9ef9-a8b0c0e70151 admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad/users/0b70b6c41753412b8476b0e0d01f68b6/roles/997c650af0d54f31940fbb188fe4172c` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:10.061207 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c98d4-45eb-4ccb-9ef9-a8b0c0e70151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04bbe2fdd09464e83b9c4e39549e8ad, user_id=0b70b6c41753412b8476b0e0d01f68b6, role_id=997c650af0d54f31940fbb188fe4172c)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:10.061488 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85fb84d-53f9-4e8a-92a0-7bdf26d8db6e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:10.062335 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c98d4-45eb-4ccb-9ef9-a8b0c0e70151 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:10.068853 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc0870-3d02-4996-9348-f33be40fef9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:10.070024 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc0870-3d02-4996-9348-f33be40fef9a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:10.070526 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc0870-3d02-4996-9348-f33be40fef9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:10.071008 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc0870-3d02-4996-9348-f33be40fef9a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:10.084969 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc0870-3d02-4996-9348-f33be40fef9a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:10.093870 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-e8dc0870-3d02-4996-9348-f33be40fef9a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 05:20:10.095542 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 58/112] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:10.097117 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd21cdf-8ee3-4a90-8095-14c0fca28897 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:10.097655 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd21cdf-8ee3-4a90-8095-14c0fca28897 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:10.102642 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd21cdf-8ee3-4a90-8095-14c0fca28897 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:10.104756 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 59/113] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:10.105893 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd21cdf-8ee3-4a90-8095-14c0fca28897 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:10.108557 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 55/114] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:20:10 2022] PUT /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad/users/0b70b6c41753412b8476b0e0d01f68b6/roles/997c650af0d54f31940fbb188fe4172c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:20:10.123248 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119f520-3552-4102-8824-1836652596b2 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:10.123582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119f520-3552-4102-8824-1836652596b2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:10.123814 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119f520-3552-4102-8824-1836652596b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:10.166503 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4119f520-3552-4102-8824-1836652596b2 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:10.167726 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4119f520-3552-4102-8824-1836652596b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:10.247757 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd21cdf-8ee3-4a90-8095-14c0fca28897 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:10.265994 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be40f7-3705-4473-b6b5-21d4ac2cbcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:10.266682 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be40f7-3705-4473-b6b5-21d4ac2cbcfb admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:10.266967 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be40f7-3705-4473-b6b5-21d4ac2cbcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:10.267242 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be40f7-3705-4473-b6b5-21d4ac2cbcfb admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:10.268013 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be40f7-3705-4473-b6b5-21d4ac2cbcfb admin admin] RBAC: Adding query filter params (name=member) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:10.268317 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be40f7-3705-4473-b6b5-21d4ac2cbcfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:10.270040 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be40f7-3705-4473-b6b5-21d4ac2cbcfb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:10.280301 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 56/115] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:10.288428 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 60/116] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:10.294848 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119f520-3552-4102-8824-1836652596b2 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:10.311842 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119f520-3552-4102-8824-1836652596b2 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:10.319849 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c892c-e3f3-4a44-9def-7263f20e00b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:10.320749 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c892c-e3f3-4a44-9def-7263f20e00b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:10.321024 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c892c-e3f3-4a44-9def-7263f20e00b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:10.321328 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c892c-e3f3-4a44-9def-7263f20e00b2 admin admin] PATH_INFO: `/v3/users/0b70b6c41753412b8476b0e0d01f68b6` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:10.326231 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c892c-e3f3-4a44-9def-7263f20e00b2 admin admin] RBAC: Authorizing `identity:get_user(user_id=0b70b6c41753412b8476b0e0d01f68b6)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:10.327222 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be40f7-3705-4473-b6b5-21d4ac2cbcfb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:10.328295 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c892c-e3f3-4a44-9def-7263f20e00b2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:10.330320 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 57/117] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:10 2022] GET /identity/v3/users/0b70b6c41753412b8476b0e0d01f68b6 => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:10.336555 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c892c-e3f3-4a44-9def-7263f20e00b2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:10.352213 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be40f7-3705-4473-b6b5-21d4ac2cbcfb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:10.352429 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c892c-e3f3-4a44-9def-7263f20e00b2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:10.362031 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dc479-bb5a-448e-9185-0663faf6d1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:10.363303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dc479-bb5a-448e-9185-0663faf6d1ff admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:10.363899 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dc479-bb5a-448e-9185-0663faf6d1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:10.364387 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dc479-bb5a-448e-9185-0663faf6d1ff admin admin] PATH_INFO: `/v3/projects/a9fc84966fad42aa832160dd8c7f9892` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:10.366094 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dc479-bb5a-448e-9185-0663faf6d1ff admin admin] RBAC: Authorizing `identity:get_project(project_id=a9fc84966fad42aa832160dd8c7f9892)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:10.368838 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dc479-bb5a-448e-9185-0663faf6d1ff admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:10.370883 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 58/118] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:10 2022] GET /identity/v3/projects/a9fc84966fad42aa832160dd8c7f9892 => generated 312 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:10.373249 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe30fb1-47d0-4cfe-bc70-95b78002bfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:10.374070 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe30fb1-47d0-4cfe-bc70-95b78002bfa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:10.374349 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe30fb1-47d0-4cfe-bc70-95b78002bfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:10.374617 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe30fb1-47d0-4cfe-bc70-95b78002bfa5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:10.379469 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dc479-bb5a-448e-9185-0663faf6d1ff admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:10.391870 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dc479-bb5a-448e-9185-0663faf6d1ff admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:10.396911 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ca2d1-66f0-44c8-a69c-9d21fb68f339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:10.398208 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ca2d1-66f0-44c8-a69c-9d21fb68f339 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:10.398715 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ca2d1-66f0-44c8-a69c-9d21fb68f339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:10.399252 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ca2d1-66f0-44c8-a69c-9d21fb68f339 admin admin] PATH_INFO: `/v3/projects/a9fc84966fad42aa832160dd8c7f9892/users/0b70b6c41753412b8476b0e0d01f68b6/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:10.401700 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ca2d1-66f0-44c8-a69c-9d21fb68f339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9fc84966fad42aa832160dd8c7f9892, user_id=0b70b6c41753412b8476b0e0d01f68b6, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:10.402293 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe30fb1-47d0-4cfe-bc70-95b78002bfa5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:10.405013 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ca2d1-66f0-44c8-a69c-9d21fb68f339 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:10.409100 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-fbe30fb1-47d0-4cfe-bc70-95b78002bfa5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:20:10.410518 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 61/119] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:20:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:10.417053 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe30fb1-47d0-4cfe-bc70-95b78002bfa5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:10.424711 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 59/120] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:20:10 2022] PUT /identity/v3/projects/a9fc84966fad42aa832160dd8c7f9892/users/0b70b6c41753412b8476b0e0d01f68b6/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:20:10.432439 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe30fb1-47d0-4cfe-bc70-95b78002bfa5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:10.509503 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc359f-6113-4470-903b-4d986b091185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:10.510168 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc359f-6113-4470-903b-4d986b091185 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:10.510445 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc359f-6113-4470-903b-4d986b091185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:10.510732 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc359f-6113-4470-903b-4d986b091185 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:10.511463 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc359f-6113-4470-903b-4d986b091185 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:10.511768 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc359f-6113-4470-903b-4d986b091185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:10.513455 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc359f-6113-4470-903b-4d986b091185 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:10.524687 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 62/121] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:10.531114 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ca2d1-66f0-44c8-a69c-9d21fb68f339 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:10.543385 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ca2d1-66f0-44c8-a69c-9d21fb68f339 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:10.553233 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb62c0-040c-4c30-92ac-778f1bb677db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:10.554586 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb62c0-040c-4c30-92ac-778f1bb677db admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:10.555086 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb62c0-040c-4c30-92ac-778f1bb677db admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:10.555692 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb62c0-040c-4c30-92ac-778f1bb677db admin admin] PATH_INFO: `/v3/users/45cb725950b24d83bf85741c6aa46ba7` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:10.561627 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb62c0-040c-4c30-92ac-778f1bb677db admin admin] RBAC: Authorizing `identity:get_user(user_id=45cb725950b24d83bf85741c6aa46ba7)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:10.563973 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb62c0-040c-4c30-92ac-778f1bb677db admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:10.566322 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 60/122] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:10 2022] GET /identity/v3/users/45cb725950b24d83bf85741c6aa46ba7 => generated 247 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:10.571763 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc359f-6113-4470-903b-4d986b091185 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:10.586264 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc359f-6113-4470-903b-4d986b091185 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:10.599566 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce633f-9664-4e7e-8543-03b78c366a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:10.600431 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce633f-9664-4e7e-8543-03b78c366a2f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:10.600711 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce633f-9664-4e7e-8543-03b78c366a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:10.600985 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce633f-9664-4e7e-8543-03b78c366a2f admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:10.606540 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce633f-9664-4e7e-8543-03b78c366a2f admin admin] RBAC: Authorizing `identity:get_project(project_id=a04bbe2fdd09464e83b9c4e39549e8ad)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:10.608650 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce633f-9664-4e7e-8543-03b78c366a2f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:10.610392 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 63/123] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:10 2022] GET /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:10.616310 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb62c0-040c-4c30-92ac-778f1bb677db admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:10.631727 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb62c0-040c-4c30-92ac-778f1bb677db admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:10.637711 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6ca70-7908-4a18-b84c-42ac25aa36e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:10.639059 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6ca70-7908-4a18-b84c-42ac25aa36e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:10.639576 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6ca70-7908-4a18-b84c-42ac25aa36e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:10.640309 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6ca70-7908-4a18-b84c-42ac25aa36e1 admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad/users/45cb725950b24d83bf85741c6aa46ba7/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:10.642772 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6ca70-7908-4a18-b84c-42ac25aa36e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04bbe2fdd09464e83b9c4e39549e8ad, user_id=45cb725950b24d83bf85741c6aa46ba7, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:10.645917 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6ca70-7908-4a18-b84c-42ac25aa36e1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:10.677557 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 61/124] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:20:10 2022] PUT /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad/users/45cb725950b24d83bf85741c6aa46ba7/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:20:11.403018 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd078b7-361c-4e7f-bdf7-445cd72a3ff0 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:11.404041 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd078b7-361c-4e7f-bdf7-445cd72a3ff0 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:11.404545 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd078b7-361c-4e7f-bdf7-445cd72a3ff0 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:11.406638 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 64/125] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:11.419304 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a6c7b-c6d5-48aa-b4cf-d3aab98e3652 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:11.419706 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a6c7b-c6d5-48aa-b4cf-d3aab98e3652 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:11.419872 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a6c7b-c6d5-48aa-b4cf-d3aab98e3652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:11.438695 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-157a6c7b-c6d5-48aa-b4cf-d3aab98e3652 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:11.439963 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-157a6c7b-c6d5-48aa-b4cf-d3aab98e3652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:11.499747 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 62/126] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 05:20:11.524952 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd078b7-361c-4e7f-bdf7-445cd72a3ff0 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:11.547121 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd078b7-361c-4e7f-bdf7-445cd72a3ff0 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:11.557490 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecffd6-6ab3-4e09-845d-cdb6c04f9256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:11.558267 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecffd6-6ab3-4e09-845d-cdb6c04f9256 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:11.558545 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecffd6-6ab3-4e09-845d-cdb6c04f9256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:11.558817 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecffd6-6ab3-4e09-845d-cdb6c04f9256 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:11.566036 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecffd6-6ab3-4e09-845d-cdb6c04f9256 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:11.567770 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecffd6-6ab3-4e09-845d-cdb6c04f9256 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:11.569385 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 65/127] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:11.575666 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a6c7b-c6d5-48aa-b4cf-d3aab98e3652 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:11.585136 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a6c7b-c6d5-48aa-b4cf-d3aab98e3652 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:11.597666 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad860ba-37cb-4242-a7ab-9ae34bd4954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:11.598632 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad860ba-37cb-4242-a7ab-9ae34bd4954b admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:11.599125 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad860ba-37cb-4242-a7ab-9ae34bd4954b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:11.599648 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad860ba-37cb-4242-a7ab-9ae34bd4954b admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:11.600562 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad860ba-37cb-4242-a7ab-9ae34bd4954b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:11.602939 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad860ba-37cb-4242-a7ab-9ae34bd4954b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:11.648734 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 63/128] 10.222.0.75 () {60 vars in 1162 bytes} [Wed Feb 16 05:20:11 2022] POST /identity/v3/projects => generated 302 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:20:11.653804 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fb91e-0781-4a24-ab82-bebc6aed749d None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:11.654062 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fb91e-0781-4a24-ab82-bebc6aed749d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:11.654328 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107fb91e-0781-4a24-ab82-bebc6aed749d None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:11.656334 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 66/129] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:11.662195 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd219d5-42fd-4d1b-a83a-9868c3748409 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:11.662786 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd219d5-42fd-4d1b-a83a-9868c3748409 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:11.663271 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd219d5-42fd-4d1b-a83a-9868c3748409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:11.686524 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-cfd219d5-42fd-4d1b-a83a-9868c3748409 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:11.688000 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cfd219d5-42fd-4d1b-a83a-9868c3748409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:11.756998 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 64/130] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:11.799312 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107fb91e-0781-4a24-ab82-bebc6aed749d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:11.821914 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107fb91e-0781-4a24-ab82-bebc6aed749d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:11.826952 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea572bca-6b38-4ed5-9757-2aac9162e7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:11.827729 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea572bca-6b38-4ed5-9757-2aac9162e7bb admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:11.828008 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea572bca-6b38-4ed5-9757-2aac9162e7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:11.828278 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea572bca-6b38-4ed5-9757-2aac9162e7bb admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:11.849979 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea572bca-6b38-4ed5-9757-2aac9162e7bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:11.857722 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-ea572bca-6b38-4ed5-9757-2aac9162e7bb admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 05:20:11.858984 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 67/131] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:11.865031 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd219d5-42fd-4d1b-a83a-9868c3748409 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:11.881315 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd219d5-42fd-4d1b-a83a-9868c3748409 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:11.886603 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e57629-bdf6-4c4c-a95c-da86d2afaf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:11.888167 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e57629-bdf6-4c4c-a95c-da86d2afaf00 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:11.888677 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e57629-bdf6-4c4c-a95c-da86d2afaf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:11.889142 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e57629-bdf6-4c4c-a95c-da86d2afaf00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:11.890128 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e57629-bdf6-4c4c-a95c-da86d2afaf00 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:11.890652 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e57629-bdf6-4c4c-a95c-da86d2afaf00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:11.897285 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e57629-bdf6-4c4c-a95c-da86d2afaf00 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:11.913428 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 65/132] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:11.914617 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea572bca-6b38-4ed5-9757-2aac9162e7bb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:11.936432 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea572bca-6b38-4ed5-9757-2aac9162e7bb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:11.945458 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e3926-62c4-4ec0-b436-3aa77917f607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:11.946337 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e3926-62c4-4ec0-b436-3aa77917f607 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:11.946622 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e3926-62c4-4ec0-b436-3aa77917f607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:11.946882 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e3926-62c4-4ec0-b436-3aa77917f607 admin admin] PATH_INFO: `/v3/users/7d528fa036454fd2bcb65d0dd7bdbe33` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:11.971255 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e3926-62c4-4ec0-b436-3aa77917f607 admin admin] RBAC: Authorizing `identity:get_user(user_id=7d528fa036454fd2bcb65d0dd7bdbe33)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:11.973479 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e3926-62c4-4ec0-b436-3aa77917f607 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:11.975193 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 68/133] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:11 2022] GET /identity/v3/users/7d528fa036454fd2bcb65d0dd7bdbe33 => generated 289 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:11.981002 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e57629-bdf6-4c4c-a95c-da86d2afaf00 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:11.994699 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e57629-bdf6-4c4c-a95c-da86d2afaf00 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:12.000052 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d92862-20d6-4303-ac02-1dd42ffe254e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:12.000978 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d92862-20d6-4303-ac02-1dd42ffe254e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:12.001524 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d92862-20d6-4303-ac02-1dd42ffe254e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:12.002020 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d92862-20d6-4303-ac02-1dd42ffe254e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:12.014961 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d92862-20d6-4303-ac02-1dd42ffe254e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:12.017290 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d92862-20d6-4303-ac02-1dd42ffe254e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:12.027576 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 66/134] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:12.033467 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e3926-62c4-4ec0-b436-3aa77917f607 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:12.050297 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e3926-62c4-4ec0-b436-3aa77917f607 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:12.057557 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd6450-e4cc-43c1-bf84-b60baa5d3548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:12.058405 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd6450-e4cc-43c1-bf84-b60baa5d3548 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:12.058685 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd6450-e4cc-43c1-bf84-b60baa5d3548 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:12.059480 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd6450-e4cc-43c1-bf84-b60baa5d3548 admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:12.065960 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd6450-e4cc-43c1-bf84-b60baa5d3548 admin admin] RBAC: Authorizing `identity:get_project(project_id=a04bbe2fdd09464e83b9c4e39549e8ad)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:12.068063 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd6450-e4cc-43c1-bf84-b60baa5d3548 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:12.069766 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 69/135] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:12 2022] GET /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:12.076275 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d92862-20d6-4303-ac02-1dd42ffe254e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:12.085649 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d92862-20d6-4303-ac02-1dd42ffe254e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:12.090448 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96fee2-556e-4497-9e31-5d63ea5e0f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:12.091352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96fee2-556e-4497-9e31-5d63ea5e0f3e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:12.091833 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96fee2-556e-4497-9e31-5d63ea5e0f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:12.092322 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96fee2-556e-4497-9e31-5d63ea5e0f3e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:12.093370 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96fee2-556e-4497-9e31-5d63ea5e0f3e admin admin] RBAC: Adding query filter params (role.id=360fccb712c74bd0a5871b8358626ee0, scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad, user.id=7d528fa036454fd2bcb65d0dd7bdbe33) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:12.093894 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96fee2-556e-4497-9e31-5d63ea5e0f3e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:12.095959 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96fee2-556e-4497-9e31-5d63ea5e0f3e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:12.102311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 67/136] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:12 2022] GET /identity/v3/role_assignments?user.id=7d528fa036454fd2bcb65d0dd7bdbe33&scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad&role.id=360fccb712c74bd0a5871b8358626ee0 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:13.318091 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15d18e-dacf-4f06-90f0-5591423e418e None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:13.318597 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15d18e-dacf-4f06-90f0-5591423e418e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:13.318695 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15d18e-dacf-4f06-90f0-5591423e418e None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:13.320481 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 70/137] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:13.325939 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0391c-b04c-4077-a19b-67df697d5142 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:13.326752 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0391c-b04c-4077-a19b-67df697d5142 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:13.327288 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0391c-b04c-4077-a19b-67df697d5142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:13.350221 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0ce0391c-b04c-4077-a19b-67df697d5142 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:13.351733 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0ce0391c-b04c-4077-a19b-67df697d5142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:13.364939 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 68/138] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:13.400332 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15d18e-dacf-4f06-90f0-5591423e418e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:13.420656 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15d18e-dacf-4f06-90f0-5591423e418e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:13.425322 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1074d2-d5f6-4977-a704-deb62dc0fd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:13.426131 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1074d2-d5f6-4977-a704-deb62dc0fd56 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:13.426409 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1074d2-d5f6-4977-a704-deb62dc0fd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:13.426679 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1074d2-d5f6-4977-a704-deb62dc0fd56 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:13.449430 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1074d2-d5f6-4977-a704-deb62dc0fd56 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:13.456957 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-9e1074d2-d5f6-4977-a704-deb62dc0fd56 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 05:20:13.462875 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 71/139] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:13.464301 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0391c-b04c-4077-a19b-67df697d5142 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:13.465157 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5f73b-45e1-431e-ac38-1c9f2f220f16 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:13.465478 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5f73b-45e1-431e-ac38-1c9f2f220f16 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:13.465756 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5f73b-45e1-431e-ac38-1c9f2f220f16 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:13.467480 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 72/140] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 05:20:13.472615 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3ae10-41cf-435e-a04c-18274f2eb8f4 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:13.472887 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3ae10-41cf-435e-a04c-18274f2eb8f4 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:13.473165 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee3ae10-41cf-435e-a04c-18274f2eb8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:13.481685 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0391c-b04c-4077-a19b-67df697d5142 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:13.486601 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252416e-c26d-451a-9f7b-cb81beb93e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:13.487520 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252416e-c26d-451a-9f7b-cb81beb93e6d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:13.488029 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252416e-c26d-451a-9f7b-cb81beb93e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:13.488510 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252416e-c26d-451a-9f7b-cb81beb93e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:13.489481 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252416e-c26d-451a-9f7b-cb81beb93e6d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:13.490014 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252416e-c26d-451a-9f7b-cb81beb93e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:13.491826 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252416e-c26d-451a-9f7b-cb81beb93e6d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:13.505776 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 69/141] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:13.508974 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-3ee3ae10-41cf-435e-a04c-18274f2eb8f4 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:13.508974 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3ee3ae10-41cf-435e-a04c-18274f2eb8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:13.511343 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252416e-c26d-451a-9f7b-cb81beb93e6d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:13.523829 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252416e-c26d-451a-9f7b-cb81beb93e6d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:13.533353 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 73/142] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 05:20:13.535686 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977efffc-d944-4515-b975-8a629c9e7fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:13.536791 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977efffc-d944-4515-b975-8a629c9e7fdc admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:13.537303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977efffc-d944-4515-b975-8a629c9e7fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:13.537779 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977efffc-d944-4515-b975-8a629c9e7fdc admin admin] PATH_INFO: `/v3/users/0b70b6c41753412b8476b0e0d01f68b6` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:13.539177 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977efffc-d944-4515-b975-8a629c9e7fdc admin admin] RBAC: Authorizing `identity:get_user(user_id=0b70b6c41753412b8476b0e0d01f68b6)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:13.541557 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977efffc-d944-4515-b975-8a629c9e7fdc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:13.543421 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 70/143] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:13 2022] GET /identity/v3/users/0b70b6c41753412b8476b0e0d01f68b6 => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:13.549001 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3ae10-41cf-435e-a04c-18274f2eb8f4 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:13.566423 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee3ae10-41cf-435e-a04c-18274f2eb8f4 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:13.583287 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475af04-9550-4746-8c18-ff29e8f69832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:13.583876 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475af04-9550-4746-8c18-ff29e8f69832 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:13.584159 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475af04-9550-4746-8c18-ff29e8f69832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:13.584514 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475af04-9550-4746-8c18-ff29e8f69832 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:13.585916 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977efffc-d944-4515-b975-8a629c9e7fdc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:13.597457 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475af04-9550-4746-8c18-ff29e8f69832 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:13.599199 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977efffc-d944-4515-b975-8a629c9e7fdc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:13.599323 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475af04-9550-4746-8c18-ff29e8f69832 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:13.608559 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c309e7-61dd-419c-8363-7ed87b0041c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:13.609647 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c309e7-61dd-419c-8363-7ed87b0041c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:13.610147 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c309e7-61dd-419c-8363-7ed87b0041c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:13.610620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c309e7-61dd-419c-8363-7ed87b0041c4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:13.616193 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 74/144] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:13.621915 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475af04-9550-4746-8c18-ff29e8f69832 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:13.622749 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c309e7-61dd-419c-8363-7ed87b0041c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:13.630254 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-53c309e7-61dd-419c-8363-7ed87b0041c4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 05:20:13.631733 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 71/145] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Feb 16 05:20:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:13.634990 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475af04-9550-4746-8c18-ff29e8f69832 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:13.637940 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c309e7-61dd-419c-8363-7ed87b0041c4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:13.651129 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8e1ef-6e11-4b54-991b-faa13adee316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:13.652015 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8e1ef-6e11-4b54-991b-faa13adee316 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:13.652295 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8e1ef-6e11-4b54-991b-faa13adee316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:13.652566 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8e1ef-6e11-4b54-991b-faa13adee316 admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:13.654167 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c309e7-61dd-419c-8363-7ed87b0041c4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:13.661420 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8e1ef-6e11-4b54-991b-faa13adee316 admin admin] RBAC: Authorizing `identity:get_project(project_id=a04bbe2fdd09464e83b9c4e39549e8ad)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:13.661420 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8e1ef-6e11-4b54-991b-faa13adee316 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:13.662598 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 75/146] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:13 2022] GET /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:13.664263 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0c5ce-7780-4571-b361-2dcfcde5e984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:13.665176 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0c5ce-7780-4571-b361-2dcfcde5e984 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:13.665696 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0c5ce-7780-4571-b361-2dcfcde5e984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:13.666173 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0c5ce-7780-4571-b361-2dcfcde5e984 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:13.667130 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0c5ce-7780-4571-b361-2dcfcde5e984 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:13.667658 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0c5ce-7780-4571-b361-2dcfcde5e984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:13.669622 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0c5ce-7780-4571-b361-2dcfcde5e984 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:13.671279 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8e1ef-6e11-4b54-991b-faa13adee316 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:13.685749 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 72/147] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:13.691129 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0c5ce-7780-4571-b361-2dcfcde5e984 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:13.696093 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8e1ef-6e11-4b54-991b-faa13adee316 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:13.707120 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935f7b3-f1b9-41b0-80f8-e1f7d0a06abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:13.707775 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935f7b3-f1b9-41b0-80f8-e1f7d0a06abe admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:13.708053 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935f7b3-f1b9-41b0-80f8-e1f7d0a06abe admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:13.708322 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935f7b3-f1b9-41b0-80f8-e1f7d0a06abe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:13.709171 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935f7b3-f1b9-41b0-80f8-e1f7d0a06abe admin admin] RBAC: Adding query filter params (role.id=3bbfe5a5163345b2b0d0cee3ea713919, scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad, user.id=0b70b6c41753412b8476b0e0d01f68b6) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:13.709584 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935f7b3-f1b9-41b0-80f8-e1f7d0a06abe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:13.711406 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935f7b3-f1b9-41b0-80f8-e1f7d0a06abe admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:13.711697 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0c5ce-7780-4571-b361-2dcfcde5e984 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:13.732392 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 76/148] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:13 2022] GET /identity/v3/role_assignments?user.id=0b70b6c41753412b8476b0e0d01f68b6&scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad&role.id=3bbfe5a5163345b2b0d0cee3ea713919 => generated 608 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:13.733676 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86252cb-2db8-448b-b14b-56a157b59724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:13.734562 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86252cb-2db8-448b-b14b-56a157b59724 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:13.734847 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86252cb-2db8-448b-b14b-56a157b59724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:13.735128 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86252cb-2db8-448b-b14b-56a157b59724 admin admin] PATH_INFO: `/v3/users/0b70b6c41753412b8476b0e0d01f68b6` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:13.742293 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86252cb-2db8-448b-b14b-56a157b59724 admin admin] RBAC: Authorizing `identity:get_user(user_id=0b70b6c41753412b8476b0e0d01f68b6)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:13.744500 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86252cb-2db8-448b-b14b-56a157b59724 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:13.747147 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 73/149] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:13 2022] GET /identity/v3/users/0b70b6c41753412b8476b0e0d01f68b6 => generated 275 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:13.752530 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935f7b3-f1b9-41b0-80f8-e1f7d0a06abe admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:13.776008 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935f7b3-f1b9-41b0-80f8-e1f7d0a06abe admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:13.791631 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4b7dd-88c4-4a52-96a5-ebb20647b4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:13.792289 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4b7dd-88c4-4a52-96a5-ebb20647b4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:13.792569 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4b7dd-88c4-4a52-96a5-ebb20647b4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:13.792840 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4b7dd-88c4-4a52-96a5-ebb20647b4a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:13.810317 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4b7dd-88c4-4a52-96a5-ebb20647b4a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:13.812213 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4b7dd-88c4-4a52-96a5-ebb20647b4a8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:13.829731 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 77/150] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:13.835585 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86252cb-2db8-448b-b14b-56a157b59724 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:13.856843 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86252cb-2db8-448b-b14b-56a157b59724 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:13.871623 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb47b2-76c4-4b8a-87ff-30e434f0293b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:13.872492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb47b2-76c4-4b8a-87ff-30e434f0293b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:13.872771 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb47b2-76c4-4b8a-87ff-30e434f0293b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:13.873042 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb47b2-76c4-4b8a-87ff-30e434f0293b admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:13.878023 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb47b2-76c4-4b8a-87ff-30e434f0293b admin admin] RBAC: Authorizing `identity:get_project(project_id=a04bbe2fdd09464e83b9c4e39549e8ad)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:13.880173 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb47b2-76c4-4b8a-87ff-30e434f0293b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:13.882197 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 74/151] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:13 2022] GET /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:13.888495 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4b7dd-88c4-4a52-96a5-ebb20647b4a8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:13.903278 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4b7dd-88c4-4a52-96a5-ebb20647b4a8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:13.912980 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de452b5-1357-4253-8b9f-54914bf2de17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:13.913658 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de452b5-1357-4253-8b9f-54914bf2de17 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:13.913930 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de452b5-1357-4253-8b9f-54914bf2de17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:13.914202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de452b5-1357-4253-8b9f-54914bf2de17 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:13.915043 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de452b5-1357-4253-8b9f-54914bf2de17 admin admin] RBAC: Adding query filter params (role.id=997c650af0d54f31940fbb188fe4172c, scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad, user.id=0b70b6c41753412b8476b0e0d01f68b6) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:13.915349 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de452b5-1357-4253-8b9f-54914bf2de17 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:13.917241 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de452b5-1357-4253-8b9f-54914bf2de17 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:13.930125 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 78/152] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:13 2022] GET /identity/v3/role_assignments?user.id=0b70b6c41753412b8476b0e0d01f68b6&scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad&role.id=997c650af0d54f31940fbb188fe4172c => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:13.972909 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830eb987-700f-4b7c-b1f7-d2476452e962 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:13.973285 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830eb987-700f-4b7c-b1f7-d2476452e962 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:13.973482 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830eb987-700f-4b7c-b1f7-d2476452e962 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:13.975694 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 75/153] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:13.981499 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b27ec9-5802-4292-8f6e-0a0413152262 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:13.981803 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b27ec9-5802-4292-8f6e-0a0413152262 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:13.982042 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b27ec9-5802-4292-8f6e-0a0413152262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:14.009577 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f3b27ec9-5802-4292-8f6e-0a0413152262 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:14.010798 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f3b27ec9-5802-4292-8f6e-0a0413152262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:14.024964 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 79/154] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:14.057543 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830eb987-700f-4b7c-b1f7-d2476452e962 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:14.075600 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830eb987-700f-4b7c-b1f7-d2476452e962 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:14.085829 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db67067-3d25-45ae-ba64-e58285d34477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:14.086566 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db67067-3d25-45ae-ba64-e58285d34477 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:14.086862 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db67067-3d25-45ae-ba64-e58285d34477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:14.087136 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db67067-3d25-45ae-ba64-e58285d34477 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:14.110307 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db67067-3d25-45ae-ba64-e58285d34477 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:14.117376 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-9db67067-3d25-45ae-ba64-e58285d34477 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 05:20:14.118654 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 76/155] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:14.124709 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b27ec9-5802-4292-8f6e-0a0413152262 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:14.139862 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b27ec9-5802-4292-8f6e-0a0413152262 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:14.150016 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524a2e9-97f1-4f2d-821e-5ed6f7909f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:14.150702 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524a2e9-97f1-4f2d-821e-5ed6f7909f69 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:14.150974 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524a2e9-97f1-4f2d-821e-5ed6f7909f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:14.151235 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3524a2e9-97f1-4f2d-821e-5ed6f7909f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:14.152004 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524a2e9-97f1-4f2d-821e-5ed6f7909f69 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:14.152303 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524a2e9-97f1-4f2d-821e-5ed6f7909f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:14.154578 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3524a2e9-97f1-4f2d-821e-5ed6f7909f69 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:14.172815 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 80/156] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:14.178540 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db67067-3d25-45ae-ba64-e58285d34477 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:14.191093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db67067-3d25-45ae-ba64-e58285d34477 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:14.197427 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb59663-a61d-4b07-b8cc-41652000fc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:14.198300 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb59663-a61d-4b07-b8cc-41652000fc3f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:14.198578 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb59663-a61d-4b07-b8cc-41652000fc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:14.198846 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb59663-a61d-4b07-b8cc-41652000fc3f admin admin] PATH_INFO: `/v3/users/0b70b6c41753412b8476b0e0d01f68b6` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:14.206088 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb59663-a61d-4b07-b8cc-41652000fc3f admin admin] RBAC: Authorizing `identity:get_user(user_id=0b70b6c41753412b8476b0e0d01f68b6)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:14.208267 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb59663-a61d-4b07-b8cc-41652000fc3f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:14.209969 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 77/157] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:14 2022] GET /identity/v3/users/0b70b6c41753412b8476b0e0d01f68b6 => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:14.216324 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524a2e9-97f1-4f2d-821e-5ed6f7909f69 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:14.227978 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3524a2e9-97f1-4f2d-821e-5ed6f7909f69 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:14.234920 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19649c-c0d4-44d2-9bcd-54c213d5ec63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:14.235576 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19649c-c0d4-44d2-9bcd-54c213d5ec63 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:14.235857 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19649c-c0d4-44d2-9bcd-54c213d5ec63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:14.236130 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19649c-c0d4-44d2-9bcd-54c213d5ec63 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:14.250596 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19649c-c0d4-44d2-9bcd-54c213d5ec63 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:14.252456 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19649c-c0d4-44d2-9bcd-54c213d5ec63 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:14.264072 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 81/158] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:14.269742 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb59663-a61d-4b07-b8cc-41652000fc3f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:14.287682 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb59663-a61d-4b07-b8cc-41652000fc3f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:14.297825 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842036e8-f1d6-40de-ac43-396501dfe12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:14.298677 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842036e8-f1d6-40de-ac43-396501dfe12f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:14.298958 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842036e8-f1d6-40de-ac43-396501dfe12f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:14.299230 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842036e8-f1d6-40de-ac43-396501dfe12f admin admin] PATH_INFO: `/v3/projects/a9fc84966fad42aa832160dd8c7f9892` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:14.300845 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842036e8-f1d6-40de-ac43-396501dfe12f admin admin] RBAC: Authorizing `identity:get_project(project_id=a9fc84966fad42aa832160dd8c7f9892)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:14.302955 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842036e8-f1d6-40de-ac43-396501dfe12f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:14.304640 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 78/159] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:14 2022] GET /identity/v3/projects/a9fc84966fad42aa832160dd8c7f9892 => generated 312 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:14.311123 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19649c-c0d4-44d2-9bcd-54c213d5ec63 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:14.320564 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0aee74-b650-4865-aa36-7271e18a8060 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:14.321002 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0aee74-b650-4865-aa36-7271e18a8060 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:14.321192 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0aee74-b650-4865-aa36-7271e18a8060 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:14.322750 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19649c-c0d4-44d2-9bcd-54c213d5ec63 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:14.323238 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 79/160] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:14.330792 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079302e-fb82-4bef-ad13-73d265f44285 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:14.331523 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079302e-fb82-4bef-ad13-73d265f44285 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:14.331523 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079302e-fb82-4bef-ad13-73d265f44285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:14.331805 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf29806-c0a9-47ab-8594-194255b55e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:14.332414 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf29806-c0a9-47ab-8594-194255b55e5f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:14.332697 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf29806-c0a9-47ab-8594-194255b55e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:14.332976 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf29806-c0a9-47ab-8594-194255b55e5f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:14.334200 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf29806-c0a9-47ab-8594-194255b55e5f admin admin] RBAC: Adding query filter params (role.id=3bbfe5a5163345b2b0d0cee3ea713919, scope.project.id=a9fc84966fad42aa832160dd8c7f9892, user.id=0b70b6c41753412b8476b0e0d01f68b6) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:14.334526 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf29806-c0a9-47ab-8594-194255b55e5f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:14.336631 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf29806-c0a9-47ab-8594-194255b55e5f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:14.344415 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 82/161] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:14 2022] GET /identity/v3/role_assignments?user.id=0b70b6c41753412b8476b0e0d01f68b6&scope.project.id=a9fc84966fad42aa832160dd8c7f9892&role.id=3bbfe5a5163345b2b0d0cee3ea713919 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:14.355227 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-a079302e-fb82-4bef-ad13-73d265f44285 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:14.357087 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a079302e-fb82-4bef-ad13-73d265f44285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:14.366147 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 80/162] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:14.404477 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf29806-c0a9-47ab-8594-194255b55e5f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:14.415135 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf29806-c0a9-47ab-8594-194255b55e5f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:14.422588 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fc539-f89a-4909-985c-53cd86ee764c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:14.423450 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fc539-f89a-4909-985c-53cd86ee764c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:14.423738 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fc539-f89a-4909-985c-53cd86ee764c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:14.424015 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fc539-f89a-4909-985c-53cd86ee764c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:14.444306 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fc539-f89a-4909-985c-53cd86ee764c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:14.453864 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-604fc539-f89a-4909-985c-53cd86ee764c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:20:14.455574 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 83/163] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:20:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:14.461484 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079302e-fb82-4bef-ad13-73d265f44285 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:14.471905 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a079302e-fb82-4bef-ad13-73d265f44285 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:14.476656 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed37776-cf77-4e38-9dd6-a16fbd02426a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:14.477433 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed37776-cf77-4e38-9dd6-a16fbd02426a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:14.477716 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed37776-cf77-4e38-9dd6-a16fbd02426a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:14.477986 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed37776-cf77-4e38-9dd6-a16fbd02426a admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:14.478819 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed37776-cf77-4e38-9dd6-a16fbd02426a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:14.479126 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed37776-cf77-4e38-9dd6-a16fbd02426a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:14.481418 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed37776-cf77-4e38-9dd6-a16fbd02426a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:14.490777 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 81/164] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:14.496427 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fc539-f89a-4909-985c-53cd86ee764c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:14.507921 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fc539-f89a-4909-985c-53cd86ee764c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:14.512670 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d4d11-3a10-4ea4-9c7e-bf056f84d33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:14.513576 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d4d11-3a10-4ea4-9c7e-bf056f84d33c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:14.513857 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d4d11-3a10-4ea4-9c7e-bf056f84d33c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:14.514121 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d4d11-3a10-4ea4-9c7e-bf056f84d33c admin admin] PATH_INFO: `/v3/users/45cb725950b24d83bf85741c6aa46ba7` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:14.515365 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d4d11-3a10-4ea4-9c7e-bf056f84d33c admin admin] RBAC: Authorizing `identity:get_user(user_id=45cb725950b24d83bf85741c6aa46ba7)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:14.517240 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d4d11-3a10-4ea4-9c7e-bf056f84d33c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:14.519108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 84/165] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:14 2022] GET /identity/v3/users/45cb725950b24d83bf85741c6aa46ba7 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:14.524574 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed37776-cf77-4e38-9dd6-a16fbd02426a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:14.534646 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed37776-cf77-4e38-9dd6-a16fbd02426a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:14.539292 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a38e1-c45d-4a1f-b8e9-d1e44edd1cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:14.539950 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a38e1-c45d-4a1f-b8e9-d1e44edd1cfa admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:14.540231 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a38e1-c45d-4a1f-b8e9-d1e44edd1cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:14.540507 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a38e1-c45d-4a1f-b8e9-d1e44edd1cfa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:14.549894 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a38e1-c45d-4a1f-b8e9-d1e44edd1cfa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:14.551687 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a38e1-c45d-4a1f-b8e9-d1e44edd1cfa admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:14.562537 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 82/166] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 05:20:14.568513 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d4d11-3a10-4ea4-9c7e-bf056f84d33c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:14.580277 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d4d11-3a10-4ea4-9c7e-bf056f84d33c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:14.585988 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049fb9f-7957-4227-b2de-2842d918f2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:14.587048 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049fb9f-7957-4227-b2de-2842d918f2bd admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:14.587489 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049fb9f-7957-4227-b2de-2842d918f2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:14.587914 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049fb9f-7957-4227-b2de-2842d918f2bd admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:14.589356 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049fb9f-7957-4227-b2de-2842d918f2bd admin admin] RBAC: Authorizing `identity:get_project(project_id=a04bbe2fdd09464e83b9c4e39549e8ad)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:14.592345 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049fb9f-7957-4227-b2de-2842d918f2bd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:14.594548 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 85/167] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:14 2022] GET /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:14.600824 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a38e1-c45d-4a1f-b8e9-d1e44edd1cfa admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:14.610651 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a38e1-c45d-4a1f-b8e9-d1e44edd1cfa admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:14.615791 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ed93e-bf01-4667-8736-be75fdc31568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:14.616598 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ed93e-bf01-4667-8736-be75fdc31568 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:14.617024 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ed93e-bf01-4667-8736-be75fdc31568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:14.617505 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ed93e-bf01-4667-8736-be75fdc31568 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:14.618526 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ed93e-bf01-4667-8736-be75fdc31568 admin admin] RBAC: Adding query filter params (role.id=9ba4a5967ed243178927661616f08901, scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad, user.id=45cb725950b24d83bf85741c6aa46ba7) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:14.618977 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ed93e-bf01-4667-8736-be75fdc31568 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:14.621064 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ed93e-bf01-4667-8736-be75fdc31568 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:14.627978 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 83/168] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:14 2022] GET /identity/v3/role_assignments?user.id=45cb725950b24d83bf85741c6aa46ba7&scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad&role.id=9ba4a5967ed243178927661616f08901 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:15.284498 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209672a9-215a-4824-b1cf-91377a37af70 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:15.284776 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209672a9-215a-4824-b1cf-91377a37af70 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:15.285047 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209672a9-215a-4824-b1cf-91377a37af70 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:15.286850 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 86/169] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:15.292138 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada6d51-af4c-4ed0-98e2-5fc622a88a7d None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:15.292426 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada6d51-af4c-4ed0-98e2-5fc622a88a7d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:15.292702 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada6d51-af4c-4ed0-98e2-5fc622a88a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:15.311216 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-3ada6d51-af4c-4ed0-98e2-5fc622a88a7d None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:15.312388 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3ada6d51-af4c-4ed0-98e2-5fc622a88a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:15.319721 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 84/170] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:15.344649 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209672a9-215a-4824-b1cf-91377a37af70 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:15.357081 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209672a9-215a-4824-b1cf-91377a37af70 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:15.361549 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69107b-3c7c-4980-8dcc-2b42c05c9387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:15.362303 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69107b-3c7c-4980-8dcc-2b42c05c9387 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:15.362578 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69107b-3c7c-4980-8dcc-2b42c05c9387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:15.362843 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69107b-3c7c-4980-8dcc-2b42c05c9387 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:15.363976 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69107b-3c7c-4980-8dcc-2b42c05c9387 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:15.365754 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69107b-3c7c-4980-8dcc-2b42c05c9387 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:15.367293 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 87/171] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:15.372923 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada6d51-af4c-4ed0-98e2-5fc622a88a7d None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:15.381780 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada6d51-af4c-4ed0-98e2-5fc622a88a7d None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:15.386082 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a72e7-2f5b-4dcb-894c-696919a36d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:15.386725 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a72e7-2f5b-4dcb-894c-696919a36d2b admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:15.387045 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a72e7-2f5b-4dcb-894c-696919a36d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:15.387320 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a72e7-2f5b-4dcb-894c-696919a36d2b admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:15.388040 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a72e7-2f5b-4dcb-894c-696919a36d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:15.389987 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a72e7-2f5b-4dcb-894c-696919a36d2b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:15.409658 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 85/172] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Feb 16 05:20:15 2022] POST /identity/v3/users => generated 283 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:20:15.485521 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8f92d-f819-40ef-9251-ac1e8b143fab None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:15.485801 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8f92d-f819-40ef-9251-ac1e8b143fab None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:15.486071 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8f92d-f819-40ef-9251-ac1e8b143fab None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:15.487844 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 88/173] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:15.493736 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cc4a1-5a5c-4846-bd03-01c68e87c970 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:15.494031 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cc4a1-5a5c-4846-bd03-01c68e87c970 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:15.494309 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3cc4a1-5a5c-4846-bd03-01c68e87c970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:15.513879 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0e3cc4a1-5a5c-4846-bd03-01c68e87c970 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:15.515389 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0e3cc4a1-5a5c-4846-bd03-01c68e87c970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:15.523146 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 86/174] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:15.546429 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8f92d-f819-40ef-9251-ac1e8b143fab None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:15.561382 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8f92d-f819-40ef-9251-ac1e8b143fab None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:15.565839 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fab71-70ec-4ab5-a537-07c77da3fbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:15.566637 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fab71-70ec-4ab5-a537-07c77da3fbca admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:15.566919 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fab71-70ec-4ab5-a537-07c77da3fbca admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:15.567189 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fab71-70ec-4ab5-a537-07c77da3fbca admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:15.579009 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fab71-70ec-4ab5-a537-07c77da3fbca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:15.585949 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-351fab71-70ec-4ab5-a537-07c77da3fbca admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 05:20:15.587155 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 89/175] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:15.593065 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cc4a1-5a5c-4846-bd03-01c68e87c970 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:15.603087 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3cc4a1-5a5c-4846-bd03-01c68e87c970 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:15.607650 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7359216-02b4-4a6b-9ab3-b020e933ee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:15.612205 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7359216-02b4-4a6b-9ab3-b020e933ee60 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:15.612493 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7359216-02b4-4a6b-9ab3-b020e933ee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:15.614060 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7359216-02b4-4a6b-9ab3-b020e933ee60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:15.614060 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7359216-02b4-4a6b-9ab3-b020e933ee60 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:15.614060 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7359216-02b4-4a6b-9ab3-b020e933ee60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:15.617128 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7359216-02b4-4a6b-9ab3-b020e933ee60 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:15.629209 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 87/176] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:15.634985 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fab71-70ec-4ab5-a537-07c77da3fbca admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:15.646308 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fab71-70ec-4ab5-a537-07c77da3fbca admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:15.650767 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125354a-0add-48cb-9476-dbd8a44a1cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:15.651615 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125354a-0add-48cb-9476-dbd8a44a1cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:15.651892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125354a-0add-48cb-9476-dbd8a44a1cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:15.652157 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125354a-0add-48cb-9476-dbd8a44a1cd1 admin admin] PATH_INFO: `/v3/users/7d528fa036454fd2bcb65d0dd7bdbe33` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:15.653884 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125354a-0add-48cb-9476-dbd8a44a1cd1 admin admin] RBAC: Authorizing `identity:get_user(user_id=7d528fa036454fd2bcb65d0dd7bdbe33)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:15.656068 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125354a-0add-48cb-9476-dbd8a44a1cd1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:15.657690 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 90/177] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:15 2022] GET /identity/v3/users/7d528fa036454fd2bcb65d0dd7bdbe33 => generated 289 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:15.663169 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7359216-02b4-4a6b-9ab3-b020e933ee60 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:15.676141 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7359216-02b4-4a6b-9ab3-b020e933ee60 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:15.680726 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ea273-66e1-41c4-a335-0ad3f7634f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:15.681634 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ea273-66e1-41c4-a335-0ad3f7634f92 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:15.682175 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ea273-66e1-41c4-a335-0ad3f7634f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:15.682442 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ea273-66e1-41c4-a335-0ad3f7634f92 admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:15.683602 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ea273-66e1-41c4-a335-0ad3f7634f92 admin admin] RBAC: Authorizing `identity:get_project(project_id=a04bbe2fdd09464e83b9c4e39549e8ad)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:15.686243 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ea273-66e1-41c4-a335-0ad3f7634f92 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:15.687912 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 88/178] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:15 2022] GET /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:15.693606 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125354a-0add-48cb-9476-dbd8a44a1cd1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:15.704636 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125354a-0add-48cb-9476-dbd8a44a1cd1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:15.709187 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba5b9d-6c85-4344-a078-7cb4d5a41cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:15.710149 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba5b9d-6c85-4344-a078-7cb4d5a41cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:15.710500 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba5b9d-6c85-4344-a078-7cb4d5a41cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:15.710832 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba5b9d-6c85-4344-a078-7cb4d5a41cb5 admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad/users/7d528fa036454fd2bcb65d0dd7bdbe33/roles/360fccb712c74bd0a5871b8358626ee0` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:15.712843 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba5b9d-6c85-4344-a078-7cb4d5a41cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04bbe2fdd09464e83b9c4e39549e8ad, user_id=7d528fa036454fd2bcb65d0dd7bdbe33, role_id=360fccb712c74bd0a5871b8358626ee0)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:15.713988 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-f8ba5b9d-6c85-4344-a078-7cb4d5a41cb5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:20:15.713988 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Feb 16 05:20:15.713988 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: Feb 16 05:20:15.716105 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba5b9d-6c85-4344-a078-7cb4d5a41cb5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:15.733108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 91/179] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:20:15 2022] PUT /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad/users/7d528fa036454fd2bcb65d0dd7bdbe33/roles/360fccb712c74bd0a5871b8358626ee0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:20:17.874155 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846dbee-7ace-4438-9c6d-c19a6a915019 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:17.874649 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846dbee-7ace-4438-9c6d-c19a6a915019 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:17.874721 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846dbee-7ace-4438-9c6d-c19a6a915019 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:17.876452 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 89/180] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:17.881994 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc8c4b-1c64-43c2-889b-0dbbff46252a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:17.882457 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc8c4b-1c64-43c2-889b-0dbbff46252a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:17.882531 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc8c4b-1c64-43c2-889b-0dbbff46252a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:17.901029 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-b5dc8c4b-1c64-43c2-889b-0dbbff46252a None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:17.902267 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b5dc8c4b-1c64-43c2-889b-0dbbff46252a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:17.966128 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 92/181] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 05:20:17.989854 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846dbee-7ace-4438-9c6d-c19a6a915019 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:18.002179 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846dbee-7ace-4438-9c6d-c19a6a915019 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:18.006606 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f0b35-52d6-429d-a3e6-85e8900a480f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:18.007389 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f0b35-52d6-429d-a3e6-85e8900a480f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.007670 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f0b35-52d6-429d-a3e6-85e8900a480f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.007946 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f0b35-52d6-429d-a3e6-85e8900a480f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.019783 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f0b35-52d6-429d-a3e6-85e8900a480f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:18.026762 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-a02f0b35-52d6-429d-a3e6-85e8900a480f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:20:18.028526 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 90/182] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:20:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:18.034421 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc8c4b-1c64-43c2-889b-0dbbff46252a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:18.044112 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc8c4b-1c64-43c2-889b-0dbbff46252a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:18.048555 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a210b0-00e8-4834-85bc-de65068ebba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:18.049209 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a210b0-00e8-4834-85bc-de65068ebba3 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.049513 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a210b0-00e8-4834-85bc-de65068ebba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.049782 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a210b0-00e8-4834-85bc-de65068ebba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.050532 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a210b0-00e8-4834-85bc-de65068ebba3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:18.050834 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a210b0-00e8-4834-85bc-de65068ebba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:18.052478 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a210b0-00e8-4834-85bc-de65068ebba3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:18.057419 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de51063-2468-4bc9-80f7-e8d1d6d3a510 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.057715 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de51063-2468-4bc9-80f7-e8d1d6d3a510 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.057995 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de51063-2468-4bc9-80f7-e8d1d6d3a510 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.059866 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 91/183] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 05:20:18.061002 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd259c10-a4ee-4b92-88a4-dba6e2272f55 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.061324 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd259c10-a4ee-4b92-88a4-dba6e2272f55 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.061603 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd259c10-a4ee-4b92-88a4-dba6e2272f55 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.063663 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 92/184] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:18.064073 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 93/185] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:18.064847 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b0c46-211a-42a7-9735-44ec98619afd None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.065104 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b0c46-211a-42a7-9735-44ec98619afd None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.065424 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b0c46-211a-42a7-9735-44ec98619afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.069572 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a210b0-00e8-4834-85bc-de65068ebba3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:18.079394 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a210b0-00e8-4834-85bc-de65068ebba3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:18.083649 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb947a-435b-4876-8d64-66faaf8b9ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:18.084276 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-cf8b0c46-211a-42a7-9735-44ec98619afd None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:18.084528 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb947a-435b-4876-8d64-66faaf8b9ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.084804 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb947a-435b-4876-8d64-66faaf8b9ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.085073 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb947a-435b-4876-8d64-66faaf8b9ea9 admin admin] PATH_INFO: `/v3/users/ea07f49165244337b8cdcca035332d51` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.085552 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cf8b0c46-211a-42a7-9735-44ec98619afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:18.093490 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 93/186] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 05:20:18.094828 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8f7b4-739c-460a-99b9-d4559482cb0f None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.095119 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8f7b4-739c-460a-99b9-d4559482cb0f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.095401 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8f7b4-739c-460a-99b9-d4559482cb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.099513 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb947a-435b-4876-8d64-66faaf8b9ea9 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea07f49165244337b8cdcca035332d51)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:18.101740 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb947a-435b-4876-8d64-66faaf8b9ea9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:18.103476 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 94/187] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:18 2022] GET /identity/v3/users/ea07f49165244337b8cdcca035332d51 => generated 283 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:18.108431 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595447b7-3849-4328-8227-3447a0449db4 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.108431 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595447b7-3849-4328-8227-3447a0449db4 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.108431 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595447b7-3849-4328-8227-3447a0449db4 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.108431 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 95/188] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:18.109272 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595447b7-3849-4328-8227-3447a0449db4 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:18.113467 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2fa8f7b4-739c-460a-99b9-d4559482cb0f None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:18.114641 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2fa8f7b4-739c-460a-99b9-d4559482cb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:18.121680 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595447b7-3849-4328-8227-3447a0449db4 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:18.122199 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 94/189] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:18.123530 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f4542-b135-4558-aec9-fe197b8299fd None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.123813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f4542-b135-4558-aec9-fe197b8299fd None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.124083 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f4542-b135-4558-aec9-fe197b8299fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.125981 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707415ff-cc70-42a9-b64f-59fba02be317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:18.126584 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707415ff-cc70-42a9-b64f-59fba02be317 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.126859 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707415ff-cc70-42a9-b64f-59fba02be317 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.127132 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707415ff-cc70-42a9-b64f-59fba02be317 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.134923 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707415ff-cc70-42a9-b64f-59fba02be317 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:18.136753 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707415ff-cc70-42a9-b64f-59fba02be317 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:18.141771 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-564f4542-b135-4558-aec9-fe197b8299fd None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:18.142947 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-564f4542-b135-4558-aec9-fe197b8299fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:18.146014 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 96/190] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:18.146804 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707415ff-cc70-42a9-b64f-59fba02be317 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:18.150627 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 95/191] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:18.151444 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f4542-b135-4558-aec9-fe197b8299fd None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:18.155905 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707415ff-cc70-42a9-b64f-59fba02be317 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:18.160178 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbd424-b4cb-4d7c-92dd-9a9bbd76878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:18.160920 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbd424-b4cb-4d7c-92dd-9a9bbd76878f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.161193 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbd424-b4cb-4d7c-92dd-9a9bbd76878f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.161489 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbd424-b4cb-4d7c-92dd-9a9bbd76878f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.161638 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f4542-b135-4558-aec9-fe197b8299fd None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:18.162666 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbd424-b4cb-4d7c-92dd-9a9bbd76878f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:18.164276 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbd424-b4cb-4d7c-92dd-9a9bbd76878f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:18.165931 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 97/192] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:18.166090 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834e117-cedc-4ba2-bd7d-a5d93c136a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:18.166509 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbd424-b4cb-4d7c-92dd-9a9bbd76878f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:18.166911 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834e117-cedc-4ba2-bd7d-a5d93c136a41 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.167198 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834e117-cedc-4ba2-bd7d-a5d93c136a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.167470 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834e117-cedc-4ba2-bd7d-a5d93c136a41 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.175479 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbd424-b4cb-4d7c-92dd-9a9bbd76878f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:18.178089 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834e117-cedc-4ba2-bd7d-a5d93c136a41 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:18.179633 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f6e1b-8d97-4165-9cd2-3ff13a3b1e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:18.180399 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f6e1b-8d97-4165-9cd2-3ff13a3b1e54 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.180673 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f6e1b-8d97-4165-9cd2-3ff13a3b1e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.180939 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f6e1b-8d97-4165-9cd2-3ff13a3b1e54 admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.182372 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f6e1b-8d97-4165-9cd2-3ff13a3b1e54 admin admin] RBAC: Authorizing `identity:get_project(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:18.184453 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f6e1b-8d97-4165-9cd2-3ff13a3b1e54 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:18.185615 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-8834e117-cedc-4ba2-bd7d-a5d93c136a41 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 05:20:18.186073 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 98/193] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:18 2022] GET /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:18.186761 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f6e1b-8d97-4165-9cd2-3ff13a3b1e54 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:18.186859 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 96/194] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Feb 16 05:20:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:18.187690 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834e117-cedc-4ba2-bd7d-a5d93c136a41 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:18.200086 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834e117-cedc-4ba2-bd7d-a5d93c136a41 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:18.200230 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f6e1b-8d97-4165-9cd2-3ff13a3b1e54 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:18.204210 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b32a69-92d9-4e99-97a5-31e5529b54ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:18.204326 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eeea4d-9d38-45ef-8ce6-6eb6a7d9e921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:18.204919 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eeea4d-9d38-45ef-8ce6-6eb6a7d9e921 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.205007 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b32a69-92d9-4e99-97a5-31e5529b54ba admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.205189 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b32a69-92d9-4e99-97a5-31e5529b54ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.205294 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eeea4d-9d38-45ef-8ce6-6eb6a7d9e921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.205487 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b32a69-92d9-4e99-97a5-31e5529b54ba admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.205662 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eeea4d-9d38-45ef-8ce6-6eb6a7d9e921 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.206180 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eeea4d-9d38-45ef-8ce6-6eb6a7d9e921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:18.208076 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eeea4d-9d38-45ef-8ce6-6eb6a7d9e921 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:18.216328 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b32a69-92d9-4e99-97a5-31e5529b54ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:18.224260 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-22b32a69-92d9-4e99-97a5-31e5529b54ba admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 05:20:18.225432 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 97/195] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:18.226163 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b32a69-92d9-4e99-97a5-31e5529b54ba admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:18.227658 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 99/196] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Feb 16 05:20:18 2022] POST /identity/v3/users => generated 297 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:20:18.234397 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eeea4d-9d38-45ef-8ce6-6eb6a7d9e921 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:18.235623 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b32a69-92d9-4e99-97a5-31e5529b54ba admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:18.240023 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b66a0a-7f54-4c8c-b0d2-88e31bacf4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:18.240682 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b66a0a-7f54-4c8c-b0d2-88e31bacf4eb admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.240961 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b66a0a-7f54-4c8c-b0d2-88e31bacf4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.241231 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b66a0a-7f54-4c8c-b0d2-88e31bacf4eb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.242131 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b66a0a-7f54-4c8c-b0d2-88e31bacf4eb admin admin] RBAC: Adding query filter params (role.id=9ba4a5967ed243178927661616f08901, scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6, user.id=ea07f49165244337b8cdcca035332d51) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:18.242435 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b66a0a-7f54-4c8c-b0d2-88e31bacf4eb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:18.244364 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b66a0a-7f54-4c8c-b0d2-88e31bacf4eb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:18.245669 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eeea4d-9d38-45ef-8ce6-6eb6a7d9e921 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:18.250846 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342dc9c-8f5e-4ecb-8269-666f6299291c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:18.251068 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 98/197] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:18 2022] GET /identity/v3/role_assignments?user.id=ea07f49165244337b8cdcca035332d51&scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6&role.id=9ba4a5967ed243178927661616f08901 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:18.251858 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b66a0a-7f54-4c8c-b0d2-88e31bacf4eb admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:18.252310 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342dc9c-8f5e-4ecb-8269-666f6299291c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.252667 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342dc9c-8f5e-4ecb-8269-666f6299291c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.253019 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342dc9c-8f5e-4ecb-8269-666f6299291c admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.253936 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342dc9c-8f5e-4ecb-8269-666f6299291c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:18.254315 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342dc9c-8f5e-4ecb-8269-666f6299291c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:18.256114 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342dc9c-8f5e-4ecb-8269-666f6299291c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:18.272477 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b66a0a-7f54-4c8c-b0d2-88e31bacf4eb admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:18.275649 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 100/198] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:18.277556 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30453a97-b1f9-4bb3-a78b-a823c4a5ce8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:18.278858 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30453a97-b1f9-4bb3-a78b-a823c4a5ce8a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.279204 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30453a97-b1f9-4bb3-a78b-a823c4a5ce8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.279543 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30453a97-b1f9-4bb3-a78b-a823c4a5ce8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.280391 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30453a97-b1f9-4bb3-a78b-a823c4a5ce8a admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:18.281004 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30453a97-b1f9-4bb3-a78b-a823c4a5ce8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:18.282288 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342dc9c-8f5e-4ecb-8269-666f6299291c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:18.282568 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30453a97-b1f9-4bb3-a78b-a823c4a5ce8a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:18.292865 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 99/199] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:18.299224 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30453a97-b1f9-4bb3-a78b-a823c4a5ce8a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:18.300742 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342dc9c-8f5e-4ecb-8269-666f6299291c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:18.307114 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eaf0e-f93f-4885-a37a-c30f5cb52320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:18.308603 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eaf0e-f93f-4885-a37a-c30f5cb52320 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.309645 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eaf0e-f93f-4885-a37a-c30f5cb52320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.310100 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eaf0e-f93f-4885-a37a-c30f5cb52320 admin admin] PATH_INFO: `/v3/users/ea07f49165244337b8cdcca035332d51` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.310781 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30453a97-b1f9-4bb3-a78b-a823c4a5ce8a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:18.312022 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934eaf0e-f93f-4885-a37a-c30f5cb52320 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea07f49165244337b8cdcca035332d51)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:18.315347 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934eaf0e-f93f-4885-a37a-c30f5cb52320 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:18.315927 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549147f-f8e4-4f7a-af9c-afa15023d37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:18.316955 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549147f-f8e4-4f7a-af9c-afa15023d37e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.317380 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549147f-f8e4-4f7a-af9c-afa15023d37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.317724 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549147f-f8e4-4f7a-af9c-afa15023d37e admin admin] PATH_INFO: `/v3/users/7d528fa036454fd2bcb65d0dd7bdbe33` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.318790 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 101/200] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:18 2022] GET /identity/v3/users/ea07f49165244337b8cdcca035332d51 => generated 283 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:18.319248 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549147f-f8e4-4f7a-af9c-afa15023d37e admin admin] RBAC: Authorizing `identity:get_user(user_id=7d528fa036454fd2bcb65d0dd7bdbe33)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:18.325364 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549147f-f8e4-4f7a-af9c-afa15023d37e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:18.325364 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 100/201] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:18 2022] GET /identity/v3/users/7d528fa036454fd2bcb65d0dd7bdbe33 => generated 289 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:18.326765 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eaf0e-f93f-4885-a37a-c30f5cb52320 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:18.329284 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549147f-f8e4-4f7a-af9c-afa15023d37e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:18.338774 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eaf0e-f93f-4885-a37a-c30f5cb52320 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:18.339576 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549147f-f8e4-4f7a-af9c-afa15023d37e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:18.344217 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee95ccc-4f12-4b22-a579-8b9a00b64eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:18.344713 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a387c1-f433-42ef-9fe2-b633ee9ee66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:18.345431 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee95ccc-4f12-4b22-a579-8b9a00b64eed admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.345550 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a387c1-f433-42ef-9fe2-b633ee9ee66d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.345885 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a387c1-f433-42ef-9fe2-b633ee9ee66d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.346172 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee95ccc-4f12-4b22-a579-8b9a00b64eed admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.346277 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a387c1-f433-42ef-9fe2-b633ee9ee66d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.346669 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee95ccc-4f12-4b22-a579-8b9a00b64eed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.356349 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a387c1-f433-42ef-9fe2-b633ee9ee66d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:18.356785 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee95ccc-4f12-4b22-a579-8b9a00b64eed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:18.358390 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a387c1-f433-42ef-9fe2-b633ee9ee66d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:18.358976 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee95ccc-4f12-4b22-a579-8b9a00b64eed admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:18.377560 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 102/202] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:18.377756 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 101/203] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 05:20:18.379213 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee95ccc-4f12-4b22-a579-8b9a00b64eed admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:18.384637 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a387c1-f433-42ef-9fe2-b633ee9ee66d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:18.390864 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee95ccc-4f12-4b22-a579-8b9a00b64eed admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:18.394510 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a387c1-f433-42ef-9fe2-b633ee9ee66d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:18.396498 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b30feb-17c2-450f-a811-12e4a92d9669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:18.397649 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b30feb-17c2-450f-a811-12e4a92d9669 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.398111 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b30feb-17c2-450f-a811-12e4a92d9669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.398557 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b30feb-17c2-450f-a811-12e4a92d9669 admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.399793 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d6026-8685-454f-b8a6-4130e03383e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:18.400238 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b30feb-17c2-450f-a811-12e4a92d9669 admin admin] RBAC: Authorizing `identity:get_project(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:18.400842 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d6026-8685-454f-b8a6-4130e03383e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.401187 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d6026-8685-454f-b8a6-4130e03383e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.401576 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d6026-8685-454f-b8a6-4130e03383e6 admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.403170 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d6026-8685-454f-b8a6-4130e03383e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=a04bbe2fdd09464e83b9c4e39549e8ad)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:18.403995 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b30feb-17c2-450f-a811-12e4a92d9669 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:18.405559 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d6026-8685-454f-b8a6-4130e03383e6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:18.411280 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 102/204] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:18 2022] GET /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:18.411471 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 103/205] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:18 2022] GET /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:18.413071 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d6026-8685-454f-b8a6-4130e03383e6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:18.419727 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b30feb-17c2-450f-a811-12e4a92d9669 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:18.431013 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d6026-8685-454f-b8a6-4130e03383e6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:18.434981 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b30feb-17c2-450f-a811-12e4a92d9669 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:18.438895 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf202b-8751-43fb-aed3-d6f805556259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:18.439896 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbc24e-c9d2-41a1-8250-357f88e731ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:18.440122 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf202b-8751-43fb-aed3-d6f805556259 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.440547 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbc24e-c9d2-41a1-8250-357f88e731ac admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:18.440794 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf202b-8751-43fb-aed3-d6f805556259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.440899 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbc24e-c9d2-41a1-8250-357f88e731ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:18.441126 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbc24e-c9d2-41a1-8250-357f88e731ac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.441573 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf202b-8751-43fb-aed3-d6f805556259 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:18.442066 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbc24e-c9d2-41a1-8250-357f88e731ac admin admin] RBAC: Adding query filter params (role.id=360fccb712c74bd0a5871b8358626ee0, scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad, user.id=7d528fa036454fd2bcb65d0dd7bdbe33) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:18.442373 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbc24e-c9d2-41a1-8250-357f88e731ac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:18.442998 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf202b-8751-43fb-aed3-d6f805556259 admin admin] RBAC: Adding query filter params (role.id=997c650af0d54f31940fbb188fe4172c, scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6, user.id=ea07f49165244337b8cdcca035332d51) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:18.443480 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf202b-8751-43fb-aed3-d6f805556259 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:18.444289 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbc24e-c9d2-41a1-8250-357f88e731ac admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:18.445782 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf202b-8751-43fb-aed3-d6f805556259 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:18.451666 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 104/206] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:18 2022] GET /identity/v3/role_assignments?user.id=7d528fa036454fd2bcb65d0dd7bdbe33&scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad&role.id=360fccb712c74bd0a5871b8358626ee0 => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:18.452707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 103/207] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:18 2022] GET /identity/v3/role_assignments?user.id=ea07f49165244337b8cdcca035332d51&scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6&role.id=997c650af0d54f31940fbb188fe4172c => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:20.618998 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c949e-2b37-4c2d-8594-f3331e4a9d5e None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:20.619531 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c949e-2b37-4c2d-8594-f3331e4a9d5e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:20.619807 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c949e-2b37-4c2d-8594-f3331e4a9d5e None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:20.622487 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 105/208] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:20.627942 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0377f-1677-4d10-b672-5e3cea6da990 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:20.628346 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0377f-1677-4d10-b672-5e3cea6da990 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:20.628512 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0377f-1677-4d10-b672-5e3cea6da990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:20.646224 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-85d0377f-1677-4d10-b672-5e3cea6da990 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:20.647411 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-85d0377f-1677-4d10-b672-5e3cea6da990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:20.655282 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 104/209] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:20.680132 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c949e-2b37-4c2d-8594-f3331e4a9d5e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:20.693164 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c949e-2b37-4c2d-8594-f3331e4a9d5e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:20.697515 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e04bf-9451-4217-a552-148c123061c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:20.698276 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e04bf-9451-4217-a552-148c123061c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:20.698550 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e04bf-9451-4217-a552-148c123061c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:20.698815 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e04bf-9451-4217-a552-148c123061c0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:20.709988 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514e04bf-9451-4217-a552-148c123061c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:20.717364 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-514e04bf-9451-4217-a552-148c123061c0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:20:20.718554 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 106/210] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:20:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:20.724688 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0377f-1677-4d10-b672-5e3cea6da990 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:20.733705 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0377f-1677-4d10-b672-5e3cea6da990 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:20.738135 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e931b-0c5f-4e4b-a45b-3abd2fa1b2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:20.738778 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e931b-0c5f-4e4b-a45b-3abd2fa1b2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:20.739050 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e931b-0c5f-4e4b-a45b-3abd2fa1b2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:20.739318 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e931b-0c5f-4e4b-a45b-3abd2fa1b2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:20.740058 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e931b-0c5f-4e4b-a45b-3abd2fa1b2a4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:20.740355 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e931b-0c5f-4e4b-a45b-3abd2fa1b2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:20.742050 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e931b-0c5f-4e4b-a45b-3abd2fa1b2a4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:20.751543 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 105/211] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:20.756991 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e04bf-9451-4217-a552-148c123061c0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:20.767265 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e04bf-9451-4217-a552-148c123061c0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:20.771671 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73a074-0f40-4b5b-9d98-124ed20e3c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:20.772519 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73a074-0f40-4b5b-9d98-124ed20e3c06 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:20.772793 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73a074-0f40-4b5b-9d98-124ed20e3c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:20.773120 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73a074-0f40-4b5b-9d98-124ed20e3c06 admin admin] PATH_INFO: `/v3/users/ea07f49165244337b8cdcca035332d51` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:20.774410 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73a074-0f40-4b5b-9d98-124ed20e3c06 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea07f49165244337b8cdcca035332d51)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:20.776559 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73a074-0f40-4b5b-9d98-124ed20e3c06 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:20.778460 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 107/212] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:20 2022] GET /identity/v3/users/ea07f49165244337b8cdcca035332d51 => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:20.783734 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e931b-0c5f-4e4b-a45b-3abd2fa1b2a4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:20.793534 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e931b-0c5f-4e4b-a45b-3abd2fa1b2a4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:20.798029 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78449e5-0ecd-4229-b1b3-55741934fda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:20.798866 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78449e5-0ecd-4229-b1b3-55741934fda3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:20.799139 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78449e5-0ecd-4229-b1b3-55741934fda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:20.799404 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78449e5-0ecd-4229-b1b3-55741934fda3 admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:20.801987 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78449e5-0ecd-4229-b1b3-55741934fda3 admin admin] RBAC: Authorizing `identity:get_project(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:20.804029 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78449e5-0ecd-4229-b1b3-55741934fda3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:20.805720 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 106/213] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:20 2022] GET /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:20.812136 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73a074-0f40-4b5b-9d98-124ed20e3c06 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:20.821798 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73a074-0f40-4b5b-9d98-124ed20e3c06 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:20.831261 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e40321-8c89-4d7c-8f1b-94754ad22fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:20.832503 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e40321-8c89-4d7c-8f1b-94754ad22fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:20.832785 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e40321-8c89-4d7c-8f1b-94754ad22fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:20.833059 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e40321-8c89-4d7c-8f1b-94754ad22fa8 admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6/users/ea07f49165244337b8cdcca035332d51/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:20.833334 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3e182-4f15-4ff9-b53e-2a88bde9343c None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:20.833768 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3e182-4f15-4ff9-b53e-2a88bde9343c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:20.834040 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3e182-4f15-4ff9-b53e-2a88bde9343c None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:20.835096 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e40321-8c89-4d7c-8f1b-94754ad22fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6, user_id=ea07f49165244337b8cdcca035332d51, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:20.835908 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 107/214] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:20.836822 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b2d6d-0f58-438f-853e-d39d2aa92236 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:20.837379 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b2d6d-0f58-438f-853e-d39d2aa92236 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:20.837847 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b2d6d-0f58-438f-853e-d39d2aa92236 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:20.837988 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e40321-8c89-4d7c-8f1b-94754ad22fa8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:20.839950 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 108/215] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:20.841165 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83b656-595a-4ba9-a1a2-7a751b4a73d0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:20.841553 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83b656-595a-4ba9-a1a2-7a751b4a73d0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:20.842014 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83b656-595a-4ba9-a1a2-7a751b4a73d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:20.853169 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 108/216] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:20:20 2022] PUT /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6/users/ea07f49165244337b8cdcca035332d51/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:20:20.854731 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64a6de-bc57-43eb-bbfd-888d04f93508 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:20.855161 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64a6de-bc57-43eb-bbfd-888d04f93508 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:20.856079 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa64a6de-bc57-43eb-bbfd-888d04f93508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:20.864482 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-cb83b656-595a-4ba9-a1a2-7a751b4a73d0 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:20.866181 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cb83b656-595a-4ba9-a1a2-7a751b4a73d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:20.875997 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-fa64a6de-bc57-43eb-bbfd-888d04f93508 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:20.877326 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fa64a6de-bc57-43eb-bbfd-888d04f93508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:20.941893 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 109/217] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:20.943266 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 109/218] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:20.943379 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78887620-8737-441d-aec4-b7aea0160da8 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:20.943528 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78887620-8737-441d-aec4-b7aea0160da8 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:20.943798 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78887620-8737-441d-aec4-b7aea0160da8 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:20.953311 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 110/219] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:20.953428 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fd089-34df-46e8-9f28-3599532a9339 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:20.953428 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fd089-34df-46e8-9f28-3599532a9339 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:20.953428 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fd089-34df-46e8-9f28-3599532a9339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:20.966172 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78887620-8737-441d-aec4-b7aea0160da8 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:20.970717 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-8e6fd089-34df-46e8-9f28-3599532a9339 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:20.972008 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8e6fd089-34df-46e8-9f28-3599532a9339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:20.979611 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 110/220] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:20.980574 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fd089-34df-46e8-9f28-3599532a9339 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:20.982701 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78887620-8737-441d-aec4-b7aea0160da8 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:20.988700 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80568597-5dcd-4618-8618-776940643cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:20.989789 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80568597-5dcd-4618-8618-776940643cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:20.990248 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80568597-5dcd-4618-8618-776940643cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:20.990414 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fd089-34df-46e8-9f28-3599532a9339 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:20.990852 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80568597-5dcd-4618-8618-776940643cfe admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:20.995132 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e1f98-0ddc-46f9-83b5-3df4ebe21127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:20.996050 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e1f98-0ddc-46f9-83b5-3df4ebe21127 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:20.996909 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e1f98-0ddc-46f9-83b5-3df4ebe21127 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:20.997233 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e1f98-0ddc-46f9-83b5-3df4ebe21127 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:21.006642 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80568597-5dcd-4618-8618-776940643cfe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:21.009001 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e1f98-0ddc-46f9-83b5-3df4ebe21127 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:21.015399 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-80568597-5dcd-4618-8618-776940643cfe admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 05:20:21.021351 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-175e1f98-0ddc-46f9-83b5-3df4ebe21127 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 05:20:21.021523 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 111/221] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:21.021523 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80568597-5dcd-4618-8618-776940643cfe admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:21.021679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 111/222] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Feb 16 05:20:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:21.024149 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e1f98-0ddc-46f9-83b5-3df4ebe21127 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:21.032549 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80568597-5dcd-4618-8618-776940643cfe admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:21.034676 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e1f98-0ddc-46f9-83b5-3df4ebe21127 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:21.036806 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9d416-f838-477b-a3a9-f96c7578e0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:21.037626 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9d416-f838-477b-a3a9-f96c7578e0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:21.037902 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9d416-f838-477b-a3a9-f96c7578e0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:21.038227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9d416-f838-477b-a3a9-f96c7578e0a3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:21.039416 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9d416-f838-477b-a3a9-f96c7578e0a3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:21.039525 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8c4cb-8f83-4a5f-bb03-2a62bc6bb58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:21.040106 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8c4cb-8f83-4a5f-bb03-2a62bc6bb58c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:21.040387 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8c4cb-8f83-4a5f-bb03-2a62bc6bb58c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:21.040659 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8c4cb-8f83-4a5f-bb03-2a62bc6bb58c admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:21.041228 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9d416-f838-477b-a3a9-f96c7578e0a3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:21.041438 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8c4cb-8f83-4a5f-bb03-2a62bc6bb58c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:21.041742 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8c4cb-8f83-4a5f-bb03-2a62bc6bb58c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:21.043073 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 112/223] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:21.044013 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8c4cb-8f83-4a5f-bb03-2a62bc6bb58c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:21.046450 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9d416-f838-477b-a3a9-f96c7578e0a3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:21.055720 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 112/224] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:21.056440 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8c4cb-8f83-4a5f-bb03-2a62bc6bb58c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:21.063549 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9d416-f838-477b-a3a9-f96c7578e0a3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:21.071601 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce4642-ee20-439e-834a-b81612889ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:21.072249 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce4642-ee20-439e-834a-b81612889ccb admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:21.072540 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce4642-ee20-439e-834a-b81612889ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:21.072754 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8c4cb-8f83-4a5f-bb03-2a62bc6bb58c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:21.072873 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce4642-ee20-439e-834a-b81612889ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:21.073891 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce4642-ee20-439e-834a-b81612889ccb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:21.073891 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce4642-ee20-439e-834a-b81612889ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:21.075651 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce4642-ee20-439e-834a-b81612889ccb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:21.077820 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7bb94-7215-42a3-bbcf-55d534a58006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:21.078770 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7bb94-7215-42a3-bbcf-55d534a58006 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:21.078884 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7bb94-7215-42a3-bbcf-55d534a58006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:21.079092 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7bb94-7215-42a3-bbcf-55d534a58006 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:21.079807 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7bb94-7215-42a3-bbcf-55d534a58006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:21.081748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7bb94-7215-42a3-bbcf-55d534a58006 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:21.088683 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 113/225] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:21.099104 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce4642-ee20-439e-834a-b81612889ccb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:21.104580 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce4642-ee20-439e-834a-b81612889ccb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:21.109651 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01598cbf-c2ff-4716-9cb4-d384e4b6a63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:21.110492 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01598cbf-c2ff-4716-9cb4-d384e4b6a63d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:21.110774 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01598cbf-c2ff-4716-9cb4-d384e4b6a63d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:21.111030 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01598cbf-c2ff-4716-9cb4-d384e4b6a63d admin admin] PATH_INFO: `/v3/users/7a3d7dc9c5714ef8bb0fe9ffe7801aff` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:21.118540 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 113/226] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Feb 16 05:20:21 2022] POST /identity/v3/users => generated 297 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:20:21.119553 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7bb94-7215-42a3-bbcf-55d534a58006 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:21.133543 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7bb94-7215-42a3-bbcf-55d534a58006 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:21.138758 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280acda5-2efa-4449-87d9-5d9355e0a1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:21.139589 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01598cbf-c2ff-4716-9cb4-d384e4b6a63d admin admin] RBAC: Authorizing `identity:get_user(user_id=7a3d7dc9c5714ef8bb0fe9ffe7801aff)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:21.139701 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280acda5-2efa-4449-87d9-5d9355e0a1cc admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:21.139913 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280acda5-2efa-4449-87d9-5d9355e0a1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:21.140193 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280acda5-2efa-4449-87d9-5d9355e0a1cc admin admin] PATH_INFO: `/v3/users/ea07f49165244337b8cdcca035332d51` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:21.141564 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280acda5-2efa-4449-87d9-5d9355e0a1cc admin admin] RBAC: Authorizing `identity:get_user(user_id=ea07f49165244337b8cdcca035332d51)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:21.143309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01598cbf-c2ff-4716-9cb4-d384e4b6a63d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:21.143805 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280acda5-2efa-4449-87d9-5d9355e0a1cc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:21.145806 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 114/227] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:21 2022] GET /identity/v3/users/7a3d7dc9c5714ef8bb0fe9ffe7801aff => generated 297 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:21.146051 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 114/228] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:21 2022] GET /identity/v3/users/ea07f49165244337b8cdcca035332d51 => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:21.151685 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280acda5-2efa-4449-87d9-5d9355e0a1cc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:21.151844 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01598cbf-c2ff-4716-9cb4-d384e4b6a63d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:21.163687 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01598cbf-c2ff-4716-9cb4-d384e4b6a63d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:21.164452 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280acda5-2efa-4449-87d9-5d9355e0a1cc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:21.169722 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8db978-0d15-40b8-9d88-ec08d73f39fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:21.170285 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97918ae1-66f6-462e-81cc-8ca9708818a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:21.170800 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8db978-0d15-40b8-9d88-ec08d73f39fa admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:21.171198 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8db978-0d15-40b8-9d88-ec08d73f39fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:21.171542 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97918ae1-66f6-462e-81cc-8ca9708818a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:21.171658 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8db978-0d15-40b8-9d88-ec08d73f39fa admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:21.172112 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97918ae1-66f6-462e-81cc-8ca9708818a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:21.172660 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97918ae1-66f6-462e-81cc-8ca9708818a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:21.173143 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8db978-0d15-40b8-9d88-ec08d73f39fa admin admin] RBAC: Authorizing `identity:get_project(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:21.175741 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8db978-0d15-40b8-9d88-ec08d73f39fa admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:21.178036 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 115/229] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:21 2022] GET /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:21.183376 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97918ae1-66f6-462e-81cc-8ca9708818a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:21.184302 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8db978-0d15-40b8-9d88-ec08d73f39fa admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:21.185679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97918ae1-66f6-462e-81cc-8ca9708818a8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:21.195323 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8db978-0d15-40b8-9d88-ec08d73f39fa admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:21.197551 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 115/230] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:21.205095 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97918ae1-66f6-462e-81cc-8ca9708818a8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:21.206443 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93996ff-45e4-4bd5-88d2-aeac213a2845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:21.207513 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93996ff-45e4-4bd5-88d2-aeac213a2845 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:21.209088 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93996ff-45e4-4bd5-88d2-aeac213a2845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:21.209512 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93996ff-45e4-4bd5-88d2-aeac213a2845 admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6/users/ea07f49165244337b8cdcca035332d51/roles/997c650af0d54f31940fbb188fe4172c` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:21.212210 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93996ff-45e4-4bd5-88d2-aeac213a2845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6, user_id=ea07f49165244337b8cdcca035332d51, role_id=997c650af0d54f31940fbb188fe4172c)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:21.215856 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93996ff-45e4-4bd5-88d2-aeac213a2845 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:21.217709 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97918ae1-66f6-462e-81cc-8ca9708818a8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:21.224283 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1c54f-e042-4522-9f8d-becdce84dd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:21.225568 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1c54f-e042-4522-9f8d-becdce84dd97 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:21.226080 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1c54f-e042-4522-9f8d-becdce84dd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:21.226532 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1c54f-e042-4522-9f8d-becdce84dd97 admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:21.228167 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1c54f-e042-4522-9f8d-becdce84dd97 admin admin] RBAC: Authorizing `identity:get_project(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:21.230633 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e1c54f-e042-4522-9f8d-becdce84dd97 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:21.232734 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 116/231] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:21 2022] GET /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:21.237715 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 116/232] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:20:21 2022] PUT /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6/users/ea07f49165244337b8cdcca035332d51/roles/997c650af0d54f31940fbb188fe4172c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:20:21.239141 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1c54f-e042-4522-9f8d-becdce84dd97 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:21.250332 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1c54f-e042-4522-9f8d-becdce84dd97 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:21.316795 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af732bec-be05-44e4-8a66-1ad3f94f424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:21.317813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af732bec-be05-44e4-8a66-1ad3f94f424f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:21.318278 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af732bec-be05-44e4-8a66-1ad3f94f424f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:21.318728 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af732bec-be05-44e4-8a66-1ad3f94f424f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:21.319880 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af732bec-be05-44e4-8a66-1ad3f94f424f admin admin] RBAC: Adding query filter params (role.id=3bbfe5a5163345b2b0d0cee3ea713919, scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6, user.id=7a3d7dc9c5714ef8bb0fe9ffe7801aff) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:21.320376 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af732bec-be05-44e4-8a66-1ad3f94f424f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:21.322494 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af732bec-be05-44e4-8a66-1ad3f94f424f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:21.329372 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 117/233] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:21 2022] GET /identity/v3/role_assignments?user.id=7a3d7dc9c5714ef8bb0fe9ffe7801aff&scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6&role.id=3bbfe5a5163345b2b0d0cee3ea713919 => generated 259 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:23.649376 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de960f-afb3-4526-a4cf-187a5011e111 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:23.649882 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de960f-afb3-4526-a4cf-187a5011e111 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:23.649983 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de960f-afb3-4526-a4cf-187a5011e111 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:23.651698 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 117/234] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:23.657301 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2754842-9b5d-4d87-aab0-d0781288a7f3 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:23.657739 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2754842-9b5d-4d87-aab0-d0781288a7f3 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:23.657939 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2754842-9b5d-4d87-aab0-d0781288a7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:23.682499 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-a2754842-9b5d-4d87-aab0-d0781288a7f3 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:23.684231 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a2754842-9b5d-4d87-aab0-d0781288a7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:23.692062 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 118/235] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:23.730819 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de960f-afb3-4526-a4cf-187a5011e111 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:23.751621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de960f-afb3-4526-a4cf-187a5011e111 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:23.756073 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5de09-5a49-4c7c-b1b5-a0ea2301a9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:23.756878 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5de09-5a49-4c7c-b1b5-a0ea2301a9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:23.757160 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5de09-5a49-4c7c-b1b5-a0ea2301a9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:23.757475 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5de09-5a49-4c7c-b1b5-a0ea2301a9a7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:23.780029 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5de09-5a49-4c7c-b1b5-a0ea2301a9a7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:23.787274 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-1bc5de09-5a49-4c7c-b1b5-a0ea2301a9a7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:20:23.788561 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 118/236] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:20:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:23.795484 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2754842-9b5d-4d87-aab0-d0781288a7f3 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:23.804615 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2754842-9b5d-4d87-aab0-d0781288a7f3 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:23.822670 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99cdae-f4e3-433c-a495-43722911c2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:23.823354 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99cdae-f4e3-433c-a495-43722911c2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:23.823632 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99cdae-f4e3-433c-a495-43722911c2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:23.823902 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99cdae-f4e3-433c-a495-43722911c2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:23.824701 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99cdae-f4e3-433c-a495-43722911c2d1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:23.825002 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99cdae-f4e3-433c-a495-43722911c2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:23.826646 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99cdae-f4e3-433c-a495-43722911c2d1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:23.835658 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 119/237] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:23.842024 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5de09-5a49-4c7c-b1b5-a0ea2301a9a7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:23.852439 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5de09-5a49-4c7c-b1b5-a0ea2301a9a7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:23.865584 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a045254-27cb-4432-8aa0-733550ccc1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:23.866462 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a045254-27cb-4432-8aa0-733550ccc1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:23.866745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a045254-27cb-4432-8aa0-733550ccc1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:23.867019 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a045254-27cb-4432-8aa0-733550ccc1d9 admin admin] PATH_INFO: `/v3/users/ea07f49165244337b8cdcca035332d51` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:23.868233 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a045254-27cb-4432-8aa0-733550ccc1d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea07f49165244337b8cdcca035332d51)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:23.870450 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a045254-27cb-4432-8aa0-733550ccc1d9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:23.872910 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 119/238] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:23 2022] GET /identity/v3/users/ea07f49165244337b8cdcca035332d51 => generated 283 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:23.882669 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99cdae-f4e3-433c-a495-43722911c2d1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:23.899697 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99cdae-f4e3-433c-a495-43722911c2d1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:23.909588 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37727cec-3008-45ec-97b7-fb1f996879e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:23.910250 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37727cec-3008-45ec-97b7-fb1f996879e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:23.910528 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37727cec-3008-45ec-97b7-fb1f996879e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:23.910798 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37727cec-3008-45ec-97b7-fb1f996879e8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:23.924806 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37727cec-3008-45ec-97b7-fb1f996879e8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:23.926585 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37727cec-3008-45ec-97b7-fb1f996879e8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:23.939707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 120/239] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:23.945614 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a045254-27cb-4432-8aa0-733550ccc1d9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:23.956122 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a045254-27cb-4432-8aa0-733550ccc1d9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:23.966745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b31f8e-9f05-40e6-87ba-3e36d4031c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:23.967597 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b31f8e-9f05-40e6-87ba-3e36d4031c17 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:23.967879 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b31f8e-9f05-40e6-87ba-3e36d4031c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:23.968153 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b31f8e-9f05-40e6-87ba-3e36d4031c17 admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:23.969383 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b31f8e-9f05-40e6-87ba-3e36d4031c17 admin admin] RBAC: Authorizing `identity:get_project(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:23.971456 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b31f8e-9f05-40e6-87ba-3e36d4031c17 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:23.973311 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 120/240] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:23 2022] GET /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:23.979044 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37727cec-3008-45ec-97b7-fb1f996879e8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:23.994155 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37727cec-3008-45ec-97b7-fb1f996879e8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:24.005629 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90be016-a8f9-4bbe-bdda-6c27e46a7298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:24.006272 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90be016-a8f9-4bbe-bdda-6c27e46a7298 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.006548 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90be016-a8f9-4bbe-bdda-6c27e46a7298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.006813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90be016-a8f9-4bbe-bdda-6c27e46a7298 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.007643 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90be016-a8f9-4bbe-bdda-6c27e46a7298 admin admin] RBAC: Adding query filter params (role.id=9ba4a5967ed243178927661616f08901, scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6, user.id=ea07f49165244337b8cdcca035332d51) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:24.007944 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90be016-a8f9-4bbe-bdda-6c27e46a7298 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:24.009813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90be016-a8f9-4bbe-bdda-6c27e46a7298 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:24.016494 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 121/241] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:23 2022] GET /identity/v3/role_assignments?user.id=ea07f49165244337b8cdcca035332d51&scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6&role.id=9ba4a5967ed243178927661616f08901 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:24.165493 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8fd84-4902-4764-a6d1-3af7dc19daf6 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.165847 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8fd84-4902-4764-a6d1-3af7dc19daf6 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.166018 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8fd84-4902-4764-a6d1-3af7dc19daf6 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.168171 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 121/242] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:24.173507 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d15cd-8364-48f8-a866-003618bd3479 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.173790 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d15cd-8364-48f8-a866-003618bd3479 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.174061 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d15cd-8364-48f8-a866-003618bd3479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.202439 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-804d15cd-8364-48f8-a866-003618bd3479 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:24.203651 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-804d15cd-8364-48f8-a866-003618bd3479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:24.211611 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 122/243] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:24.213739 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f096d-4713-4749-86fe-6baf47d3db8e None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.214028 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f096d-4713-4749-86fe-6baf47d3db8e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.214305 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f096d-4713-4749-86fe-6baf47d3db8e None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.217845 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 122/244] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:24.222279 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044769a-4b49-4a6d-ba0f-c486e518442b None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.222558 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044769a-4b49-4a6d-ba0f-c486e518442b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.222833 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044769a-4b49-4a6d-ba0f-c486e518442b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.235042 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f096d-4713-4749-86fe-6baf47d3db8e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:24.247147 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4044769a-4b49-4a6d-ba0f-c486e518442b None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:24.248342 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4044769a-4b49-4a6d-ba0f-c486e518442b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:24.255183 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f096d-4713-4749-86fe-6baf47d3db8e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:24.256362 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 123/245] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 05:20:24.257505 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057aab4-6373-4272-bed8-cd09b8acd6d7 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.257783 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057aab4-6373-4272-bed8-cd09b8acd6d7 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.258049 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057aab4-6373-4272-bed8-cd09b8acd6d7 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.260563 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f5943-39a6-48b3-a562-18e23b12295e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:24.260563 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f5943-39a6-48b3-a562-18e23b12295e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.261066 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f5943-39a6-48b3-a562-18e23b12295e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.261066 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f5943-39a6-48b3-a562-18e23b12295e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.264184 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 124/246] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:24.272998 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9455ef7-15c1-4380-ac39-df58d1fbc51e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.272998 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9455ef7-15c1-4380-ac39-df58d1fbc51e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.272998 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9455ef7-15c1-4380-ac39-df58d1fbc51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.273582 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f5943-39a6-48b3-a562-18e23b12295e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:24.280528 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-205f5943-39a6-48b3-a562-18e23b12295e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 05:20:24.282132 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 123/247] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:24.286159 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f5943-39a6-48b3-a562-18e23b12295e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:24.297684 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f5943-39a6-48b3-a562-18e23b12295e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:24.300305 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-c9455ef7-15c1-4380-ac39-df58d1fbc51e None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:24.301532 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c9455ef7-15c1-4380-ac39-df58d1fbc51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:24.301999 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf02ee4-b4c6-45b2-a5f8-02506d5dc18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:24.302779 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf02ee4-b4c6-45b2-a5f8-02506d5dc18e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.303056 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf02ee4-b4c6-45b2-a5f8-02506d5dc18e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.303339 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf02ee4-b4c6-45b2-a5f8-02506d5dc18e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.310706 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 125/248] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 05:20:24.311353 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9455ef7-15c1-4380-ac39-df58d1fbc51e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:24.322131 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf02ee4-b4c6-45b2-a5f8-02506d5dc18e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:24.323264 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9455ef7-15c1-4380-ac39-df58d1fbc51e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:24.328236 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c38ba-4ac9-43d5-bfdb-a985de269bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:24.328881 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c38ba-4ac9-43d5-bfdb-a985de269bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.329163 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c38ba-4ac9-43d5-bfdb-a985de269bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.329470 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c38ba-4ac9-43d5-bfdb-a985de269bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.329905 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-baf02ee4-b4c6-45b2-a5f8-02506d5dc18e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 05:20:24.330217 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c38ba-4ac9-43d5-bfdb-a985de269bd8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:24.330522 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c38ba-4ac9-43d5-bfdb-a985de269bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:24.331231 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 124/249] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Feb 16 05:20:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:24.332227 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4c38ba-4ac9-43d5-bfdb-a985de269bd8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:24.332331 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe14c1d-3600-4d17-89f4-c1d61b66b57a None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.332599 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe14c1d-3600-4d17-89f4-c1d61b66b57a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.332818 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe14c1d-3600-4d17-89f4-c1d61b66b57a None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.335252 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 125/250] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:24.339845 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe14c1d-3600-4d17-89f4-c1d61b66b57a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:24.343068 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 126/251] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:24.343877 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c38ba-4ac9-43d5-bfdb-a985de269bd8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:24.353742 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c38ba-4ac9-43d5-bfdb-a985de269bd8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:24.356246 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe14c1d-3600-4d17-89f4-c1d61b66b57a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:24.359414 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18003385-5ddc-482b-8eff-637be951d00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:24.360062 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18003385-5ddc-482b-8eff-637be951d00f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.360338 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18003385-5ddc-482b-8eff-637be951d00f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.360606 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18003385-5ddc-482b-8eff-637be951d00f admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.360782 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca943fa-143c-4837-abd5-83a93d962390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:24.361373 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18003385-5ddc-482b-8eff-637be951d00f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:24.361573 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca943fa-143c-4837-abd5-83a93d962390 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.361668 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18003385-5ddc-482b-8eff-637be951d00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:24.362030 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca943fa-143c-4837-abd5-83a93d962390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.362149 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca943fa-143c-4837-abd5-83a93d962390 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.363249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18003385-5ddc-482b-8eff-637be951d00f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:24.363350 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca943fa-143c-4837-abd5-83a93d962390 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:24.364917 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca943fa-143c-4837-abd5-83a93d962390 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:24.366514 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 126/252] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:24.367640 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff81d82-b519-4fad-93b2-a9e32334d828 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.367921 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff81d82-b519-4fad-93b2-a9e32334d828 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.368193 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff81d82-b519-4fad-93b2-a9e32334d828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.378037 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 127/253] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:24.378916 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18003385-5ddc-482b-8eff-637be951d00f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:24.388451 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-dff81d82-b519-4fad-93b2-a9e32334d828 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:24.388913 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18003385-5ddc-482b-8eff-637be951d00f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:24.389665 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-dff81d82-b519-4fad-93b2-a9e32334d828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:24.393497 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f61a37-6b7b-48b1-b32a-642c8ad0803b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:24.394331 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f61a37-6b7b-48b1-b32a-642c8ad0803b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.394608 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f61a37-6b7b-48b1-b32a-642c8ad0803b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.394875 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f61a37-6b7b-48b1-b32a-642c8ad0803b admin admin] PATH_INFO: `/v3/users/7a3d7dc9c5714ef8bb0fe9ffe7801aff` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.396024 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f61a37-6b7b-48b1-b32a-642c8ad0803b admin admin] RBAC: Authorizing `identity:get_user(user_id=7a3d7dc9c5714ef8bb0fe9ffe7801aff)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:24.397103 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 127/254] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:24.398211 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f61a37-6b7b-48b1-b32a-642c8ad0803b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:24.399757 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 128/255] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:24 2022] GET /identity/v3/users/7a3d7dc9c5714ef8bb0fe9ffe7801aff => generated 297 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:24.400482 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f61a37-6b7b-48b1-b32a-642c8ad0803b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:24.402186 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff81d82-b519-4fad-93b2-a9e32334d828 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:24.410597 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f61a37-6b7b-48b1-b32a-642c8ad0803b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:24.412370 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff81d82-b519-4fad-93b2-a9e32334d828 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:24.414843 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b96184-a0a3-45ab-a4c9-0e5a4f120dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:24.415754 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b96184-a0a3-45ab-a4c9-0e5a4f120dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.416048 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b96184-a0a3-45ab-a4c9-0e5a4f120dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.416324 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b96184-a0a3-45ab-a4c9-0e5a4f120dc7 admin admin] PATH_INFO: `/v3/users/ea07f49165244337b8cdcca035332d51` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.417048 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95648c2-22ae-4c1e-93f9-5ba54c7067ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:24.417483 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b96184-a0a3-45ab-a4c9-0e5a4f120dc7 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea07f49165244337b8cdcca035332d51)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:24.417724 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95648c2-22ae-4c1e-93f9-5ba54c7067ba admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.418579 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95648c2-22ae-4c1e-93f9-5ba54c7067ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.418854 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95648c2-22ae-4c1e-93f9-5ba54c7067ba admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.419556 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95648c2-22ae-4c1e-93f9-5ba54c7067ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:24.420085 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b96184-a0a3-45ab-a4c9-0e5a4f120dc7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:24.421651 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95648c2-22ae-4c1e-93f9-5ba54c7067ba admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:24.421901 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 129/256] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:24 2022] GET /identity/v3/users/ea07f49165244337b8cdcca035332d51 => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:24.426114 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b96184-a0a3-45ab-a4c9-0e5a4f120dc7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:24.436932 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b96184-a0a3-45ab-a4c9-0e5a4f120dc7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:24.441528 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fc708-d309-45cc-8674-22f4a798f3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:24.442328 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fc708-d309-45cc-8674-22f4a798f3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.442609 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fc708-d309-45cc-8674-22f4a798f3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.442890 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fc708-d309-45cc-8674-22f4a798f3e5 admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.443609 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 128/257] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Feb 16 05:20:24 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:20:24.444047 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fc708-d309-45cc-8674-22f4a798f3e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:24.444466 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95648c2-22ae-4c1e-93f9-5ba54c7067ba admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:24.446146 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fc708-d309-45cc-8674-22f4a798f3e5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:24.447964 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 130/258] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:24 2022] GET /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:24.450142 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fc708-d309-45cc-8674-22f4a798f3e5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:24.455738 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95648c2-22ae-4c1e-93f9-5ba54c7067ba admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:24.461461 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda571f-7fa0-4212-9012-c8e383ac7a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:24.462565 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda571f-7fa0-4212-9012-c8e383ac7a7d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.462851 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda571f-7fa0-4212-9012-c8e383ac7a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.463004 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fc708-d309-45cc-8674-22f4a798f3e5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:24.463143 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda571f-7fa0-4212-9012-c8e383ac7a7d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.468669 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa77bc-a9f2-491a-9421-777fa14aa376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:24.469355 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa77bc-a9f2-491a-9421-777fa14aa376 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.469643 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa77bc-a9f2-491a-9421-777fa14aa376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.469920 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa77bc-a9f2-491a-9421-777fa14aa376 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.476332 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdda571f-7fa0-4212-9012-c8e383ac7a7d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:24.478928 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa77bc-a9f2-491a-9421-777fa14aa376 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:24.481530 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa77bc-a9f2-491a-9421-777fa14aa376 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:24.483937 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-fdda571f-7fa0-4212-9012-c8e383ac7a7d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 05:20:24.485185 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 129/259] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:24.485969 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda571f-7fa0-4212-9012-c8e383ac7a7d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:24.492337 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 131/260] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:24.493522 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa77bc-a9f2-491a-9421-777fa14aa376 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:24.501521 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda571f-7fa0-4212-9012-c8e383ac7a7d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:24.506179 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795eac9-d5d2-4590-821b-b668c9ccc92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:24.507042 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa77bc-a9f2-491a-9421-777fa14aa376 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:24.507153 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795eac9-d5d2-4590-821b-b668c9ccc92e admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.507348 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795eac9-d5d2-4590-821b-b668c9ccc92e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.507621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795eac9-d5d2-4590-821b-b668c9ccc92e admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6/users/7a3d7dc9c5714ef8bb0fe9ffe7801aff/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.509717 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795eac9-d5d2-4590-821b-b668c9ccc92e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6, user_id=7a3d7dc9c5714ef8bb0fe9ffe7801aff, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:24.512197 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8c089-c73f-4b35-906d-fc253dfa977c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:24.512565 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795eac9-d5d2-4590-821b-b668c9ccc92e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:24.513012 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8c089-c73f-4b35-906d-fc253dfa977c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.513398 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8c089-c73f-4b35-906d-fc253dfa977c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.513741 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8c089-c73f-4b35-906d-fc253dfa977c admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.514586 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8c089-c73f-4b35-906d-fc253dfa977c admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:24.514974 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8c089-c73f-4b35-906d-fc253dfa977c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:24.516637 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a8c089-c73f-4b35-906d-fc253dfa977c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:24.526515 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 130/261] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:20:24 2022] PUT /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6/users/7a3d7dc9c5714ef8bb0fe9ffe7801aff/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:20:24.526706 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 132/262] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:24.534676 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8c089-c73f-4b35-906d-fc253dfa977c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:24.538246 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795eac9-d5d2-4590-821b-b668c9ccc92e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:24.549031 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a8c089-c73f-4b35-906d-fc253dfa977c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:24.619548 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795eac9-d5d2-4590-821b-b668c9ccc92e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:24.626446 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cf91e-e6d5-4851-b8a9-fa799465d66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:24.627480 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cf91e-e6d5-4851-b8a9-fa799465d66b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.627906 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cf91e-e6d5-4851-b8a9-fa799465d66b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.628346 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cf91e-e6d5-4851-b8a9-fa799465d66b admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.629440 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b1b28-1d0e-4c95-b1e8-43693f12888d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:24.630199 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cf91e-e6d5-4851-b8a9-fa799465d66b admin admin] RBAC: Authorizing `identity:get_project(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:24.630694 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b1b28-1d0e-4c95-b1e8-43693f12888d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.631117 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b1b28-1d0e-4c95-b1e8-43693f12888d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.631533 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b1b28-1d0e-4c95-b1e8-43693f12888d admin admin] PATH_INFO: `/v3/users/696a91545632434da9368823b1c49a7f` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.632960 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6cf91e-e6d5-4851-b8a9-fa799465d66b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:24.636145 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 131/263] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:24 2022] GET /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6 => generated 302 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:24.642852 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cf91e-e6d5-4851-b8a9-fa799465d66b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:24.653538 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b1b28-1d0e-4c95-b1e8-43693f12888d admin admin] RBAC: Authorizing `identity:get_user(user_id=696a91545632434da9368823b1c49a7f)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:24.654611 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cf91e-e6d5-4851-b8a9-fa799465d66b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:24.656631 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b1b28-1d0e-4c95-b1e8-43693f12888d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:24.659391 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 133/264] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:24 2022] GET /identity/v3/users/696a91545632434da9368823b1c49a7f => generated 297 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:24.661732 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c29e04-93a9-4fe5-8694-13ea0f8ce1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:24.662497 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c29e04-93a9-4fe5-8694-13ea0f8ce1de admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.662923 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c29e04-93a9-4fe5-8694-13ea0f8ce1de admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.663296 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c29e04-93a9-4fe5-8694-13ea0f8ce1de admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.664637 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c29e04-93a9-4fe5-8694-13ea0f8ce1de admin admin] RBAC: Adding query filter params (role.id=997c650af0d54f31940fbb188fe4172c, scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6, user.id=ea07f49165244337b8cdcca035332d51) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:24.665340 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b1b28-1d0e-4c95-b1e8-43693f12888d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:24.666051 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c29e04-93a9-4fe5-8694-13ea0f8ce1de admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:24.668182 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c29e04-93a9-4fe5-8694-13ea0f8ce1de admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:24.677788 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b1b28-1d0e-4c95-b1e8-43693f12888d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:24.681467 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 132/265] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:24 2022] GET /identity/v3/role_assignments?user.id=ea07f49165244337b8cdcca035332d51&scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6&role.id=997c650af0d54f31940fbb188fe4172c => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:24.683273 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de71b63-e012-41b5-bdf2-b0b54e728380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:24.684707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de71b63-e012-41b5-bdf2-b0b54e728380 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.685074 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de71b63-e012-41b5-bdf2-b0b54e728380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.685568 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de71b63-e012-41b5-bdf2-b0b54e728380 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.694869 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de71b63-e012-41b5-bdf2-b0b54e728380 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:24.696926 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de71b63-e012-41b5-bdf2-b0b54e728380 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:24.707866 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 134/266] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 05:20:24.716883 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c29e04-93a9-4fe5-8694-13ea0f8ce1de admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:24.728339 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c29e04-93a9-4fe5-8694-13ea0f8ce1de admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:24.736314 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1c417-c3ba-450e-8b62-aff60696dfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:24.737422 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1c417-c3ba-450e-8b62-aff60696dfb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.737808 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1c417-c3ba-450e-8b62-aff60696dfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.738220 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1c417-c3ba-450e-8b62-aff60696dfb2 admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.740098 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1c417-c3ba-450e-8b62-aff60696dfb2 admin admin] RBAC: Authorizing `identity:get_project(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:24.742393 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1c417-c3ba-450e-8b62-aff60696dfb2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:24.744533 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 133/267] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:24 2022] GET /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:24.751045 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de71b63-e012-41b5-bdf2-b0b54e728380 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:24.761603 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de71b63-e012-41b5-bdf2-b0b54e728380 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:24.767773 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674283da-df14-47b3-8000-6b8598d18ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:24.768790 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674283da-df14-47b3-8000-6b8598d18ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:24.769242 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674283da-df14-47b3-8000-6b8598d18ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:24.769691 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674283da-df14-47b3-8000-6b8598d18ed1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:24.770756 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674283da-df14-47b3-8000-6b8598d18ed1 admin admin] RBAC: Adding query filter params (role.id=360fccb712c74bd0a5871b8358626ee0, scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6, user.id=696a91545632434da9368823b1c49a7f) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:24.771247 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674283da-df14-47b3-8000-6b8598d18ed1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:24.773446 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674283da-df14-47b3-8000-6b8598d18ed1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:24.780742 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 135/268] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:24 2022] GET /identity/v3/role_assignments?user.id=696a91545632434da9368823b1c49a7f&scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6&role.id=360fccb712c74bd0a5871b8358626ee0 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:26.942369 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc3736-cd91-45d8-925c-bea74d8d884e None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:26.942856 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc3736-cd91-45d8-925c-bea74d8d884e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:26.943098 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc3736-cd91-45d8-925c-bea74d8d884e None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:26.945170 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 134/269] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:26.950554 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde13c3-f58a-4245-830b-a329da53dfcc None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:26.950960 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde13c3-f58a-4245-830b-a329da53dfcc None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:26.951288 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde13c3-f58a-4245-830b-a329da53dfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:26.969930 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-9fde13c3-f58a-4245-830b-a329da53dfcc None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:26.971124 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9fde13c3-f58a-4245-830b-a329da53dfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:26.978986 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 136/270] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:27.003115 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc3736-cd91-45d8-925c-bea74d8d884e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:27.015591 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc3736-cd91-45d8-925c-bea74d8d884e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:27.019903 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449a1e9-f32e-4963-a395-3105c32a72a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:27.020677 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449a1e9-f32e-4963-a395-3105c32a72a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.020956 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449a1e9-f32e-4963-a395-3105c32a72a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.021226 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449a1e9-f32e-4963-a395-3105c32a72a5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.033196 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1516728-d44d-44e8-9a9b-540e73c89ae0 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.033785 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1516728-d44d-44e8-9a9b-540e73c89ae0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.033785 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1516728-d44d-44e8-9a9b-540e73c89ae0 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.040955 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449a1e9-f32e-4963-a395-3105c32a72a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:27.041084 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 137/271] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:27.041973 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-2449a1e9-f32e-4963-a395-3105c32a72a5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 05:20:27.042664 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d041d-c520-4029-aed5-a55a2b660ec8 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.043773 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d041d-c520-4029-aed5-a55a2b660ec8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.044175 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 135/272] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:27.044398 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d041d-c520-4029-aed5-a55a2b660ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.049618 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449a1e9-f32e-4963-a395-3105c32a72a5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:27.060598 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449a1e9-f32e-4963-a395-3105c32a72a5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:27.065029 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf34166-16d3-44c7-b3fd-5c9233441c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:27.065731 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf34166-16d3-44c7-b3fd-5c9233441c36 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.066008 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf34166-16d3-44c7-b3fd-5c9233441c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.066274 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf34166-16d3-44c7-b3fd-5c9233441c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.067016 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf34166-16d3-44c7-b3fd-5c9233441c36 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:27.067318 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf34166-16d3-44c7-b3fd-5c9233441c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:27.069055 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf34166-16d3-44c7-b3fd-5c9233441c36 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:27.069356 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-a32d041d-c520-4029-aed5-a55a2b660ec8 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:27.070742 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a32d041d-c520-4029-aed5-a55a2b660ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:27.079499 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 136/273] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:27.079842 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 138/274] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:27.084741 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf34166-16d3-44c7-b3fd-5c9233441c36 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:27.094316 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf34166-16d3-44c7-b3fd-5c9233441c36 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:27.098665 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118aadc0-8908-4d58-8927-b86764885b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:27.099509 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118aadc0-8908-4d58-8927-b86764885b38 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.099795 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118aadc0-8908-4d58-8927-b86764885b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.100067 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118aadc0-8908-4d58-8927-b86764885b38 admin admin] PATH_INFO: `/v3/users/7a3d7dc9c5714ef8bb0fe9ffe7801aff` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.101250 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118aadc0-8908-4d58-8927-b86764885b38 admin admin] RBAC: Authorizing `identity:get_user(user_id=7a3d7dc9c5714ef8bb0fe9ffe7801aff)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:27.103405 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118aadc0-8908-4d58-8927-b86764885b38 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:27.105842 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 137/275] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:27 2022] GET /identity/v3/users/7a3d7dc9c5714ef8bb0fe9ffe7801aff => generated 297 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:27.106114 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d041d-c520-4029-aed5-a55a2b660ec8 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:27.110939 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118aadc0-8908-4d58-8927-b86764885b38 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:27.116444 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d041d-c520-4029-aed5-a55a2b660ec8 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:27.120405 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118aadc0-8908-4d58-8927-b86764885b38 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:27.121853 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f2b91-e3a7-4fb8-a7a2-a3f5202b2610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:27.122927 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f2b91-e3a7-4fb8-a7a2-a3f5202b2610 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.123405 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f2b91-e3a7-4fb8-a7a2-a3f5202b2610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.123888 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f2b91-e3a7-4fb8-a7a2-a3f5202b2610 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.125348 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721e2d5-8114-4310-8051-c996debc0e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:27.125965 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721e2d5-8114-4310-8051-c996debc0e89 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.126246 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721e2d5-8114-4310-8051-c996debc0e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.126535 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721e2d5-8114-4310-8051-c996debc0e89 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.134284 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721e2d5-8114-4310-8051-c996debc0e89 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:27.136041 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721e2d5-8114-4310-8051-c996debc0e89 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:27.136201 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f2b91-e3a7-4fb8-a7a2-a3f5202b2610 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:27.143219 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-dc7f2b91-e3a7-4fb8-a7a2-a3f5202b2610 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 05:20:27.144556 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 139/276] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:27.149362 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 138/277] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 05:20:27.149362 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5d171-5918-4d4c-a6b7-b874778bad61 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.149362 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5d171-5918-4d4c-a6b7-b874778bad61 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.149362 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5d171-5918-4d4c-a6b7-b874778bad61 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.149620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b30368-2286-4a97-9f46-e9ffd8482d82 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.149620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b30368-2286-4a97-9f46-e9ffd8482d82 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.149620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b30368-2286-4a97-9f46-e9ffd8482d82 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.149791 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 139/278] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:27.149864 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5d171-5918-4d4c-a6b7-b874778bad61 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:27.150183 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 140/279] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 05:20:27.154628 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4fa2a-56e0-4ca4-a887-fa1525170c13 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.154909 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4fa2a-56e0-4ca4-a887-fa1525170c13 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.155182 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4fa2a-56e0-4ca4-a887-fa1525170c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.161880 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5d171-5918-4d4c-a6b7-b874778bad61 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:27.166048 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4948a-a1e9-43c8-914e-af00affd4154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:27.166657 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4948a-a1e9-43c8-914e-af00affd4154 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.166933 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4948a-a1e9-43c8-914e-af00affd4154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.167204 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4948a-a1e9-43c8-914e-af00affd4154 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.168468 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4948a-a1e9-43c8-914e-af00affd4154 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:27.168769 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4948a-a1e9-43c8-914e-af00affd4154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:27.170389 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4948a-a1e9-43c8-914e-af00affd4154 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:27.172864 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-eab4fa2a-56e0-4ca4-a887-fa1525170c13 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:27.174063 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-eab4fa2a-56e0-4ca4-a887-fa1525170c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:27.178506 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 140/280] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:27.179258 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4948a-a1e9-43c8-914e-af00affd4154 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:27.182758 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 141/281] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:27.184966 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690627b8-23c9-44e3-a620-67485512459b None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.185253 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690627b8-23c9-44e3-a620-67485512459b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.186094 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690627b8-23c9-44e3-a620-67485512459b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.189007 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4948a-a1e9-43c8-914e-af00affd4154 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:27.193277 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff4445-122c-4d6f-a107-24c1aa3b4b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:27.194052 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff4445-122c-4d6f-a107-24c1aa3b4b31 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.194331 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff4445-122c-4d6f-a107-24c1aa3b4b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.194600 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff4445-122c-4d6f-a107-24c1aa3b4b31 admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.195751 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff4445-122c-4d6f-a107-24c1aa3b4b31 admin admin] RBAC: Authorizing `identity:get_project(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:27.197809 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff4445-122c-4d6f-a107-24c1aa3b4b31 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:27.199579 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 141/282] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:27 2022] GET /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:27.200161 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff4445-122c-4d6f-a107-24c1aa3b4b31 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:27.205300 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-690627b8-23c9-44e3-a620-67485512459b None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:27.205300 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-690627b8-23c9-44e3-a620-67485512459b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:27.210734 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff4445-122c-4d6f-a107-24c1aa3b4b31 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:27.213073 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 142/283] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:27.213874 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690627b8-23c9-44e3-a620-67485512459b None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:27.218805 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b6be6-ebc8-4e0f-bf7f-4e2dc99331ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:27.219715 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b6be6-ebc8-4e0f-bf7f-4e2dc99331ac admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.220088 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b6be6-ebc8-4e0f-bf7f-4e2dc99331ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.220438 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b6be6-ebc8-4e0f-bf7f-4e2dc99331ac admin admin] PATH_INFO: `/v3/users/c340bbd611984adb93455e2327abc5f2` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.222801 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690627b8-23c9-44e3-a620-67485512459b None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:27.227098 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544275a-9027-4947-a593-56691214237f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:27.227708 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544275a-9027-4947-a593-56691214237f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.227989 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544275a-9027-4947-a593-56691214237f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.228315 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544275a-9027-4947-a593-56691214237f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.229075 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544275a-9027-4947-a593-56691214237f admin admin] RBAC: Adding query filter params (role.id=3bbfe5a5163345b2b0d0cee3ea713919, scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6, user.id=7a3d7dc9c5714ef8bb0fe9ffe7801aff) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:27.229426 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544275a-9027-4947-a593-56691214237f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:27.231823 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544275a-9027-4947-a593-56691214237f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:27.235239 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b6be6-ebc8-4e0f-bf7f-4e2dc99331ac admin admin] RBAC: Authorizing `identity:get_user(user_id=c340bbd611984adb93455e2327abc5f2)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:27.237416 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648b6be6-ebc8-4e0f-bf7f-4e2dc99331ac admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:27.237659 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 143/284] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:27 2022] GET /identity/v3/role_assignments?user.id=7a3d7dc9c5714ef8bb0fe9ffe7801aff&scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6&role.id=3bbfe5a5163345b2b0d0cee3ea713919 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:27.238423 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544275a-9027-4947-a593-56691214237f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:27.240036 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 142/285] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:27 2022] GET /identity/v3/users/c340bbd611984adb93455e2327abc5f2 => generated 293 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:27.240791 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b6be6-ebc8-4e0f-bf7f-4e2dc99331ac admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:27.255796 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b6be6-ebc8-4e0f-bf7f-4e2dc99331ac admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:27.256007 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544275a-9027-4947-a593-56691214237f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:27.260305 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eaf5ae-7913-4533-8c42-dc93db766a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:27.260499 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbcfd8-39c9-438c-ac55-e798e043b721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:27.261112 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eaf5ae-7913-4533-8c42-dc93db766a1a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.261210 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbcfd8-39c9-438c-ac55-e798e043b721 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.261424 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eaf5ae-7913-4533-8c42-dc93db766a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.261519 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbcfd8-39c9-438c-ac55-e798e043b721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.262266 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbcfd8-39c9-438c-ac55-e798e043b721 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.263507 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbcfd8-39c9-438c-ac55-e798e043b721 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:27.263856 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eaf5ae-7913-4533-8c42-dc93db766a1a admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.266024 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbcfd8-39c9-438c-ac55-e798e043b721 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:27.268135 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 144/286] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:27.273513 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbcfd8-39c9-438c-ac55-e798e043b721 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:27.278743 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eaf5ae-7913-4533-8c42-dc93db766a1a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:27.284379 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbcfd8-39c9-438c-ac55-e798e043b721 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:27.285951 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-b5eaf5ae-7913-4533-8c42-dc93db766a1a admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 05:20:27.287490 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 143/287] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:27.288263 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eaf5ae-7913-4533-8c42-dc93db766a1a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:27.293720 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d3efc-e804-4800-8106-1019ca767a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:27.294376 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d3efc-e804-4800-8106-1019ca767a5f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.294659 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d3efc-e804-4800-8106-1019ca767a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.294929 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d3efc-e804-4800-8106-1019ca767a5f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.295765 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d3efc-e804-4800-8106-1019ca767a5f admin admin] RBAC: Adding query filter params (role.id=3bbfe5a5163345b2b0d0cee3ea713919, user.id=c340bbd611984adb93455e2327abc5f2, scope.system=all) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:27.296074 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d3efc-e804-4800-8106-1019ca767a5f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:27.297996 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d3efc-e804-4800-8106-1019ca767a5f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:27.298670 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eaf5ae-7913-4533-8c42-dc93db766a1a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:27.303162 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972e8cf-83ce-4f81-8f29-fafb0a24ee01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:27.303834 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972e8cf-83ce-4f81-8f29-fafb0a24ee01 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.304110 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972e8cf-83ce-4f81-8f29-fafb0a24ee01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.304378 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972e8cf-83ce-4f81-8f29-fafb0a24ee01 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.305093 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972e8cf-83ce-4f81-8f29-fafb0a24ee01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:27.313545 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 145/288] 10.222.0.75 () {56 vars in 1329 bytes} [Wed Feb 16 05:20:27 2022] GET /identity/v3/role_assignments?user.id=c340bbd611984adb93455e2327abc5f2&scope.system=all&role.id=3bbfe5a5163345b2b0d0cee3ea713919 => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:27.313766 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972e8cf-83ce-4f81-8f29-fafb0a24ee01 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:27.313842 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d3efc-e804-4800-8106-1019ca767a5f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:27.327830 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d3efc-e804-4800-8106-1019ca767a5f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:27.333520 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c566b9f-8598-44a6-a2d6-c6cd3d1ef0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:27.334390 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c566b9f-8598-44a6-a2d6-c6cd3d1ef0de admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.334740 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c566b9f-8598-44a6-a2d6-c6cd3d1ef0de admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.335120 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c566b9f-8598-44a6-a2d6-c6cd3d1ef0de admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.335973 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c566b9f-8598-44a6-a2d6-c6cd3d1ef0de admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:27.336387 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c566b9f-8598-44a6-a2d6-c6cd3d1ef0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:27.338181 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c566b9f-8598-44a6-a2d6-c6cd3d1ef0de admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:27.342114 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 144/289] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Feb 16 05:20:27 2022] POST /identity/v3/users => generated 293 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:20:27.354804 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 146/290] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:27.361511 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972e8cf-83ce-4f81-8f29-fafb0a24ee01 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:27.376501 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972e8cf-83ce-4f81-8f29-fafb0a24ee01 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:27.381812 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e363dc-1510-4fa0-a494-e2a9e700e758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:27.382838 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e363dc-1510-4fa0-a494-e2a9e700e758 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.383194 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e363dc-1510-4fa0-a494-e2a9e700e758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.383599 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e363dc-1510-4fa0-a494-e2a9e700e758 admin admin] PATH_INFO: `/v3/users/696a91545632434da9368823b1c49a7f` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.385195 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e363dc-1510-4fa0-a494-e2a9e700e758 admin admin] RBAC: Authorizing `identity:get_user(user_id=696a91545632434da9368823b1c49a7f)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:27.388326 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e363dc-1510-4fa0-a494-e2a9e700e758 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:27.390594 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 145/291] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:27 2022] GET /identity/v3/users/696a91545632434da9368823b1c49a7f => generated 297 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:27.396618 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c566b9f-8598-44a6-a2d6-c6cd3d1ef0de admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:27.408049 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c566b9f-8598-44a6-a2d6-c6cd3d1ef0de admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:27.413202 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d3eda-de05-468f-ae2e-58e3d4dadf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:27.414306 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d3eda-de05-468f-ae2e-58e3d4dadf1a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.414651 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d3eda-de05-468f-ae2e-58e3d4dadf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.414990 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d3eda-de05-468f-ae2e-58e3d4dadf1a admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.416667 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d3eda-de05-468f-ae2e-58e3d4dadf1a admin admin] RBAC: Authorizing `identity:get_project(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:27.419100 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d3eda-de05-468f-ae2e-58e3d4dadf1a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:27.421542 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 147/292] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:27 2022] GET /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:27.427313 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e363dc-1510-4fa0-a494-e2a9e700e758 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:27.439189 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e363dc-1510-4fa0-a494-e2a9e700e758 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:27.444656 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3e64e-031c-4e92-8323-c70f5a066c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:27.445894 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3e64e-031c-4e92-8323-c70f5a066c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:27.446348 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3e64e-031c-4e92-8323-c70f5a066c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:27.446765 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3e64e-031c-4e92-8323-c70f5a066c89 admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6/users/696a91545632434da9368823b1c49a7f/roles/360fccb712c74bd0a5871b8358626ee0` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:27.449809 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3e64e-031c-4e92-8323-c70f5a066c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6, user_id=696a91545632434da9368823b1c49a7f, role_id=360fccb712c74bd0a5871b8358626ee0)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:27.453056 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3e64e-031c-4e92-8323-c70f5a066c89 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:27.476270 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 146/293] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:20:27 2022] PUT /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6/users/696a91545632434da9368823b1c49a7f/roles/360fccb712c74bd0a5871b8358626ee0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:20:29.748034 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac0527-3a97-42d2-919a-f1a69d7e8125 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:29.748569 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac0527-3a97-42d2-919a-f1a69d7e8125 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:29.748569 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac0527-3a97-42d2-919a-f1a69d7e8125 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:29.750825 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 148/294] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:29.756152 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c274a-c5b3-4979-b8c6-5510475a21d6 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:29.756578 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c274a-c5b3-4979-b8c6-5510475a21d6 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:29.756785 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c274a-c5b3-4979-b8c6-5510475a21d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:29.774557 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-6a8c274a-c5b3-4979-b8c6-5510475a21d6 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:29.775746 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6a8c274a-c5b3-4979-b8c6-5510475a21d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:29.835261 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 147/295] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:29.851505 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d93b5-ec8b-4463-b37e-988f46817d66 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:29.851789 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d93b5-ec8b-4463-b37e-988f46817d66 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:29.852066 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135d93b5-ec8b-4463-b37e-988f46817d66 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:29.855070 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 149/296] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:29.858781 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c274a-c5b3-4979-b8c6-5510475a21d6 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:29.859689 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c2105-cfd7-4250-8eae-718a8ac6ee4a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:29.859979 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c2105-cfd7-4250-8eae-718a8ac6ee4a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:29.860259 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c2105-cfd7-4250-8eae-718a8ac6ee4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:29.868221 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c274a-c5b3-4979-b8c6-5510475a21d6 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:29.872881 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c210c-4cde-40cd-8f05-9bddbb21823b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:29.873700 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c210c-4cde-40cd-8f05-9bddbb21823b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:29.873971 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c210c-4cde-40cd-8f05-9bddbb21823b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:29.874237 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c210c-4cde-40cd-8f05-9bddbb21823b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:29.878584 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-e37c2105-cfd7-4250-8eae-718a8ac6ee4a None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:29.880004 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e37c2105-cfd7-4250-8eae-718a8ac6ee4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:29.885704 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c210c-4cde-40cd-8f05-9bddbb21823b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:29.888528 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 150/297] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 05:20:29.893338 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-4e3c210c-4cde-40cd-8f05-9bddbb21823b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 05:20:29.893964 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 148/298] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:29.899794 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c2105-cfd7-4250-8eae-718a8ac6ee4a None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:29.914210 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c2105-cfd7-4250-8eae-718a8ac6ee4a None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:29.914849 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c210c-4cde-40cd-8f05-9bddbb21823b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:29.919861 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96545259-faa1-4f41-a4c4-09049f8c635e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:29.920839 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96545259-faa1-4f41-a4c4-09049f8c635e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:29.921170 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96545259-faa1-4f41-a4c4-09049f8c635e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:29.921578 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96545259-faa1-4f41-a4c4-09049f8c635e admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:29.922431 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96545259-faa1-4f41-a4c4-09049f8c635e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:29.922809 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96545259-faa1-4f41-a4c4-09049f8c635e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:29.924492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96545259-faa1-4f41-a4c4-09049f8c635e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:29.926431 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c210c-4cde-40cd-8f05-9bddbb21823b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:29.931085 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8c1d1-7d7d-4627-9825-d5627ac1d560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:29.932362 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8c1d1-7d7d-4627-9825-d5627ac1d560 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:29.932824 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8c1d1-7d7d-4627-9825-d5627ac1d560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:29.933304 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8c1d1-7d7d-4627-9825-d5627ac1d560 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:29.934453 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 151/299] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:29.940137 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96545259-faa1-4f41-a4c4-09049f8c635e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:29.945945 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8c1d1-7d7d-4627-9825-d5627ac1d560 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:29.950382 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96545259-faa1-4f41-a4c4-09049f8c635e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:29.953576 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-1df8c1d1-7d7d-4627-9825-d5627ac1d560 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 05:20:29.955122 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 149/300] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:29.955232 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6c4ea-c080-4ffe-8834-da52a1d64478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:29.959900 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6c4ea-c080-4ffe-8834-da52a1d64478 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:29.959900 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6c4ea-c080-4ffe-8834-da52a1d64478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:29.959900 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6c4ea-c080-4ffe-8834-da52a1d64478 admin admin] PATH_INFO: `/v3/users/c340bbd611984adb93455e2327abc5f2` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:29.959900 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6c4ea-c080-4ffe-8834-da52a1d64478 admin admin] RBAC: Authorizing `identity:get_user(user_id=c340bbd611984adb93455e2327abc5f2)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:29.959900 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6c4ea-c080-4ffe-8834-da52a1d64478 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:29.961583 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8c1d1-7d7d-4627-9825-d5627ac1d560 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:29.961993 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 152/301] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:29 2022] GET /identity/v3/users/c340bbd611984adb93455e2327abc5f2 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:29.967782 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6c4ea-c080-4ffe-8834-da52a1d64478 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:29.972814 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8c1d1-7d7d-4627-9825-d5627ac1d560 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:29.977655 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6c4ea-c080-4ffe-8834-da52a1d64478 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:29.978458 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7ffef-f64e-4272-b080-abd5c7e01f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:29.979397 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7ffef-f64e-4272-b080-abd5c7e01f4e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:29.979859 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7ffef-f64e-4272-b080-abd5c7e01f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:29.981055 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7ffef-f64e-4272-b080-abd5c7e01f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:29.982364 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7ffef-f64e-4272-b080-abd5c7e01f4e admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:29.982706 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2e6e8-a770-4eab-b274-cd66fd844f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:29.983196 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7ffef-f64e-4272-b080-abd5c7e01f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:29.983539 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2e6e8-a770-4eab-b274-cd66fd844f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:29.983819 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2e6e8-a770-4eab-b274-cd66fd844f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:29.984097 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2e6e8-a770-4eab-b274-cd66fd844f9b admin admin] PATH_INFO: `/v3/system/users/c340bbd611984adb93455e2327abc5f2/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:29.985585 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2e6e8-a770-4eab-b274-cd66fd844f9b admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c340bbd611984adb93455e2327abc5f2, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:29.986126 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7ffef-f64e-4272-b080-abd5c7e01f4e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:29.986703 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-abb2e6e8-a770-4eab-b274-cd66fd844f9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:20:29.986703 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Feb 16 05:20:29.986703 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: Feb 16 05:20:29.987575 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2e6e8-a770-4eab-b274-cd66fd844f9b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:29.996938 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 153/302] 10.222.0.75 () {58 vars in 1355 bytes} [Wed Feb 16 05:20:29 2022] PUT /identity/v3/system/users/c340bbd611984adb93455e2327abc5f2/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:20:29.998363 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b59f4-a0d8-4654-af97-336a6b56f8c8 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:29.998651 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b59f4-a0d8-4654-af97-336a6b56f8c8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:29.998927 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b59f4-a0d8-4654-af97-336a6b56f8c8 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:30.003527 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 154/303] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:30.004146 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 150/304] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:30.008508 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b59f4-a0d8-4654-af97-336a6b56f8c8 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:30.010326 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc93135-c5cc-4394-b385-a192e6750f14 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:30.010617 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc93135-c5cc-4394-b385-a192e6750f14 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:30.010906 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc93135-c5cc-4394-b385-a192e6750f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:30.028040 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b59f4-a0d8-4654-af97-336a6b56f8c8 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:30.033922 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a0669-0d6b-4b32-b2db-4e8cca1282ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:30.035449 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a0669-0d6b-4b32-b2db-4e8cca1282ff admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:30.035968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a0669-0d6b-4b32-b2db-4e8cca1282ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:30.036441 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a0669-0d6b-4b32-b2db-4e8cca1282ff admin admin] PATH_INFO: `/v3/users/696a91545632434da9368823b1c49a7f` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:30.037993 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a0669-0d6b-4b32-b2db-4e8cca1282ff admin admin] RBAC: Authorizing `identity:get_user(user_id=696a91545632434da9368823b1c49a7f)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:30.038650 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-7dc93135-c5cc-4394-b385-a192e6750f14 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:30.039937 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7dc93135-c5cc-4394-b385-a192e6750f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:30.040988 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a0669-0d6b-4b32-b2db-4e8cca1282ff admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:30.043603 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 155/305] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:30 2022] GET /identity/v3/users/696a91545632434da9368823b1c49a7f => generated 297 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:30.046144 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739eb10-25c1-4217-8d26-447def1d80db None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:30.046700 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739eb10-25c1-4217-8d26-447def1d80db None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:30.047146 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739eb10-25c1-4217-8d26-447def1d80db None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:30.048310 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 151/306] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:30.049145 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc93135-c5cc-4394-b385-a192e6750f14 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:30.054488 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 156/307] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 05:20:30.061129 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc70e6a-1a80-45e4-8896-4d96aa5b1cb4 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:30.061444 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc70e6a-1a80-45e4-8896-4d96aa5b1cb4 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:30.061717 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc70e6a-1a80-45e4-8896-4d96aa5b1cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:30.063915 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc93135-c5cc-4394-b385-a192e6750f14 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:30.068641 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782162d-c589-4bb7-af6c-48a0716d38b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:30.069445 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782162d-c589-4bb7-af6c-48a0716d38b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:30.069802 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782162d-c589-4bb7-af6c-48a0716d38b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:30.070145 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782162d-c589-4bb7-af6c-48a0716d38b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:30.080203 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782162d-c589-4bb7-af6c-48a0716d38b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:30.082164 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782162d-c589-4bb7-af6c-48a0716d38b0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:30.082363 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-cfc70e6a-1a80-45e4-8896-4d96aa5b1cb4 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:30.083601 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cfc70e6a-1a80-45e4-8896-4d96aa5b1cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:30.092256 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 157/308] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 05:20:30.092681 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 152/309] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:30.094191 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc70e6a-1a80-45e4-8896-4d96aa5b1cb4 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:30.102335 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782162d-c589-4bb7-af6c-48a0716d38b0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:30.104606 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc70e6a-1a80-45e4-8896-4d96aa5b1cb4 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:30.111271 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0c7e8-6c0f-45dd-b3de-1d94c5ce463e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:30.112444 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0c7e8-6c0f-45dd-b3de-1d94c5ce463e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:30.112552 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782162d-c589-4bb7-af6c-48a0716d38b0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:30.113038 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0c7e8-6c0f-45dd-b3de-1d94c5ce463e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:30.113569 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a0c7e8-6c0f-45dd-b3de-1d94c5ce463e admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:30.117479 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa469d09-eca5-4af9-83d6-0b471bb6439e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:30.118337 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa469d09-eca5-4af9-83d6-0b471bb6439e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:30.118618 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa469d09-eca5-4af9-83d6-0b471bb6439e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:30.118891 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa469d09-eca5-4af9-83d6-0b471bb6439e admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:30.120121 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa469d09-eca5-4af9-83d6-0b471bb6439e admin admin] RBAC: Authorizing `identity:get_project(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:30.122559 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa469d09-eca5-4af9-83d6-0b471bb6439e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:30.124238 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 153/310] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:30 2022] GET /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:30.124940 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa469d09-eca5-4af9-83d6-0b471bb6439e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:30.130098 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a0c7e8-6c0f-45dd-b3de-1d94c5ce463e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:30.135180 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa469d09-eca5-4af9-83d6-0b471bb6439e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:30.137850 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-96a0c7e8-6c0f-45dd-b3de-1d94c5ce463e admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 05:20:30.139344 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 158/311] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:30.140447 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd8b51-be93-497e-930a-c579c940b3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:30.141251 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd8b51-be93-497e-930a-c579c940b3bc admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:30.141568 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd8b51-be93-497e-930a-c579c940b3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:30.141840 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd8b51-be93-497e-930a-c579c940b3bc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:30.143050 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd8b51-be93-497e-930a-c579c940b3bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:30.144685 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0c7e8-6c0f-45dd-b3de-1d94c5ce463e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:30.144933 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd8b51-be93-497e-930a-c579c940b3bc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:30.146803 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 154/312] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:30.151525 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd8b51-be93-497e-930a-c579c940b3bc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:30.155282 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a0c7e8-6c0f-45dd-b3de-1d94c5ce463e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:30.160078 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8586d-92af-4705-a75e-3fca1b31aa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:30.160732 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8586d-92af-4705-a75e-3fca1b31aa29 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:30.161016 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8586d-92af-4705-a75e-3fca1b31aa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:30.161311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8586d-92af-4705-a75e-3fca1b31aa29 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:30.161504 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd8b51-be93-497e-930a-c579c940b3bc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:30.162210 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8586d-92af-4705-a75e-3fca1b31aa29 admin admin] RBAC: Adding query filter params (role.id=360fccb712c74bd0a5871b8358626ee0, scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6, user.id=696a91545632434da9368823b1c49a7f) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:30.162519 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8586d-92af-4705-a75e-3fca1b31aa29 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:30.164394 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8586d-92af-4705-a75e-3fca1b31aa29 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:30.165998 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3e1f0-215c-4c28-b704-cf3c924c9752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:30.166662 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3e1f0-215c-4c28-b704-cf3c924c9752 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:30.166946 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3e1f0-215c-4c28-b704-cf3c924c9752 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:30.167216 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3e1f0-215c-4c28-b704-cf3c924c9752 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:30.168003 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3e1f0-215c-4c28-b704-cf3c924c9752 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:30.168310 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3e1f0-215c-4c28-b704-cf3c924c9752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:30.169981 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3e1f0-215c-4c28-b704-cf3c924c9752 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:30.171673 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 159/313] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:30 2022] GET /identity/v3/role_assignments?user.id=696a91545632434da9368823b1c49a7f&scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6&role.id=360fccb712c74bd0a5871b8358626ee0 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:30.172349 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8586d-92af-4705-a75e-3fca1b31aa29 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:30.183834 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8586d-92af-4705-a75e-3fca1b31aa29 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:30.186997 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 155/314] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:30.192707 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3e1f0-215c-4c28-b704-cf3c924c9752 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:30.194927 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200004c-068e-405c-910f-03e497a2c6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:30.195789 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200004c-068e-405c-910f-03e497a2c6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:30.196224 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200004c-068e-405c-910f-03e497a2c6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:30.196656 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200004c-068e-405c-910f-03e497a2c6e9 admin admin] PATH_INFO: `/v3/groups` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:30.197525 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200004c-068e-405c-910f-03e497a2c6e9 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:30.199516 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-b200004c-068e-405c-910f-03e497a2c6e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:20:30.199516 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Feb 16 05:20:30.199516 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: Feb 16 05:20:30.201419 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200004c-068e-405c-910f-03e497a2c6e9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:30.204044 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3e1f0-215c-4c28-b704-cf3c924c9752 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:30.211551 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2e220-2143-49ed-9f16-5d4bd5d390a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:30.212470 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2e220-2143-49ed-9f16-5d4bd5d390a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:30.212749 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2e220-2143-49ed-9f16-5d4bd5d390a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:30.213023 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2e220-2143-49ed-9f16-5d4bd5d390a1 admin admin] PATH_INFO: `/v3/users/8a7b9e081f5d4465a99447a6aee82032` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:30.220416 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 160/315] 10.222.0.75 () {60 vars in 1155 bytes} [Wed Feb 16 05:20:30 2022] POST /identity/v3/groups => generated 229 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:20:30.229037 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2e220-2143-49ed-9f16-5d4bd5d390a1 admin admin] RBAC: Authorizing `identity:get_user(user_id=8a7b9e081f5d4465a99447a6aee82032)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:30.232027 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2e220-2143-49ed-9f16-5d4bd5d390a1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:30.240245 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 156/316] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:30 2022] GET /identity/v3/users/8a7b9e081f5d4465a99447a6aee82032 => generated 293 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:30.240475 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200004c-068e-405c-910f-03e497a2c6e9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:30.251487 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200004c-068e-405c-910f-03e497a2c6e9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:30.256098 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39afa7-6e15-4105-91a4-acd427a6c6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:30.256760 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39afa7-6e15-4105-91a4-acd427a6c6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:30.257045 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39afa7-6e15-4105-91a4-acd427a6c6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:30.257352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39afa7-6e15-4105-91a4-acd427a6c6d9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:30.258210 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39afa7-6e15-4105-91a4-acd427a6c6d9 admin admin] RBAC: Adding query filter params (role.id=360fccb712c74bd0a5871b8358626ee0, user.id=8a7b9e081f5d4465a99447a6aee82032, scope.system=all) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:30.258520 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39afa7-6e15-4105-91a4-acd427a6c6d9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:30.260420 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39afa7-6e15-4105-91a4-acd427a6c6d9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:30.267037 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 161/317] 10.222.0.75 () {56 vars in 1329 bytes} [Wed Feb 16 05:20:30 2022] GET /identity/v3/role_assignments?user.id=8a7b9e081f5d4465a99447a6aee82032&scope.system=all&role.id=360fccb712c74bd0a5871b8358626ee0 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:32.399976 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7014008-1305-4acc-9158-69c542294bae None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:32.400509 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7014008-1305-4acc-9158-69c542294bae None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:32.400509 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7014008-1305-4acc-9158-69c542294bae None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:32.402981 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 157/318] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:32.408090 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a5a77-5139-4d64-a878-60c87b776513 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:32.408498 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a5a77-5139-4d64-a878-60c87b776513 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:32.408714 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a5a77-5139-4d64-a878-60c87b776513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:32.426003 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-ba7a5a77-5139-4d64-a878-60c87b776513 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:32.427179 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ba7a5a77-5139-4d64-a878-60c87b776513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:32.435196 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 162/319] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:32.465299 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7014008-1305-4acc-9158-69c542294bae None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:32.479284 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7014008-1305-4acc-9158-69c542294bae None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:32.483619 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af105d-d375-4ef5-bdfb-8ccbe15dc280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:32.484398 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af105d-d375-4ef5-bdfb-8ccbe15dc280 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:32.484680 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af105d-d375-4ef5-bdfb-8ccbe15dc280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:32.484951 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af105d-d375-4ef5-bdfb-8ccbe15dc280 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:32.495313 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af105d-d375-4ef5-bdfb-8ccbe15dc280 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:32.502170 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-30af105d-d375-4ef5-bdfb-8ccbe15dc280 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 05:20:32.507786 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 158/320] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:32.509048 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a5a77-5139-4d64-a878-60c87b776513 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:32.518570 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a5a77-5139-4d64-a878-60c87b776513 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:32.522930 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b0c45-82ad-4440-ac5d-c89d6d40cde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:32.523647 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b0c45-82ad-4440-ac5d-c89d6d40cde6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:32.524017 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b0c45-82ad-4440-ac5d-c89d6d40cde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:32.524360 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b0c45-82ad-4440-ac5d-c89d6d40cde6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:32.525169 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b0c45-82ad-4440-ac5d-c89d6d40cde6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:32.525569 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b0c45-82ad-4440-ac5d-c89d6d40cde6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:32.528019 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b0c45-82ad-4440-ac5d-c89d6d40cde6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:32.536982 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 163/321] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:32.542200 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af105d-d375-4ef5-bdfb-8ccbe15dc280 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:32.551827 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af105d-d375-4ef5-bdfb-8ccbe15dc280 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:32.556015 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fadb646-3d37-49d7-bd67-5c8865d9d609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:32.557150 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadb646-3d37-49d7-bd67-5c8865d9d609 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:32.557460 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadb646-3d37-49d7-bd67-5c8865d9d609 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:32.557730 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fadb646-3d37-49d7-bd67-5c8865d9d609 admin admin] PATH_INFO: `/v3/users/c340bbd611984adb93455e2327abc5f2` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:32.558934 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadb646-3d37-49d7-bd67-5c8865d9d609 admin admin] RBAC: Authorizing `identity:get_user(user_id=c340bbd611984adb93455e2327abc5f2)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:32.561072 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fadb646-3d37-49d7-bd67-5c8865d9d609 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:32.562816 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 159/322] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:32 2022] GET /identity/v3/users/c340bbd611984adb93455e2327abc5f2 => generated 293 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:32.568173 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b0c45-82ad-4440-ac5d-c89d6d40cde6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:32.578463 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b0c45-82ad-4440-ac5d-c89d6d40cde6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:32.582819 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e315ae-394a-40e3-9134-81a88b551aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:32.583455 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e315ae-394a-40e3-9134-81a88b551aeb admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:32.583736 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e315ae-394a-40e3-9134-81a88b551aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:32.584012 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e315ae-394a-40e3-9134-81a88b551aeb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:32.584837 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e315ae-394a-40e3-9134-81a88b551aeb admin admin] RBAC: Adding query filter params (role.id=3bbfe5a5163345b2b0d0cee3ea713919, user.id=c340bbd611984adb93455e2327abc5f2, scope.system=all) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:32.585146 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e315ae-394a-40e3-9134-81a88b551aeb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:32.587047 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e315ae-394a-40e3-9134-81a88b551aeb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:32.609358 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 164/323] 10.222.0.75 () {56 vars in 1329 bytes} [Wed Feb 16 05:20:32 2022] GET /identity/v3/role_assignments?user.id=c340bbd611984adb93455e2327abc5f2&scope.system=all&role.id=3bbfe5a5163345b2b0d0cee3ea713919 => generated 510 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:32.613196 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ac662-539b-4b16-85ad-94aeb4881d43 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:32.613506 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ac662-539b-4b16-85ad-94aeb4881d43 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:32.613779 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ac662-539b-4b16-85ad-94aeb4881d43 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:32.615775 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 160/324] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:32.621569 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bd67a-ebd6-450c-bdea-c3b3ba20e2f0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:32.621869 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bd67a-ebd6-450c-bdea-c3b3ba20e2f0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:32.622134 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bd67a-ebd6-450c-bdea-c3b3ba20e2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:32.625347 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1f7d3-f79a-4f59-8832-dd06c460f2f5 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:32.625639 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1f7d3-f79a-4f59-8832-dd06c460f2f5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:32.625918 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d1f7d3-f79a-4f59-8832-dd06c460f2f5 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:32.627852 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 161/325] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 05:20:32.633625 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2314c-34de-460f-be77-f3c2d9a40988 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:32.633949 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2314c-34de-460f-be77-f3c2d9a40988 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:32.634185 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2314c-34de-460f-be77-f3c2d9a40988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:32.641381 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-621bd67a-ebd6-450c-bdea-c3b3ba20e2f0 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:32.642677 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-621bd67a-ebd6-450c-bdea-c3b3ba20e2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:32.650799 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 165/326] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:32.654620 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-aed2314c-34de-460f-be77-f3c2d9a40988 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:32.655836 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-aed2314c-34de-460f-be77-f3c2d9a40988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:32.663756 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 162/327] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 05:20:32.674479 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bd67a-ebd6-450c-bdea-c3b3ba20e2f0 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:32.684220 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bd67a-ebd6-450c-bdea-c3b3ba20e2f0 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:32.687362 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2314c-34de-460f-be77-f3c2d9a40988 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:32.688902 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e7f26-4147-4e02-8d1a-1fa58fb8a578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:32.689735 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e7f26-4147-4e02-8d1a-1fa58fb8a578 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:32.690015 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e7f26-4147-4e02-8d1a-1fa58fb8a578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:32.690287 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e7f26-4147-4e02-8d1a-1fa58fb8a578 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:32.691511 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e7f26-4147-4e02-8d1a-1fa58fb8a578 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:32.693287 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e7f26-4147-4e02-8d1a-1fa58fb8a578 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:32.697293 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 166/328] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:32.697467 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed2314c-34de-460f-be77-f3c2d9a40988 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:32.701445 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e7f26-4147-4e02-8d1a-1fa58fb8a578 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:32.702292 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d84f9-f26d-48a9-8ec1-90ff600322d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:32.703055 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d84f9-f26d-48a9-8ec1-90ff600322d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:32.703335 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d84f9-f26d-48a9-8ec1-90ff600322d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:32.703608 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d84f9-f26d-48a9-8ec1-90ff600322d4 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:32.711240 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e7f26-4147-4e02-8d1a-1fa58fb8a578 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:32.715632 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d84f9-f26d-48a9-8ec1-90ff600322d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:32.721187 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8d986-4723-4d5b-a319-dc3fcd9c0d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:32.721893 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8d986-4723-4d5b-a319-dc3fcd9c0d6c admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:32.722176 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8d986-4723-4d5b-a319-dc3fcd9c0d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:32.722448 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8d986-4723-4d5b-a319-dc3fcd9c0d6c admin admin] PATH_INFO: `/v3/groups` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:32.722606 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-8d7d84f9-f26d-48a9-8ec1-90ff600322d4 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 05:20:32.723153 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8d986-4723-4d5b-a319-dc3fcd9c0d6c admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:32.724018 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 163/329] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:32.725094 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8d986-4723-4d5b-a319-dc3fcd9c0d6c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:32.729692 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d84f9-f26d-48a9-8ec1-90ff600322d4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:32.739957 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d84f9-f26d-48a9-8ec1-90ff600322d4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:32.741716 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 167/330] 10.222.0.75 () {60 vars in 1155 bytes} [Wed Feb 16 05:20:32 2022] POST /identity/v3/groups => generated 226 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:20:32.749164 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201114e-0fd9-46eb-9e7a-09a1c7795875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:32.749932 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201114e-0fd9-46eb-9e7a-09a1c7795875 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:32.750214 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201114e-0fd9-46eb-9e7a-09a1c7795875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:32.750487 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201114e-0fd9-46eb-9e7a-09a1c7795875 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:32.751297 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201114e-0fd9-46eb-9e7a-09a1c7795875 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:32.751606 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201114e-0fd9-46eb-9e7a-09a1c7795875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:32.753309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201114e-0fd9-46eb-9e7a-09a1c7795875 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:32.764876 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 164/331] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:32.770781 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8d986-4723-4d5b-a319-dc3fcd9c0d6c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:32.782058 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8d986-4723-4d5b-a319-dc3fcd9c0d6c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:32.787882 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162625c-9faf-451a-8284-d4f03f745424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:32.788779 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162625c-9faf-451a-8284-d4f03f745424 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:32.789063 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162625c-9faf-451a-8284-d4f03f745424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:32.789370 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162625c-9faf-451a-8284-d4f03f745424 admin admin] PATH_INFO: `/v3/users/8a7b9e081f5d4465a99447a6aee82032` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:32.790656 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162625c-9faf-451a-8284-d4f03f745424 admin admin] RBAC: Authorizing `identity:get_user(user_id=8a7b9e081f5d4465a99447a6aee82032)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:32.795154 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162625c-9faf-451a-8284-d4f03f745424 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:32.796967 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 168/332] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:32 2022] GET /identity/v3/users/8a7b9e081f5d4465a99447a6aee82032 => generated 293 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:32.803702 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201114e-0fd9-46eb-9e7a-09a1c7795875 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:32.814214 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201114e-0fd9-46eb-9e7a-09a1c7795875 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:32.820987 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f7085-fbf5-4b93-bb59-4182783199fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:32.821897 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f7085-fbf5-4b93-bb59-4182783199fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:32.822177 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f7085-fbf5-4b93-bb59-4182783199fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:32.822446 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f7085-fbf5-4b93-bb59-4182783199fd admin admin] PATH_INFO: `/v3/system/users/8a7b9e081f5d4465a99447a6aee82032/roles/360fccb712c74bd0a5871b8358626ee0` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:32.824700 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f7085-fbf5-4b93-bb59-4182783199fd admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8a7b9e081f5d4465a99447a6aee82032, role_id=360fccb712c74bd0a5871b8358626ee0)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:32.826134 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-678f7085-fbf5-4b93-bb59-4182783199fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:20:32.826134 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Feb 16 05:20:32.826134 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: Feb 16 05:20:32.826713 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f7085-fbf5-4b93-bb59-4182783199fd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:32.839259 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 165/333] 10.222.0.75 () {58 vars in 1355 bytes} [Wed Feb 16 05:20:32 2022] PUT /identity/v3/system/users/8a7b9e081f5d4465a99447a6aee82032/roles/360fccb712c74bd0a5871b8358626ee0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:20:35.374645 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc11637-5159-494a-9825-5955f873c533 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:35.375657 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc11637-5159-494a-9825-5955f873c533 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:35.376141 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc11637-5159-494a-9825-5955f873c533 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:35.378645 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 169/334] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:35.387576 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7155281-b0a2-4e07-a241-7e4de68627b3 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:35.388926 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7155281-b0a2-4e07-a241-7e4de68627b3 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:35.389465 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7155281-b0a2-4e07-a241-7e4de68627b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:35.412727 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-b7155281-b0a2-4e07-a241-7e4de68627b3 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:35.414268 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b7155281-b0a2-4e07-a241-7e4de68627b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:35.424584 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 166/335] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:35.466740 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc11637-5159-494a-9825-5955f873c533 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:35.479862 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc11637-5159-494a-9825-5955f873c533 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:35.485481 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66b5d5-5d04-4646-8869-aa593bc08182 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:35.486014 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66b5d5-5d04-4646-8869-aa593bc08182 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:35.486509 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66b5d5-5d04-4646-8869-aa593bc08182 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:35.488560 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 167/336] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:35.492746 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bda83-3637-439d-bd85-88e23d8d5ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:35.493804 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bda83-3637-439d-bd85-88e23d8d5ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:35.494281 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bda83-3637-439d-bd85-88e23d8d5ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:35.494749 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0bda83-3637-439d-bd85-88e23d8d5ce9 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:35.505699 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a33251-f416-456a-bedf-bd7524d20b8b None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:35.505991 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a33251-f416-456a-bedf-bd7524d20b8b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:35.506246 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a33251-f416-456a-bedf-bd7524d20b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:35.511240 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0bda83-3637-439d-bd85-88e23d8d5ce9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:35.518432 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-1c0bda83-3637-439d-bd85-88e23d8d5ce9 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 16 05:20:35.520170 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 170/337] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:35.525894 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bda83-3637-439d-bd85-88e23d8d5ce9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:35.534316 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-55a33251-f416-456a-bedf-bd7524d20b8b None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:35.535512 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-55a33251-f416-456a-bedf-bd7524d20b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:35.539878 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0bda83-3637-439d-bd85-88e23d8d5ce9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:35.548922 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b109ae-b099-4f5d-8b7c-26de92065e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:35.549612 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b109ae-b099-4f5d-8b7c-26de92065e2c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:35.549893 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b109ae-b099-4f5d-8b7c-26de92065e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:35.550170 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b109ae-b099-4f5d-8b7c-26de92065e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:35.550928 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b109ae-b099-4f5d-8b7c-26de92065e2c admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:35.551235 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b109ae-b099-4f5d-8b7c-26de92065e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:35.552826 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b109ae-b099-4f5d-8b7c-26de92065e2c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:35.555753 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 168/338] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:35.564319 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 171/339] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:35.574855 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a33251-f416-456a-bedf-bd7524d20b8b None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:35.585289 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a33251-f416-456a-bedf-bd7524d20b8b None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:35.591603 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8ed6b-757e-4459-a8c2-678f08efe940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:35.592639 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8ed6b-757e-4459-a8c2-678f08efe940 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:35.592923 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8ed6b-757e-4459-a8c2-678f08efe940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:35.593198 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8ed6b-757e-4459-a8c2-678f08efe940 admin admin] PATH_INFO: `/v3/users/8a7b9e081f5d4465a99447a6aee82032` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:35.595728 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8ed6b-757e-4459-a8c2-678f08efe940 admin admin] RBAC: Authorizing `identity:get_user(user_id=8a7b9e081f5d4465a99447a6aee82032)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:35.597921 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8ed6b-757e-4459-a8c2-678f08efe940 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:35.599561 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 169/340] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:20:35 2022] GET /identity/v3/users/8a7b9e081f5d4465a99447a6aee82032 => generated 293 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:35.601700 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b109ae-b099-4f5d-8b7c-26de92065e2c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:35.608759 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8ed6b-757e-4459-a8c2-678f08efe940 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:35.612739 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b109ae-b099-4f5d-8b7c-26de92065e2c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:35.626846 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8ed6b-757e-4459-a8c2-678f08efe940 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:35.627996 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92c267-7e55-4274-8a16-37fac16042b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:35.628810 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92c267-7e55-4274-8a16-37fac16042b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:35.629087 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92c267-7e55-4274-8a16-37fac16042b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:35.629396 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92c267-7e55-4274-8a16-37fac16042b9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:35.640488 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a110c09-6330-485e-b0ac-5f47479609b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:35.641136 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a110c09-6330-485e-b0ac-5f47479609b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:35.641520 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a110c09-6330-485e-b0ac-5f47479609b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:35.641797 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a110c09-6330-485e-b0ac-5f47479609b5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:35.642639 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a110c09-6330-485e-b0ac-5f47479609b5 admin admin] RBAC: Adding query filter params (role.id=360fccb712c74bd0a5871b8358626ee0, user.id=8a7b9e081f5d4465a99447a6aee82032, scope.system=all) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:35.642947 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a110c09-6330-485e-b0ac-5f47479609b5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:35.644854 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a110c09-6330-485e-b0ac-5f47479609b5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:35.654206 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92c267-7e55-4274-8a16-37fac16042b9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:35.666098 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-2d92c267-7e55-4274-8a16-37fac16042b9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 05:20:35.667711 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 172/342] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Feb 16 05:20:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:35.667819 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 170/342] 10.222.0.75 () {56 vars in 1329 bytes} [Wed Feb 16 05:20:35 2022] GET /identity/v3/role_assignments?user.id=8a7b9e081f5d4465a99447a6aee82032&scope.system=all&role.id=360fccb712c74bd0a5871b8358626ee0 => generated 510 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:35.674328 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92c267-7e55-4274-8a16-37fac16042b9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:35.685871 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92c267-7e55-4274-8a16-37fac16042b9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:35.690789 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04ecd8-0aa2-447f-9de2-2bb609fb584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:35.691740 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04ecd8-0aa2-447f-9de2-2bb609fb584c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:35.692167 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04ecd8-0aa2-447f-9de2-2bb609fb584c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:35.692581 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04ecd8-0aa2-447f-9de2-2bb609fb584c admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:35.693542 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04ecd8-0aa2-447f-9de2-2bb609fb584c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:35.694026 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04ecd8-0aa2-447f-9de2-2bb609fb584c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:35.695840 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04ecd8-0aa2-447f-9de2-2bb609fb584c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:35.709084 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 173/343] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:35.715224 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a110c09-6330-485e-b0ac-5f47479609b5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:35.736406 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a110c09-6330-485e-b0ac-5f47479609b5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:35.751657 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7bb60-bddb-4154-b482-35fa9f2e3652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:35.752317 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7bb60-bddb-4154-b482-35fa9f2e3652 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:35.752594 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7bb60-bddb-4154-b482-35fa9f2e3652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:35.752866 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7bb60-bddb-4154-b482-35fa9f2e3652 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:35.766377 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7bb60-bddb-4154-b482-35fa9f2e3652 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:35.768187 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7bb60-bddb-4154-b482-35fa9f2e3652 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:35.782170 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 171/344] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:35.787769 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04ecd8-0aa2-447f-9de2-2bb609fb584c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:35.801864 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04ecd8-0aa2-447f-9de2-2bb609fb584c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:35.806946 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a99cd1-7717-4b2a-adb4-d92585b42311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:35.808042 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a99cd1-7717-4b2a-adb4-d92585b42311 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:35.809057 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a99cd1-7717-4b2a-adb4-d92585b42311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:35.809607 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a99cd1-7717-4b2a-adb4-d92585b42311 admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:35.811041 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a99cd1-7717-4b2a-adb4-d92585b42311 admin admin] RBAC: Authorizing `identity:get_project(project_id=a04bbe2fdd09464e83b9c4e39549e8ad)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:35.813429 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a99cd1-7717-4b2a-adb4-d92585b42311 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:35.815830 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 174/345] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:35 2022] GET /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:35.821103 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7bb60-bddb-4154-b482-35fa9f2e3652 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:35.830974 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7bb60-bddb-4154-b482-35fa9f2e3652 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:35.841874 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241045c-82c5-4cbd-8deb-5124df3abcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:35.842761 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241045c-82c5-4cbd-8deb-5124df3abcbf admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:35.843042 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241045c-82c5-4cbd-8deb-5124df3abcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:35.843313 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241045c-82c5-4cbd-8deb-5124df3abcbf admin admin] PATH_INFO: `/v3/groups/d966599a0b324538bcd070faebf51e35` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:35.862175 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241045c-82c5-4cbd-8deb-5124df3abcbf admin admin] RBAC: Authorizing `identity:get_group(group_id=d966599a0b324538bcd070faebf51e35)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:35.863268 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-2241045c-82c5-4cbd-8deb-5124df3abcbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:20:35.863268 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Feb 16 05:20:35.863268 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: Feb 16 05:20:35.864510 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241045c-82c5-4cbd-8deb-5124df3abcbf admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:35.866477 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 172/346] 10.222.0.75 () {56 vars in 1201 bytes} [Wed Feb 16 05:20:35 2022] GET /identity/v3/groups/d966599a0b324538bcd070faebf51e35 => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:35.873073 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a99cd1-7717-4b2a-adb4-d92585b42311 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:35.883708 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a99cd1-7717-4b2a-adb4-d92585b42311 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:35.893581 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba9f5e-1ed0-4ed1-8e49-2b034490ce63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:35.894623 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba9f5e-1ed0-4ed1-8e49-2b034490ce63 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:35.895105 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba9f5e-1ed0-4ed1-8e49-2b034490ce63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:35.895576 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba9f5e-1ed0-4ed1-8e49-2b034490ce63 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:35.896606 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba9f5e-1ed0-4ed1-8e49-2b034490ce63 admin admin] RBAC: Adding query filter params (group.id=d966599a0b324538bcd070faebf51e35, role.id=997c650af0d54f31940fbb188fe4172c, scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:35.897143 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba9f5e-1ed0-4ed1-8e49-2b034490ce63 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:35.899231 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba9f5e-1ed0-4ed1-8e49-2b034490ce63 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:35.912367 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 175/347] 10.222.0.75 () {56 vars in 1397 bytes} [Wed Feb 16 05:20:35 2022] GET /identity/v3/role_assignments?group.id=d966599a0b324538bcd070faebf51e35&scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad&role.id=997c650af0d54f31940fbb188fe4172c => generated 260 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:36.174283 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f0195-d005-4d3b-a719-71cf4ce26e11 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:36.174634 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f0195-d005-4d3b-a719-71cf4ce26e11 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:36.174744 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f0195-d005-4d3b-a719-71cf4ce26e11 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:36.176776 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 173/348] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:36.183251 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a8499-e0a2-466b-a2f9-07483eaf65a6 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:36.184513 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a8499-e0a2-466b-a2f9-07483eaf65a6 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:36.185030 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a8499-e0a2-466b-a2f9-07483eaf65a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:36.209290 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-992a8499-e0a2-466b-a2f9-07483eaf65a6 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:36.210860 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-992a8499-e0a2-466b-a2f9-07483eaf65a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:36.223541 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 176/349] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:36.267235 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f0195-d005-4d3b-a719-71cf4ce26e11 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:36.283606 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f0195-d005-4d3b-a719-71cf4ce26e11 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:36.288955 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b30a15-14d9-445c-af84-242481178167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:36.289771 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b30a15-14d9-445c-af84-242481178167 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:36.290052 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b30a15-14d9-445c-af84-242481178167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:36.290325 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b30a15-14d9-445c-af84-242481178167 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:36.302203 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc0fd8-f6ca-49e5-b46f-1ea456dd8aa0 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:36.302529 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc0fd8-f6ca-49e5-b46f-1ea456dd8aa0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:36.302744 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc0fd8-f6ca-49e5-b46f-1ea456dd8aa0 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:36.304643 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 177/350] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:36.305227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b30a15-14d9-445c-af84-242481178167 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:36.311030 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667fcd9-1a92-416b-bbd7-86a146138c12 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:36.311335 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667fcd9-1a92-416b-bbd7-86a146138c12 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:36.311580 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667fcd9-1a92-416b-bbd7-86a146138c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:36.314564 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-38b30a15-14d9-445c-af84-242481178167 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 05:20:36.317027 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 174/351] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:36.321971 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b30a15-14d9-445c-af84-242481178167 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:36.334570 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-1667fcd9-1a92-416b-bbd7-86a146138c12 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:36.335748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1667fcd9-1a92-416b-bbd7-86a146138c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:36.336674 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b30a15-14d9-445c-af84-242481178167 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:36.352991 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651580d2-4e3e-45dc-a535-c9d568aea299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:36.353730 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651580d2-4e3e-45dc-a535-c9d568aea299 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:36.353975 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651580d2-4e3e-45dc-a535-c9d568aea299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:36.354248 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651580d2-4e3e-45dc-a535-c9d568aea299 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:36.357711 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 178/352] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 05:20:36.358340 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651580d2-4e3e-45dc-a535-c9d568aea299 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:36.358655 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651580d2-4e3e-45dc-a535-c9d568aea299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:36.360381 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651580d2-4e3e-45dc-a535-c9d568aea299 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:36.373717 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 175/353] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:36.379226 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667fcd9-1a92-416b-bbd7-86a146138c12 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:36.388857 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667fcd9-1a92-416b-bbd7-86a146138c12 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:36.392301 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651580d2-4e3e-45dc-a535-c9d568aea299 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:36.398197 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc2dab-72c9-4507-af46-0422889ef13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:36.399769 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc2dab-72c9-4507-af46-0422889ef13e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:36.400268 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc2dab-72c9-4507-af46-0422889ef13e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:36.400742 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc2dab-72c9-4507-af46-0422889ef13e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:36.404606 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651580d2-4e3e-45dc-a535-c9d568aea299 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:36.410773 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6c9fd-ff5f-4c14-ab13-53ac0242d10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:36.411557 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6c9fd-ff5f-4c14-ab13-53ac0242d10d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:36.411845 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6c9fd-ff5f-4c14-ab13-53ac0242d10d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:36.412122 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6c9fd-ff5f-4c14-ab13-53ac0242d10d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:36.415330 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc2dab-72c9-4507-af46-0422889ef13e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:36.417497 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc2dab-72c9-4507-af46-0422889ef13e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:36.427362 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6c9fd-ff5f-4c14-ab13-53ac0242d10d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:36.432020 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 179/354] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:36.440368 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-52a6c9fd-ff5f-4c14-ab13-53ac0242d10d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 05:20:36.442000 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 176/355] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:36.443401 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc2dab-72c9-4507-af46-0422889ef13e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:36.453777 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6c9fd-ff5f-4c14-ab13-53ac0242d10d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:36.458068 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc2dab-72c9-4507-af46-0422889ef13e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:36.464427 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc274eb-c7a0-45a6-b165-bef0d5a5dd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:36.466120 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc274eb-c7a0-45a6-b165-bef0d5a5dd7b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:36.466674 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc274eb-c7a0-45a6-b165-bef0d5a5dd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:36.467211 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc274eb-c7a0-45a6-b165-bef0d5a5dd7b admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:36.468637 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6c9fd-ff5f-4c14-ab13-53ac0242d10d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:36.469004 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc274eb-c7a0-45a6-b165-bef0d5a5dd7b admin admin] RBAC: Authorizing `identity:get_project(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:36.471359 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc274eb-c7a0-45a6-b165-bef0d5a5dd7b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:36.473733 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 180/356] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:36 2022] GET /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:36.479327 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc274eb-c7a0-45a6-b165-bef0d5a5dd7b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:36.479604 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490d004-7321-4276-81ed-962c9b6b43b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:36.480297 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490d004-7321-4276-81ed-962c9b6b43b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:36.480585 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490d004-7321-4276-81ed-962c9b6b43b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:36.480841 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490d004-7321-4276-81ed-962c9b6b43b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:36.488109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490d004-7321-4276-81ed-962c9b6b43b0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:36.488109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490d004-7321-4276-81ed-962c9b6b43b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:36.488109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490d004-7321-4276-81ed-962c9b6b43b0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:36.497091 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 177/357] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:36.503013 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490d004-7321-4276-81ed-962c9b6b43b0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:36.505668 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc274eb-c7a0-45a6-b165-bef0d5a5dd7b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:36.521156 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d183f9a-4ad5-4f1c-9ea0-c4477d17ae4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:36.522036 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d183f9a-4ad5-4f1c-9ea0-c4477d17ae4c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:36.522313 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d183f9a-4ad5-4f1c-9ea0-c4477d17ae4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:36.522586 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d183f9a-4ad5-4f1c-9ea0-c4477d17ae4c admin admin] PATH_INFO: `/v3/groups/d966599a0b324538bcd070faebf51e35` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:36.526040 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490d004-7321-4276-81ed-962c9b6b43b0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:36.526159 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d183f9a-4ad5-4f1c-9ea0-c4477d17ae4c admin admin] RBAC: Authorizing `identity:get_group(group_id=d966599a0b324538bcd070faebf51e35)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:36.526854 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-9d183f9a-4ad5-4f1c-9ea0-c4477d17ae4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:20:36.526854 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Feb 16 05:20:36.526854 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: Feb 16 05:20:36.528249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d183f9a-4ad5-4f1c-9ea0-c4477d17ae4c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:36.530094 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 181/358] 10.222.0.75 () {56 vars in 1201 bytes} [Wed Feb 16 05:20:36 2022] GET /identity/v3/groups/d966599a0b324538bcd070faebf51e35 => generated 226 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:36.538104 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d183f9a-4ad5-4f1c-9ea0-c4477d17ae4c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:36.545995 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf3704-2663-4054-a495-5b03cac9df1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:36.546655 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf3704-2663-4054-a495-5b03cac9df1f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:36.546934 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf3704-2663-4054-a495-5b03cac9df1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:36.547205 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf3704-2663-4054-a495-5b03cac9df1f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:36.556309 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d183f9a-4ad5-4f1c-9ea0-c4477d17ae4c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:36.562900 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf3704-2663-4054-a495-5b03cac9df1f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:36.564686 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf3704-2663-4054-a495-5b03cac9df1f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:36.572657 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226991d5-d58f-45b3-860f-41b22b6ddd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:36.573340 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226991d5-d58f-45b3-860f-41b22b6ddd33 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:36.573620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226991d5-d58f-45b3-860f-41b22b6ddd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:36.573947 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226991d5-d58f-45b3-860f-41b22b6ddd33 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:36.575359 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226991d5-d58f-45b3-860f-41b22b6ddd33 admin admin] RBAC: Adding query filter params (group.id=d966599a0b324538bcd070faebf51e35, role.id=3bbfe5a5163345b2b0d0cee3ea713919, scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:36.575673 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226991d5-d58f-45b3-860f-41b22b6ddd33 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:36.577549 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226991d5-d58f-45b3-860f-41b22b6ddd33 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:36.586770 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 178/359] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:36.588493 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 182/360] 10.222.0.75 () {56 vars in 1397 bytes} [Wed Feb 16 05:20:36 2022] GET /identity/v3/role_assignments?group.id=d966599a0b324538bcd070faebf51e35&scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6&role.id=3bbfe5a5163345b2b0d0cee3ea713919 => generated 260 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:36.592907 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf3704-2663-4054-a495-5b03cac9df1f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:36.606888 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf3704-2663-4054-a495-5b03cac9df1f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:36.612792 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f99186-d426-4f38-bab3-1cc85e5adc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:36.613754 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f99186-d426-4f38-bab3-1cc85e5adc5d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:36.614036 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f99186-d426-4f38-bab3-1cc85e5adc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:36.614304 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f99186-d426-4f38-bab3-1cc85e5adc5d admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:36.618000 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f99186-d426-4f38-bab3-1cc85e5adc5d admin admin] RBAC: Authorizing `identity:get_project(project_id=a04bbe2fdd09464e83b9c4e39549e8ad)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:36.620079 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f99186-d426-4f38-bab3-1cc85e5adc5d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:36.622654 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 179/361] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:36 2022] GET /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:36.628233 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226991d5-d58f-45b3-860f-41b22b6ddd33 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:36.640358 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226991d5-d58f-45b3-860f-41b22b6ddd33 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:36.648775 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edea2b8-49f0-4a5d-b526-dee2e3092d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:36.649676 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edea2b8-49f0-4a5d-b526-dee2e3092d87 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:36.649955 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edea2b8-49f0-4a5d-b526-dee2e3092d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:36.650227 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edea2b8-49f0-4a5d-b526-dee2e3092d87 admin admin] PATH_INFO: `/v3/groups/d966599a0b324538bcd070faebf51e35` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:36.651447 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edea2b8-49f0-4a5d-b526-dee2e3092d87 admin admin] RBAC: Authorizing `identity:get_group(group_id=d966599a0b324538bcd070faebf51e35)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:36.653414 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edea2b8-49f0-4a5d-b526-dee2e3092d87 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:36.655316 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 183/362] 10.222.0.75 () {56 vars in 1201 bytes} [Wed Feb 16 05:20:36 2022] GET /identity/v3/groups/d966599a0b324538bcd070faebf51e35 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:36.661149 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f99186-d426-4f38-bab3-1cc85e5adc5d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:36.673813 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f99186-d426-4f38-bab3-1cc85e5adc5d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:36.678588 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f055ef14-a2c2-4c91-8591-f6961f8a32e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:36.679223 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055ef14-a2c2-4c91-8591-f6961f8a32e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:36.679500 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055ef14-a2c2-4c91-8591-f6961f8a32e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:36.679825 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f055ef14-a2c2-4c91-8591-f6961f8a32e4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:36.680755 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055ef14-a2c2-4c91-8591-f6961f8a32e4 admin admin] RBAC: Adding query filter params (group.id=d966599a0b324538bcd070faebf51e35, role.id=3bbfe5a5163345b2b0d0cee3ea713919, scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:36.681066 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055ef14-a2c2-4c91-8591-f6961f8a32e4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:36.683940 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f055ef14-a2c2-4c91-8591-f6961f8a32e4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:36.696090 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 180/363] 10.222.0.75 () {56 vars in 1397 bytes} [Wed Feb 16 05:20:36 2022] GET /identity/v3/role_assignments?group.id=d966599a0b324538bcd070faebf51e35&scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad&role.id=3bbfe5a5163345b2b0d0cee3ea713919 => generated 260 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:37.435860 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b62b7-8e04-4fec-a818-5e239cea0e1b None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:37.436560 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b62b7-8e04-4fec-a818-5e239cea0e1b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:37.436560 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b62b7-8e04-4fec-a818-5e239cea0e1b None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:37.438450 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 184/364] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:37.443781 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ea488-bb9a-4709-ba53-d5f4b36b37ea None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:37.444254 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ea488-bb9a-4709-ba53-d5f4b36b37ea None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:37.444422 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ea488-bb9a-4709-ba53-d5f4b36b37ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:37.466211 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-3d5ea488-bb9a-4709-ba53-d5f4b36b37ea None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:37.467407 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3d5ea488-bb9a-4709-ba53-d5f4b36b37ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:37.475423 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 181/365] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 05:20:37.510796 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b62b7-8e04-4fec-a818-5e239cea0e1b None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:37.527017 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b62b7-8e04-4fec-a818-5e239cea0e1b None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:37.531479 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3579df-357f-40b9-ac4e-4edd5b292d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:37.532271 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3579df-357f-40b9-ac4e-4edd5b292d8b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:37.532547 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3579df-357f-40b9-ac4e-4edd5b292d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:37.532818 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3579df-357f-40b9-ac4e-4edd5b292d8b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:37.547747 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3579df-357f-40b9-ac4e-4edd5b292d8b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:37.554926 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-0c3579df-357f-40b9-ac4e-4edd5b292d8b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 05:20:37.556164 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 185/366] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Feb 16 05:20:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:37.562810 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ea488-bb9a-4709-ba53-d5f4b36b37ea None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:37.571924 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ea488-bb9a-4709-ba53-d5f4b36b37ea None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:37.577848 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ff84f-6cbc-454b-a495-e4502ae98f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:37.578519 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ff84f-6cbc-454b-a495-e4502ae98f4a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:37.578796 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ff84f-6cbc-454b-a495-e4502ae98f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:37.579068 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ff84f-6cbc-454b-a495-e4502ae98f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:37.579898 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ff84f-6cbc-454b-a495-e4502ae98f4a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:37.580206 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ff84f-6cbc-454b-a495-e4502ae98f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:37.586179 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ff84f-6cbc-454b-a495-e4502ae98f4a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:37.595834 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 182/367] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:37.601501 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3579df-357f-40b9-ac4e-4edd5b292d8b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:37.614703 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3579df-357f-40b9-ac4e-4edd5b292d8b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:37.619302 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d2532-02a5-4d4c-a4ff-5bdc557e98e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:37.619932 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d2532-02a5-4d4c-a4ff-5bdc557e98e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:37.620209 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d2532-02a5-4d4c-a4ff-5bdc557e98e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:37.620482 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d2532-02a5-4d4c-a4ff-5bdc557e98e7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:37.632882 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d2532-02a5-4d4c-a4ff-5bdc557e98e7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:37.634662 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d2532-02a5-4d4c-a4ff-5bdc557e98e7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:37.647139 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 186/368] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:37.652635 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ff84f-6cbc-454b-a495-e4502ae98f4a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:37.662490 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ff84f-6cbc-454b-a495-e4502ae98f4a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:37.678003 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4510124-c6ae-4ba1-a909-85b18f26090c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:37.678872 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4510124-c6ae-4ba1-a909-85b18f26090c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:37.679151 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4510124-c6ae-4ba1-a909-85b18f26090c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:37.679425 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4510124-c6ae-4ba1-a909-85b18f26090c admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:37.680678 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4510124-c6ae-4ba1-a909-85b18f26090c admin admin] RBAC: Authorizing `identity:get_project(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:37.683064 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4510124-c6ae-4ba1-a909-85b18f26090c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:37.685666 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 183/369] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:37 2022] GET /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:37.691125 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d2532-02a5-4d4c-a4ff-5bdc557e98e7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:37.704042 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d2532-02a5-4d4c-a4ff-5bdc557e98e7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:37.722894 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c995e6d-b5e7-4493-ab9c-279643ca8919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:37.723754 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c995e6d-b5e7-4493-ab9c-279643ca8919 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:37.724028 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c995e6d-b5e7-4493-ab9c-279643ca8919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:37.724294 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c995e6d-b5e7-4493-ab9c-279643ca8919 admin admin] PATH_INFO: `/v3/groups/d966599a0b324538bcd070faebf51e35` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:37.725503 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c995e6d-b5e7-4493-ab9c-279643ca8919 admin admin] RBAC: Authorizing `identity:get_group(group_id=d966599a0b324538bcd070faebf51e35)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:37.727407 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c995e6d-b5e7-4493-ab9c-279643ca8919 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:37.729329 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 187/370] 10.222.0.75 () {56 vars in 1201 bytes} [Wed Feb 16 05:20:37 2022] GET /identity/v3/groups/d966599a0b324538bcd070faebf51e35 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:37.735582 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4510124-c6ae-4ba1-a909-85b18f26090c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:37.754309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4510124-c6ae-4ba1-a909-85b18f26090c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:37.761946 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0295d-786a-4dab-b46a-ed3991360c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:37.762593 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0295d-786a-4dab-b46a-ed3991360c02 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:37.762877 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0295d-786a-4dab-b46a-ed3991360c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:37.763153 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0295d-786a-4dab-b46a-ed3991360c02 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:37.763986 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0295d-786a-4dab-b46a-ed3991360c02 admin admin] RBAC: Adding query filter params (group.id=d966599a0b324538bcd070faebf51e35, role.id=997c650af0d54f31940fbb188fe4172c, scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:37.764297 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0295d-786a-4dab-b46a-ed3991360c02 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:37.766204 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0295d-786a-4dab-b46a-ed3991360c02 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:37.776074 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 184/371] 10.222.0.75 () {56 vars in 1397 bytes} [Wed Feb 16 05:20:37 2022] GET /identity/v3/role_assignments?group.id=d966599a0b324538bcd070faebf51e35&scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6&role.id=997c650af0d54f31940fbb188fe4172c => generated 260 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:37.872264 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381ce6c-2fd4-4c3c-a3c9-54458ef21251 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:37.872575 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381ce6c-2fd4-4c3c-a3c9-54458ef21251 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:37.872798 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381ce6c-2fd4-4c3c-a3c9-54458ef21251 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:37.874607 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 188/372] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:37.880364 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f23963-52ff-41bb-93be-48ee75841864 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:37.880648 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f23963-52ff-41bb-93be-48ee75841864 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:37.880917 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f23963-52ff-41bb-93be-48ee75841864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:37.916173 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-28f23963-52ff-41bb-93be-48ee75841864 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:37.916173 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-28f23963-52ff-41bb-93be-48ee75841864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:37.924243 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 185/373] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:37.966903 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381ce6c-2fd4-4c3c-a3c9-54458ef21251 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:37.983378 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381ce6c-2fd4-4c3c-a3c9-54458ef21251 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:37.991983 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a314b7c-0fc3-4218-8afe-50ca950612fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:37.992781 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a314b7c-0fc3-4218-8afe-50ca950612fa admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:37.993058 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a314b7c-0fc3-4218-8afe-50ca950612fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:37.993356 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a314b7c-0fc3-4218-8afe-50ca950612fa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:38.007327 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a314b7c-0fc3-4218-8afe-50ca950612fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:38.014956 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-5a314b7c-0fc3-4218-8afe-50ca950612fa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:20:38.016516 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 189/374] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:20:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:38.022209 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f23963-52ff-41bb-93be-48ee75841864 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:38.034706 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f23963-52ff-41bb-93be-48ee75841864 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:38.051024 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce5f33-a8e7-48a0-95e8-b71a83fd9088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:38.051710 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce5f33-a8e7-48a0-95e8-b71a83fd9088 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:38.051990 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce5f33-a8e7-48a0-95e8-b71a83fd9088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:38.052262 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce5f33-a8e7-48a0-95e8-b71a83fd9088 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:38.053040 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce5f33-a8e7-48a0-95e8-b71a83fd9088 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:38.053379 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce5f33-a8e7-48a0-95e8-b71a83fd9088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:38.055056 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce5f33-a8e7-48a0-95e8-b71a83fd9088 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:38.069343 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 186/375] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:38.074909 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a314b7c-0fc3-4218-8afe-50ca950612fa admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:38.085891 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a314b7c-0fc3-4218-8afe-50ca950612fa admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:38.093503 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a5220-c805-45f0-be17-e3171ee0f5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:38.094150 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a5220-c805-45f0-be17-e3171ee0f5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:38.094428 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a5220-c805-45f0-be17-e3171ee0f5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:38.094760 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a5220-c805-45f0-be17-e3171ee0f5c6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:38.103996 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a5220-c805-45f0-be17-e3171ee0f5c6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:38.106352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a5220-c805-45f0-be17-e3171ee0f5c6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:38.119429 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 190/376] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:38.125201 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce5f33-a8e7-48a0-95e8-b71a83fd9088 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:38.135286 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce5f33-a8e7-48a0-95e8-b71a83fd9088 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:38.141612 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648145b-ad2a-4d35-8228-6b5234b41136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:38.142470 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648145b-ad2a-4d35-8228-6b5234b41136 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:38.142749 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648145b-ad2a-4d35-8228-6b5234b41136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:38.143020 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648145b-ad2a-4d35-8228-6b5234b41136 admin admin] PATH_INFO: `/v3/projects/b93c4f51f61141d6b4554752db1f615b` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:38.144918 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648145b-ad2a-4d35-8228-6b5234b41136 admin admin] RBAC: Authorizing `identity:get_project(project_id=b93c4f51f61141d6b4554752db1f615b)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:38.146782 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648145b-ad2a-4d35-8228-6b5234b41136 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:38.149704 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 187/377] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:38 2022] GET /identity/v3/projects/b93c4f51f61141d6b4554752db1f615b => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:38.154946 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a5220-c805-45f0-be17-e3171ee0f5c6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:38.164031 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a5220-c805-45f0-be17-e3171ee0f5c6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:38.173644 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c86b5-161f-48df-8e99-4def26f59d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:38.174495 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c86b5-161f-48df-8e99-4def26f59d43 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:38.174776 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c86b5-161f-48df-8e99-4def26f59d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:38.175055 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c86b5-161f-48df-8e99-4def26f59d43 admin admin] PATH_INFO: `/v3/groups/4a342ba79dae4793a5a6510ebe5008de` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:38.186152 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c86b5-161f-48df-8e99-4def26f59d43 admin admin] RBAC: Authorizing `identity:get_group(group_id=4a342ba79dae4793a5a6510ebe5008de)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:38.188086 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c86b5-161f-48df-8e99-4def26f59d43 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:38.190410 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 191/378] 10.222.0.75 () {56 vars in 1201 bytes} [Wed Feb 16 05:20:38 2022] GET /identity/v3/groups/4a342ba79dae4793a5a6510ebe5008de => generated 229 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:38.198638 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648145b-ad2a-4d35-8228-6b5234b41136 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:38.215181 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648145b-ad2a-4d35-8228-6b5234b41136 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:38.226242 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a20fc6-e45d-4ec9-9e0c-980b3a3a4dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:38.226840 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a20fc6-e45d-4ec9-9e0c-980b3a3a4dcb admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:38.227124 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a20fc6-e45d-4ec9-9e0c-980b3a3a4dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:38.227393 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a20fc6-e45d-4ec9-9e0c-980b3a3a4dcb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:38.228245 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a20fc6-e45d-4ec9-9e0c-980b3a3a4dcb admin admin] RBAC: Adding query filter params (group.id=4a342ba79dae4793a5a6510ebe5008de, role.id=9ba4a5967ed243178927661616f08901, scope.project.id=b93c4f51f61141d6b4554752db1f615b) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:38.228555 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a20fc6-e45d-4ec9-9e0c-980b3a3a4dcb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:38.231113 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a20fc6-e45d-4ec9-9e0c-980b3a3a4dcb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:38.237734 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 188/379] 10.222.0.75 () {56 vars in 1397 bytes} [Wed Feb 16 05:20:38 2022] GET /identity/v3/role_assignments?group.id=4a342ba79dae4793a5a6510ebe5008de&scope.project.id=b93c4f51f61141d6b4554752db1f615b&role.id=9ba4a5967ed243178927661616f08901 => generated 260 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:38.951203 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38eec46-2c4a-48c7-929c-eb72db1ad545 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:38.951203 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38eec46-2c4a-48c7-929c-eb72db1ad545 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:38.951203 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38eec46-2c4a-48c7-929c-eb72db1ad545 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:38.951203 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 192/380] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:38.952288 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac430f-2a37-46ec-8fe2-5bb269b71c9b None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:38.952288 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac430f-2a37-46ec-8fe2-5bb269b71c9b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:38.952288 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ac430f-2a37-46ec-8fe2-5bb269b71c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:38.971516 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-34ac430f-2a37-46ec-8fe2-5bb269b71c9b None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:38.973029 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-34ac430f-2a37-46ec-8fe2-5bb269b71c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:38.987170 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 189/381] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:39.028928 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38eec46-2c4a-48c7-929c-eb72db1ad545 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:39.047836 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38eec46-2c4a-48c7-929c-eb72db1ad545 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:39.052713 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88b0d9-6053-41ce-b63a-480881b9cbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:39.053793 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88b0d9-6053-41ce-b63a-480881b9cbcc admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:39.054279 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88b0d9-6053-41ce-b63a-480881b9cbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:39.054793 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88b0d9-6053-41ce-b63a-480881b9cbcc admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:39.072006 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88b0d9-6053-41ce-b63a-480881b9cbcc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:39.079847 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-fb88b0d9-6053-41ce-b63a-480881b9cbcc admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 05:20:39.081679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 193/382] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Feb 16 05:20:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:39.087121 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac430f-2a37-46ec-8fe2-5bb269b71c9b None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:39.097149 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ac430f-2a37-46ec-8fe2-5bb269b71c9b None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:39.106013 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec1ab0-18bd-4cb6-9d39-449f50aa480a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:39.106981 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec1ab0-18bd-4cb6-9d39-449f50aa480a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:39.107483 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec1ab0-18bd-4cb6-9d39-449f50aa480a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:39.107955 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec1ab0-18bd-4cb6-9d39-449f50aa480a admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:39.108949 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec1ab0-18bd-4cb6-9d39-449f50aa480a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:39.109534 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec1ab0-18bd-4cb6-9d39-449f50aa480a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:39.111439 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec1ab0-18bd-4cb6-9d39-449f50aa480a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:39.123483 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 190/383] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:39.128855 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88b0d9-6053-41ce-b63a-480881b9cbcc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:39.140728 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88b0d9-6053-41ce-b63a-480881b9cbcc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:39.145854 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257d8bc-8f08-4ab9-a128-f38ee229b5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:39.147052 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257d8bc-8f08-4ab9-a128-f38ee229b5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:39.147536 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257d8bc-8f08-4ab9-a128-f38ee229b5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:39.148010 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257d8bc-8f08-4ab9-a128-f38ee229b5a2 admin admin] PATH_INFO: `/v3/groups/d966599a0b324538bcd070faebf51e35` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:39.150926 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257d8bc-8f08-4ab9-a128-f38ee229b5a2 admin admin] RBAC: Authorizing `identity:get_group(group_id=d966599a0b324538bcd070faebf51e35)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:39.153776 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257d8bc-8f08-4ab9-a128-f38ee229b5a2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:39.155663 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 194/384] 10.222.0.75 () {56 vars in 1201 bytes} [Wed Feb 16 05:20:39 2022] GET /identity/v3/groups/d966599a0b324538bcd070faebf51e35 => generated 226 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:39.161199 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec1ab0-18bd-4cb6-9d39-449f50aa480a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:39.171492 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec1ab0-18bd-4cb6-9d39-449f50aa480a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:39.183034 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63115f-d3f1-4520-aa38-919c2d75623d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:39.184213 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63115f-d3f1-4520-aa38-919c2d75623d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:39.184695 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63115f-d3f1-4520-aa38-919c2d75623d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:39.185166 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63115f-d3f1-4520-aa38-919c2d75623d admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:39.186609 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63115f-d3f1-4520-aa38-919c2d75623d admin admin] RBAC: Authorizing `identity:get_project(project_id=a04bbe2fdd09464e83b9c4e39549e8ad)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:39.188916 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63115f-d3f1-4520-aa38-919c2d75623d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:39.191111 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 191/385] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:39 2022] GET /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:39.196492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257d8bc-8f08-4ab9-a128-f38ee229b5a2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:39.207214 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257d8bc-8f08-4ab9-a128-f38ee229b5a2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:39.216887 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16617b-b335-4f62-aa9d-e6e8fe38467c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:39.218076 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16617b-b335-4f62-aa9d-e6e8fe38467c admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:39.218563 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16617b-b335-4f62-aa9d-e6e8fe38467c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:39.219098 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16617b-b335-4f62-aa9d-e6e8fe38467c admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad/groups/d966599a0b324538bcd070faebf51e35/roles/997c650af0d54f31940fbb188fe4172c` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:39.221630 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16617b-b335-4f62-aa9d-e6e8fe38467c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04bbe2fdd09464e83b9c4e39549e8ad, group_id=d966599a0b324538bcd070faebf51e35, role_id=997c650af0d54f31940fbb188fe4172c)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:39.224509 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16617b-b335-4f62-aa9d-e6e8fe38467c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:39.253563 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 195/386] 10.222.0.75 () {58 vars in 1463 bytes} [Wed Feb 16 05:20:39 2022] PUT /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad/groups/d966599a0b324538bcd070faebf51e35/roles/997c650af0d54f31940fbb188fe4172c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:20:39.710286 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91ece3-6a12-4902-9261-f401d66898f7 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:39.710974 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91ece3-6a12-4902-9261-f401d66898f7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:39.711453 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91ece3-6a12-4902-9261-f401d66898f7 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:39.713840 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 192/387] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:39.722886 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5fc0e-7bc3-40a3-804b-3d18ca270c5a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:39.723175 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5fc0e-7bc3-40a3-804b-3d18ca270c5a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:39.723451 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5fc0e-7bc3-40a3-804b-3d18ca270c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:39.750271 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0ad5fc0e-7bc3-40a3-804b-3d18ca270c5a None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:39.751468 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0ad5fc0e-7bc3-40a3-804b-3d18ca270c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:39.777510 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c3aac-c163-474c-9ac3-80b5b8c204b9 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:39.778109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c3aac-c163-474c-9ac3-80b5b8c204b9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:39.778597 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c3aac-c163-474c-9ac3-80b5b8c204b9 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:39.780771 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 193/388] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:39.786299 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f031f-5918-4311-8b4a-a6bd87f31ea6 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:39.786829 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f031f-5918-4311-8b4a-a6bd87f31ea6 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:39.787101 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f031f-5918-4311-8b4a-a6bd87f31ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:39.809674 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-147f031f-5918-4311-8b4a-a6bd87f31ea6 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:39.811597 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-147f031f-5918-4311-8b4a-a6bd87f31ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:39.838106 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 196/389] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:39.876265 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5fc0e-7bc3-40a3-804b-3d18ca270c5a None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:39.894537 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5fc0e-7bc3-40a3-804b-3d18ca270c5a None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:39.900450 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 194/390] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 05:20:39.909700 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548712a-43ac-4b6e-a3c0-77ceffa34f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:39.910505 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548712a-43ac-4b6e-a3c0-77ceffa34f05 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:39.910785 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548712a-43ac-4b6e-a3c0-77ceffa34f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:39.911056 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548712a-43ac-4b6e-a3c0-77ceffa34f05 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:39.923555 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f031f-5918-4311-8b4a-a6bd87f31ea6 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:39.934637 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548712a-43ac-4b6e-a3c0-77ceffa34f05 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:39.935770 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f031f-5918-4311-8b4a-a6bd87f31ea6 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:39.940794 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3939b9f-13b3-4016-96c7-20a5deebad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:39.941548 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-7548712a-43ac-4b6e-a3c0-77ceffa34f05 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 05:20:39.942275 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3939b9f-13b3-4016-96c7-20a5deebad54 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:39.942759 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3939b9f-13b3-4016-96c7-20a5deebad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:39.945353 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 197/391] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:39.946086 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3939b9f-13b3-4016-96c7-20a5deebad54 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:39.953221 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548712a-43ac-4b6e-a3c0-77ceffa34f05 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:39.961143 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3939b9f-13b3-4016-96c7-20a5deebad54 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:39.970642 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-b3939b9f-13b3-4016-96c7-20a5deebad54 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 05:20:39.971656 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548712a-43ac-4b6e-a3c0-77ceffa34f05 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:39.975709 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 195/392] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:39.978892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3939b9f-13b3-4016-96c7-20a5deebad54 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:39.986880 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b57503-9241-4a77-b322-f3c73cf9e84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:39.987555 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b57503-9241-4a77-b322-f3c73cf9e84b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:39.987838 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b57503-9241-4a77-b322-f3c73cf9e84b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:39.988103 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b57503-9241-4a77-b322-f3c73cf9e84b admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:39.988856 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b57503-9241-4a77-b322-f3c73cf9e84b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:39.989157 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b57503-9241-4a77-b322-f3c73cf9e84b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:39.990810 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b57503-9241-4a77-b322-f3c73cf9e84b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:39.991487 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3939b9f-13b3-4016-96c7-20a5deebad54 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:40.005307 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748c14a-d6c4-485b-89b4-3e3f80f3ef60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:40.005307 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748c14a-d6c4-485b-89b4-3e3f80f3ef60 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:40.005307 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748c14a-d6c4-485b-89b4-3e3f80f3ef60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:40.005307 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748c14a-d6c4-485b-89b4-3e3f80f3ef60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:40.005663 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748c14a-d6c4-485b-89b4-3e3f80f3ef60 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:40.005663 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748c14a-d6c4-485b-89b4-3e3f80f3ef60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:40.009306 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748c14a-d6c4-485b-89b4-3e3f80f3ef60 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:40.012499 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 198/393] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:40.018832 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b57503-9241-4a77-b322-f3c73cf9e84b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:40.029940 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b57503-9241-4a77-b322-f3c73cf9e84b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:40.034361 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 196/394] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:40.040700 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748c14a-d6c4-485b-89b4-3e3f80f3ef60 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:40.049989 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ee047-527c-4c58-9c5f-d773cf60e633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:40.050861 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ee047-527c-4c58-9c5f-d773cf60e633 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:40.051144 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ee047-527c-4c58-9c5f-d773cf60e633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:40.051419 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ee047-527c-4c58-9c5f-d773cf60e633 admin admin] PATH_INFO: `/v3/groups/d966599a0b324538bcd070faebf51e35` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:40.052917 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748c14a-d6c4-485b-89b4-3e3f80f3ef60 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:40.054994 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ee047-527c-4c58-9c5f-d773cf60e633 admin admin] RBAC: Authorizing `identity:get_group(group_id=d966599a0b324538bcd070faebf51e35)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:40.057550 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ee047-527c-4c58-9c5f-d773cf60e633 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:40.058686 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f6376-9593-46dd-96c9-e0d3f3791fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:40.059650 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 199/395] 10.222.0.75 () {56 vars in 1201 bytes} [Wed Feb 16 05:20:40 2022] GET /identity/v3/groups/d966599a0b324538bcd070faebf51e35 => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:40.060075 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f6376-9593-46dd-96c9-e0d3f3791fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:40.060649 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f6376-9593-46dd-96c9-e0d3f3791fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:40.061185 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f6376-9593-46dd-96c9-e0d3f3791fa4 admin admin] PATH_INFO: `/v3/groups/d966599a0b324538bcd070faebf51e35` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:40.062716 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f6376-9593-46dd-96c9-e0d3f3791fa4 admin admin] RBAC: Authorizing `identity:get_group(group_id=d966599a0b324538bcd070faebf51e35)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:40.064654 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ee047-527c-4c58-9c5f-d773cf60e633 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:40.065396 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f6376-9593-46dd-96c9-e0d3f3791fa4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:40.073388 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 197/396] 10.222.0.75 () {56 vars in 1201 bytes} [Wed Feb 16 05:20:40 2022] GET /identity/v3/groups/d966599a0b324538bcd070faebf51e35 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:40.076336 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f6376-9593-46dd-96c9-e0d3f3791fa4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:40.082396 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ee047-527c-4c58-9c5f-d773cf60e633 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:40.087001 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f6376-9593-46dd-96c9-e0d3f3791fa4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:40.092781 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ee45e-5ce7-40e6-b042-f089321c7fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:40.094895 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ee45e-5ce7-40e6-b042-f089321c7fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:40.095435 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ee45e-5ce7-40e6-b042-f089321c7fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:40.095907 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ee45e-5ce7-40e6-b042-f089321c7fa1 admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:40.098233 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc3f8f-ff47-4013-b0ec-3bb12671a44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:40.098233 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc3f8f-ff47-4013-b0ec-3bb12671a44f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:40.098515 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc3f8f-ff47-4013-b0ec-3bb12671a44f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:40.098776 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc3f8f-ff47-4013-b0ec-3bb12671a44f admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:40.099755 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ee45e-5ce7-40e6-b042-f089321c7fa1 admin admin] RBAC: Authorizing `identity:get_project(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:40.102195 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ee45e-5ce7-40e6-b042-f089321c7fa1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:40.108540 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc3f8f-ff47-4013-b0ec-3bb12671a44f admin admin] RBAC: Authorizing `identity:get_project(project_id=a04bbe2fdd09464e83b9c4e39549e8ad)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:40.108540 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc3f8f-ff47-4013-b0ec-3bb12671a44f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:40.109146 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 198/397] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:40 2022] GET /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:40.110317 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 200/398] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:40 2022] GET /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:40.111194 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ee45e-5ce7-40e6-b042-f089321c7fa1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:40.118153 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc3f8f-ff47-4013-b0ec-3bb12671a44f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:40.122168 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ee45e-5ce7-40e6-b042-f089321c7fa1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:40.131582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc3f8f-ff47-4013-b0ec-3bb12671a44f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:40.132749 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf5dc7-3019-4649-af04-7e3e5e3a3d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:40.134074 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf5dc7-3019-4649-af04-7e3e5e3a3d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:40.134557 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf5dc7-3019-4649-af04-7e3e5e3a3d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:40.135065 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf5dc7-3019-4649-af04-7e3e5e3a3d3d admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6/groups/d966599a0b324538bcd070faebf51e35/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:40.138178 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf5dc7-3019-4649-af04-7e3e5e3a3d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6, group_id=d966599a0b324538bcd070faebf51e35, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:40.141196 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf5dc7-3019-4649-af04-7e3e5e3a3d3d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:40.150978 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6cd66a-2a91-4092-af26-870fa5c509a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:40.151950 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cd66a-2a91-4092-af26-870fa5c509a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:40.152755 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cd66a-2a91-4092-af26-870fa5c509a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:40.153058 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6cd66a-2a91-4092-af26-870fa5c509a6 admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad/groups/d966599a0b324538bcd070faebf51e35/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:40.156624 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cd66a-2a91-4092-af26-870fa5c509a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04bbe2fdd09464e83b9c4e39549e8ad, group_id=d966599a0b324538bcd070faebf51e35, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:40.159339 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6cd66a-2a91-4092-af26-870fa5c509a6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:40.164116 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 199/399] 10.222.0.75 () {58 vars in 1463 bytes} [Wed Feb 16 05:20:40 2022] PUT /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6/groups/d966599a0b324538bcd070faebf51e35/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:20:40.195338 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 201/400] 10.222.0.75 () {58 vars in 1463 bytes} [Wed Feb 16 05:20:40 2022] PUT /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad/groups/d966599a0b324538bcd070faebf51e35/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:20:40.963898 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa423f-c68d-457e-8a39-d5041d1b846c None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:40.965492 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa423f-c68d-457e-8a39-d5041d1b846c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:40.966016 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa423f-c68d-457e-8a39-d5041d1b846c None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:40.968397 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 200/401] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:40.973604 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103bd72-135a-4c58-9373-202be3f24683 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:40.974504 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103bd72-135a-4c58-9373-202be3f24683 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:40.975002 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a103bd72-135a-4c58-9373-202be3f24683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:40.994622 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-a103bd72-135a-4c58-9373-202be3f24683 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:40.996229 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a103bd72-135a-4c58-9373-202be3f24683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:41.065244 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 202/402] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:41.098223 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa423f-c68d-457e-8a39-d5041d1b846c None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:41.111970 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa423f-c68d-457e-8a39-d5041d1b846c None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:41.120767 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47ba5b-9e5a-4383-91a1-592199f6a90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:41.122033 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47ba5b-9e5a-4383-91a1-592199f6a90c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:41.122533 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47ba5b-9e5a-4383-91a1-592199f6a90c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:41.123014 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47ba5b-9e5a-4383-91a1-592199f6a90c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:41.134479 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47ba5b-9e5a-4383-91a1-592199f6a90c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:41.142475 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-0c47ba5b-9e5a-4383-91a1-592199f6a90c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 05:20:41.144560 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 201/403] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Feb 16 05:20:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:41.150029 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103bd72-135a-4c58-9373-202be3f24683 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:41.160276 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a103bd72-135a-4c58-9373-202be3f24683 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:41.165085 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cf8fd-edc0-422c-b23a-cfac28dd02aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:41.166097 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cf8fd-edc0-422c-b23a-cfac28dd02aa admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:41.166657 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cf8fd-edc0-422c-b23a-cfac28dd02aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:41.167142 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cf8fd-edc0-422c-b23a-cfac28dd02aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:41.168709 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0cf8fd-edc0-422c-b23a-cfac28dd02aa admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:41.169226 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0cf8fd-edc0-422c-b23a-cfac28dd02aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:41.171101 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0cf8fd-edc0-422c-b23a-cfac28dd02aa admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:41.181229 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 203/404] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:41.190331 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47ba5b-9e5a-4383-91a1-592199f6a90c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:41.201595 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47ba5b-9e5a-4383-91a1-592199f6a90c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:41.208967 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a8f8d-676c-49c7-a284-c0226f43e6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:41.210107 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a8f8d-676c-49c7-a284-c0226f43e6ef admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:41.210640 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a8f8d-676c-49c7-a284-c0226f43e6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:41.211117 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a8f8d-676c-49c7-a284-c0226f43e6ef admin admin] PATH_INFO: `/v3/groups/d966599a0b324538bcd070faebf51e35` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:41.212496 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a8f8d-676c-49c7-a284-c0226f43e6ef admin admin] RBAC: Authorizing `identity:get_group(group_id=d966599a0b324538bcd070faebf51e35)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:41.218919 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a8f8d-676c-49c7-a284-c0226f43e6ef admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:41.220832 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 202/405] 10.222.0.75 () {56 vars in 1201 bytes} [Wed Feb 16 05:20:41 2022] GET /identity/v3/groups/d966599a0b324538bcd070faebf51e35 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:41.226311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cf8fd-edc0-422c-b23a-cfac28dd02aa admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:41.238696 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cf8fd-edc0-422c-b23a-cfac28dd02aa admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:41.243919 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09f22f-771d-4b8a-b83b-0a96716b9362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:41.245165 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09f22f-771d-4b8a-b83b-0a96716b9362 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:41.245717 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09f22f-771d-4b8a-b83b-0a96716b9362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:41.246219 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09f22f-771d-4b8a-b83b-0a96716b9362 admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:41.247725 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09f22f-771d-4b8a-b83b-0a96716b9362 admin admin] RBAC: Authorizing `identity:get_project(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:41.250919 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09f22f-771d-4b8a-b83b-0a96716b9362 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:41.257488 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 204/406] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:41 2022] GET /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:41.263018 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a8f8d-676c-49c7-a284-c0226f43e6ef admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:41.273731 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a8f8d-676c-49c7-a284-c0226f43e6ef admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:41.281088 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32eef41-02c8-4c07-abe0-c641f48c511f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:41.282295 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32eef41-02c8-4c07-abe0-c641f48c511f admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:41.282807 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32eef41-02c8-4c07-abe0-c641f48c511f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:41.283316 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32eef41-02c8-4c07-abe0-c641f48c511f admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6/groups/d966599a0b324538bcd070faebf51e35/roles/997c650af0d54f31940fbb188fe4172c` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:41.286033 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32eef41-02c8-4c07-abe0-c641f48c511f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6, group_id=d966599a0b324538bcd070faebf51e35, role_id=997c650af0d54f31940fbb188fe4172c)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:41.289066 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32eef41-02c8-4c07-abe0-c641f48c511f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:41.317080 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 203/407] 10.222.0.75 () {58 vars in 1463 bytes} [Wed Feb 16 05:20:41 2022] PUT /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6/groups/d966599a0b324538bcd070faebf51e35/roles/997c650af0d54f31940fbb188fe4172c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:20:41.742052 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b21089-c668-4e48-acc5-0a3c4c6647e4 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:41.742394 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b21089-c668-4e48-acc5-0a3c4c6647e4 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:41.742595 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b21089-c668-4e48-acc5-0a3c4c6647e4 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:41.746236 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 205/408] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:41.752023 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d578a9-13d5-4b76-8bfa-bf7eac512660 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:41.752311 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d578a9-13d5-4b76-8bfa-bf7eac512660 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:41.752584 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d578a9-13d5-4b76-8bfa-bf7eac512660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:41.773611 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f7d578a9-13d5-4b76-8bfa-bf7eac512660 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:41.774818 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f7d578a9-13d5-4b76-8bfa-bf7eac512660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:41.851773 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 204/409] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:41.892378 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b21089-c668-4e48-acc5-0a3c4c6647e4 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:41.910884 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b21089-c668-4e48-acc5-0a3c4c6647e4 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:41.915433 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda2d72-4f60-437f-ab6f-802259804be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:41.916227 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda2d72-4f60-437f-ab6f-802259804be5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:41.916494 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda2d72-4f60-437f-ab6f-802259804be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:41.916764 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda2d72-4f60-437f-ab6f-802259804be5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:41.938819 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda2d72-4f60-437f-ab6f-802259804be5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:41.945728 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-ecda2d72-4f60-437f-ab6f-802259804be5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:20:41.947223 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 206/410] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:20:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:41.953463 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d578a9-13d5-4b76-8bfa-bf7eac512660 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:41.962482 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d578a9-13d5-4b76-8bfa-bf7eac512660 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:41.968094 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ddf31-2b57-4e58-8d7e-032774e8c99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:41.968761 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ddf31-2b57-4e58-8d7e-032774e8c99e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:41.969026 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ddf31-2b57-4e58-8d7e-032774e8c99e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:41.969307 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ddf31-2b57-4e58-8d7e-032774e8c99e admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:41.970057 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ddf31-2b57-4e58-8d7e-032774e8c99e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:41.970356 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ddf31-2b57-4e58-8d7e-032774e8c99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:41.971964 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ddf31-2b57-4e58-8d7e-032774e8c99e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:41.984758 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 205/411] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:41.990243 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda2d72-4f60-437f-ab6f-802259804be5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:42.005397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda2d72-4f60-437f-ab6f-802259804be5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:42.010052 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b822f-f400-410b-a6da-a433d63b2d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:42.010876 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b822f-f400-410b-a6da-a433d63b2d3a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:42.011202 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b822f-f400-410b-a6da-a433d63b2d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:42.011973 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b822f-f400-410b-a6da-a433d63b2d3a admin admin] PATH_INFO: `/v3/groups/4a342ba79dae4793a5a6510ebe5008de` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:42.013166 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b822f-f400-410b-a6da-a433d63b2d3a admin admin] RBAC: Authorizing `identity:get_group(group_id=4a342ba79dae4793a5a6510ebe5008de)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:42.015106 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b822f-f400-410b-a6da-a433d63b2d3a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:42.016682 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 207/412] 10.222.0.75 () {56 vars in 1201 bytes} [Wed Feb 16 05:20:41 2022] GET /identity/v3/groups/4a342ba79dae4793a5a6510ebe5008de => generated 229 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:42.022041 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ddf31-2b57-4e58-8d7e-032774e8c99e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:42.034383 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ddf31-2b57-4e58-8d7e-032774e8c99e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:42.042273 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c53fbc-fe2e-400c-9d19-ef2f4f3ce5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:42.043685 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c53fbc-fe2e-400c-9d19-ef2f4f3ce5dc admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:42.043966 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c53fbc-fe2e-400c-9d19-ef2f4f3ce5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:42.044236 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c53fbc-fe2e-400c-9d19-ef2f4f3ce5dc admin admin] PATH_INFO: `/v3/projects/b93c4f51f61141d6b4554752db1f615b` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:42.045975 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c53fbc-fe2e-400c-9d19-ef2f4f3ce5dc admin admin] RBAC: Authorizing `identity:get_project(project_id=b93c4f51f61141d6b4554752db1f615b)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:42.047792 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c53fbc-fe2e-400c-9d19-ef2f4f3ce5dc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:42.049783 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 206/413] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:42 2022] GET /identity/v3/projects/b93c4f51f61141d6b4554752db1f615b => generated 344 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:42.054965 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b822f-f400-410b-a6da-a433d63b2d3a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:42.067663 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b822f-f400-410b-a6da-a433d63b2d3a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:42.078417 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31e85f-8ca7-43cd-9414-b703b86f2167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:42.079294 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31e85f-8ca7-43cd-9414-b703b86f2167 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:42.079576 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31e85f-8ca7-43cd-9414-b703b86f2167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:42.079841 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31e85f-8ca7-43cd-9414-b703b86f2167 admin admin] PATH_INFO: `/v3/projects/b93c4f51f61141d6b4554752db1f615b/groups/4a342ba79dae4793a5a6510ebe5008de/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:42.086551 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31e85f-8ca7-43cd-9414-b703b86f2167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b93c4f51f61141d6b4554752db1f615b, group_id=4a342ba79dae4793a5a6510ebe5008de, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:42.089208 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31e85f-8ca7-43cd-9414-b703b86f2167 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:42.117014 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 208/414] 10.222.0.75 () {58 vars in 1463 bytes} [Wed Feb 16 05:20:42 2022] PUT /identity/v3/projects/b93c4f51f61141d6b4554752db1f615b/groups/4a342ba79dae4793a5a6510ebe5008de/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:20:42.510774 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118a19c-7755-4b71-8c1f-e16627732ea8 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:42.511183 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118a19c-7755-4b71-8c1f-e16627732ea8 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:42.511366 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118a19c-7755-4b71-8c1f-e16627732ea8 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:42.513453 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 207/415] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:42.518642 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1f456-b1be-45e0-a0f8-15685b3bf555 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:42.518925 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1f456-b1be-45e0-a0f8-15685b3bf555 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:42.519204 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a1f456-b1be-45e0-a0f8-15685b3bf555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:42.540396 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-f7a1f456-b1be-45e0-a0f8-15685b3bf555 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:42.541635 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f7a1f456-b1be-45e0-a0f8-15685b3bf555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:42.613249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 209/416] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:42.638596 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118a19c-7755-4b71-8c1f-e16627732ea8 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:42.650827 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118a19c-7755-4b71-8c1f-e16627732ea8 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:42.655673 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd22a1-c0ba-4d43-abe4-371581a1a1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:42.656455 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd22a1-c0ba-4d43-abe4-371581a1a1be admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:42.656730 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd22a1-c0ba-4d43-abe4-371581a1a1be admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:42.657000 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd22a1-c0ba-4d43-abe4-371581a1a1be admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:42.668299 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd22a1-c0ba-4d43-abe4-371581a1a1be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:42.675529 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-71dd22a1-c0ba-4d43-abe4-371581a1a1be admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 05:20:42.677049 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 208/417] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Feb 16 05:20:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:42.683551 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1f456-b1be-45e0-a0f8-15685b3bf555 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:42.694003 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a1f456-b1be-45e0-a0f8-15685b3bf555 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:42.703605 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb22d7-cd80-4ecf-9a3b-f206f5b125bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:42.704289 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb22d7-cd80-4ecf-9a3b-f206f5b125bd admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:42.704570 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb22d7-cd80-4ecf-9a3b-f206f5b125bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:42.704841 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb22d7-cd80-4ecf-9a3b-f206f5b125bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:42.705649 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb22d7-cd80-4ecf-9a3b-f206f5b125bd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:42.705955 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb22d7-cd80-4ecf-9a3b-f206f5b125bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:42.707633 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb22d7-cd80-4ecf-9a3b-f206f5b125bd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:42.725323 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 210/418] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:42.730979 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd22a1-c0ba-4d43-abe4-371581a1a1be admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:42.742602 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd22a1-c0ba-4d43-abe4-371581a1a1be admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:42.753705 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935579a8-20d5-45b7-8eb0-6b1d80a6f05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:42.754366 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935579a8-20d5-45b7-8eb0-6b1d80a6f05f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:42.754645 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935579a8-20d5-45b7-8eb0-6b1d80a6f05f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:42.754914 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935579a8-20d5-45b7-8eb0-6b1d80a6f05f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:42.770331 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935579a8-20d5-45b7-8eb0-6b1d80a6f05f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:42.772033 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935579a8-20d5-45b7-8eb0-6b1d80a6f05f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:42.783239 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 209/419] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:42.788430 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb22d7-cd80-4ecf-9a3b-f206f5b125bd admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:42.806095 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb22d7-cd80-4ecf-9a3b-f206f5b125bd admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:42.818502 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91d56b-ec8c-4ab6-965c-439af7b8995d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:42.819364 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91d56b-ec8c-4ab6-965c-439af7b8995d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:42.819642 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91d56b-ec8c-4ab6-965c-439af7b8995d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:42.819911 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91d56b-ec8c-4ab6-965c-439af7b8995d admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:42.826010 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91d56b-ec8c-4ab6-965c-439af7b8995d admin admin] RBAC: Authorizing `identity:get_project(project_id=a04bbe2fdd09464e83b9c4e39549e8ad)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:42.828068 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91d56b-ec8c-4ab6-965c-439af7b8995d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:42.829785 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 211/420] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:42 2022] GET /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:42.835349 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935579a8-20d5-45b7-8eb0-6b1d80a6f05f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:42.848044 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935579a8-20d5-45b7-8eb0-6b1d80a6f05f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:42.858799 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf822a-ff64-40ef-bdf2-20e125448e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:42.859652 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf822a-ff64-40ef-bdf2-20e125448e41 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:42.859982 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf822a-ff64-40ef-bdf2-20e125448e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:42.860210 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf822a-ff64-40ef-bdf2-20e125448e41 admin admin] PATH_INFO: `/v3/groups/d966599a0b324538bcd070faebf51e35` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:42.866018 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf822a-ff64-40ef-bdf2-20e125448e41 admin admin] RBAC: Authorizing `identity:get_group(group_id=d966599a0b324538bcd070faebf51e35)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:42.867953 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf822a-ff64-40ef-bdf2-20e125448e41 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:42.869929 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 210/421] 10.222.0.75 () {56 vars in 1201 bytes} [Wed Feb 16 05:20:42 2022] GET /identity/v3/groups/d966599a0b324538bcd070faebf51e35 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:42.875871 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91d56b-ec8c-4ab6-965c-439af7b8995d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:42.890304 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91d56b-ec8c-4ab6-965c-439af7b8995d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:42.897994 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83a36c-cebf-4eb5-8634-b7c19c84a1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:42.898637 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83a36c-cebf-4eb5-8634-b7c19c84a1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:42.898916 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83a36c-cebf-4eb5-8634-b7c19c84a1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:42.899189 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83a36c-cebf-4eb5-8634-b7c19c84a1b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:42.900022 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83a36c-cebf-4eb5-8634-b7c19c84a1b8 admin admin] RBAC: Adding query filter params (group.id=d966599a0b324538bcd070faebf51e35, role.id=997c650af0d54f31940fbb188fe4172c, scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:42.900327 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83a36c-cebf-4eb5-8634-b7c19c84a1b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:42.902324 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83a36c-cebf-4eb5-8634-b7c19c84a1b8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:42.910096 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 212/422] 10.222.0.75 () {56 vars in 1397 bytes} [Wed Feb 16 05:20:42 2022] GET /identity/v3/role_assignments?group.id=d966599a0b324538bcd070faebf51e35&scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad&role.id=997c650af0d54f31940fbb188fe4172c => generated 611 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:43.167350 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea904b-9820-4197-a234-c5f817406308 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:43.168055 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea904b-9820-4197-a234-c5f817406308 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:43.168055 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea904b-9820-4197-a234-c5f817406308 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:43.169685 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 211/423] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:43.175835 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2fe2c-60f9-4927-8daa-e6568dca04d7 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:43.176394 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2fe2c-60f9-4927-8daa-e6568dca04d7 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:43.176394 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2fe2c-60f9-4927-8daa-e6568dca04d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:43.197241 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-1ec2fe2c-60f9-4927-8daa-e6568dca04d7 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:43.198454 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1ec2fe2c-60f9-4927-8daa-e6568dca04d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:43.207287 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 213/424] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:43.211026 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6eb2-e964-49f6-91e2-85fa035d8ee5 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:43.211308 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6eb2-e964-49f6-91e2-85fa035d8ee5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:43.211582 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6eb2-e964-49f6-91e2-85fa035d8ee5 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:43.213491 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 212/425] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:43.219631 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceb163-4674-440b-ae6a-28628abf6cf8 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:43.219913 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceb163-4674-440b-ae6a-28628abf6cf8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:43.220196 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceb163-4674-440b-ae6a-28628abf6cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:43.240678 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d6eb2-e964-49f6-91e2-85fa035d8ee5 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:43.241815 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-27ceb163-4674-440b-ae6a-28628abf6cf8 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:43.243027 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-27ceb163-4674-440b-ae6a-28628abf6cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:43.253892 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 214/426] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:43.256943 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d6eb2-e964-49f6-91e2-85fa035d8ee5 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:43.262314 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1646f65-398c-41fc-8fd1-24a8db8341d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:43.263237 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1646f65-398c-41fc-8fd1-24a8db8341d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:43.263513 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1646f65-398c-41fc-8fd1-24a8db8341d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:43.263835 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1646f65-398c-41fc-8fd1-24a8db8341d8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:43.275903 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1646f65-398c-41fc-8fd1-24a8db8341d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:43.280925 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ceb163-4674-440b-ae6a-28628abf6cf8 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:43.287292 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-a1646f65-398c-41fc-8fd1-24a8db8341d8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 05:20:43.289070 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 213/427] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:43.290718 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ceb163-4674-440b-ae6a-28628abf6cf8 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:43.296055 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a554a0-68f6-4989-8f57-211802e3e7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:43.296894 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a554a0-68f6-4989-8f57-211802e3e7bc admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:43.297176 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a554a0-68f6-4989-8f57-211802e3e7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:43.297477 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a554a0-68f6-4989-8f57-211802e3e7bc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:43.297646 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1646f65-398c-41fc-8fd1-24a8db8341d8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:43.312781 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a554a0-68f6-4989-8f57-211802e3e7bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:43.313085 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1646f65-398c-41fc-8fd1-24a8db8341d8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:43.319302 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-62a554a0-68f6-4989-8f57-211802e3e7bc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 16 05:20:43.320316 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5363f-27e4-41c1-955c-8c6fd3f1b11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:43.320892 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 215/428] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:43.321610 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5363f-27e4-41c1-955c-8c6fd3f1b11b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:43.322113 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5363f-27e4-41c1-955c-8c6fd3f1b11b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:43.322619 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5363f-27e4-41c1-955c-8c6fd3f1b11b admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:43.323618 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5363f-27e4-41c1-955c-8c6fd3f1b11b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:43.324123 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5363f-27e4-41c1-955c-8c6fd3f1b11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:43.326295 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5363f-27e4-41c1-955c-8c6fd3f1b11b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:43.326406 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a554a0-68f6-4989-8f57-211802e3e7bc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:43.337331 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a554a0-68f6-4989-8f57-211802e3e7bc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:43.340190 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 214/429] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:43.343884 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5363f-27e4-41c1-955c-8c6fd3f1b11b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:43.351265 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe426b-e3e5-41c1-9a1d-5770883945ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:43.352342 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe426b-e3e5-41c1-9a1d-5770883945ff admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:43.353505 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe426b-e3e5-41c1-9a1d-5770883945ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:43.354004 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe426b-e3e5-41c1-9a1d-5770883945ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:43.355981 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe426b-e3e5-41c1-9a1d-5770883945ff admin admin] RBAC: Adding query filter params (name=member) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:43.356605 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe426b-e3e5-41c1-9a1d-5770883945ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:43.358506 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe426b-e3e5-41c1-9a1d-5770883945ff admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:43.359098 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5363f-27e4-41c1-955c-8c6fd3f1b11b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:43.369453 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fbf9c-a7cc-4b62-9106-57f7f2f1a3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:43.370101 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fbf9c-a7cc-4b62-9106-57f7f2f1a3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:43.370477 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fbf9c-a7cc-4b62-9106-57f7f2f1a3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:43.371185 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8fbf9c-a7cc-4b62-9106-57f7f2f1a3d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:43.371647 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 216/430] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:20:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:43.376430 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe426b-e3e5-41c1-9a1d-5770883945ff admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:43.383528 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8fbf9c-a7cc-4b62-9106-57f7f2f1a3d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:43.385741 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8fbf9c-a7cc-4b62-9106-57f7f2f1a3d6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:43.393053 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe426b-e3e5-41c1-9a1d-5770883945ff admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:43.397800 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee94309-604f-44bf-897c-08614dfa1e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:43.398495 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee94309-604f-44bf-897c-08614dfa1e5e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:43.398878 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee94309-604f-44bf-897c-08614dfa1e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:43.399102 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee94309-604f-44bf-897c-08614dfa1e5e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:43.399198 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 215/431] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:43.403805 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fbf9c-a7cc-4b62-9106-57f7f2f1a3d6 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:43.411821 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee94309-604f-44bf-897c-08614dfa1e5e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:43.413086 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8fbf9c-a7cc-4b62-9106-57f7f2f1a3d6 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:43.413714 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee94309-604f-44bf-897c-08614dfa1e5e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:43.418127 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3957dd-c6ba-42ba-9fcd-39ad0d7566c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:43.419677 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3957dd-c6ba-42ba-9fcd-39ad0d7566c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:43.420178 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3957dd-c6ba-42ba-9fcd-39ad0d7566c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:43.420654 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3957dd-c6ba-42ba-9fcd-39ad0d7566c6 admin admin] PATH_INFO: `/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:43.422098 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3957dd-c6ba-42ba-9fcd-39ad0d7566c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=a04bbe2fdd09464e83b9c4e39549e8ad)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:43.424372 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3957dd-c6ba-42ba-9fcd-39ad0d7566c6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:43.426411 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 216/432] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:43 2022] GET /identity/v3/projects/a04bbe2fdd09464e83b9c4e39549e8ad => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:43.429351 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 217/433] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 05:20:43.433837 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3957dd-c6ba-42ba-9fcd-39ad0d7566c6 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:43.436337 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee94309-604f-44bf-897c-08614dfa1e5e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:43.446221 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3957dd-c6ba-42ba-9fcd-39ad0d7566c6 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:43.447542 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee94309-604f-44bf-897c-08614dfa1e5e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:43.452448 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40d182-6832-4d20-a25a-272bb2117b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:43.452781 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdbe8d-d6a0-4da6-990e-c77cb6ec52ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:43.454501 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdbe8d-d6a0-4da6-990e-c77cb6ec52ec admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:43.454501 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdbe8d-d6a0-4da6-990e-c77cb6ec52ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:43.454501 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cdbe8d-d6a0-4da6-990e-c77cb6ec52ec admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:43.455133 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40d182-6832-4d20-a25a-272bb2117b0e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:43.455631 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40d182-6832-4d20-a25a-272bb2117b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:43.456031 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdbe8d-d6a0-4da6-990e-c77cb6ec52ec admin admin] RBAC: Authorizing `identity:get_project(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:43.456300 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40d182-6832-4d20-a25a-272bb2117b0e admin admin] PATH_INFO: `/v3/groups/d966599a0b324538bcd070faebf51e35` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:43.457755 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40d182-6832-4d20-a25a-272bb2117b0e admin admin] RBAC: Authorizing `identity:get_group(group_id=d966599a0b324538bcd070faebf51e35)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:43.458236 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cdbe8d-d6a0-4da6-990e-c77cb6ec52ec admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:43.460047 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 218/434] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:43 2022] GET /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:43.460389 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40d182-6832-4d20-a25a-272bb2117b0e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:43.466301 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 217/435] 10.222.0.75 () {56 vars in 1201 bytes} [Wed Feb 16 05:20:43 2022] GET /identity/v3/groups/d966599a0b324538bcd070faebf51e35 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:43.469492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdbe8d-d6a0-4da6-990e-c77cb6ec52ec admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:43.473234 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40d182-6832-4d20-a25a-272bb2117b0e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:43.484205 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40d182-6832-4d20-a25a-272bb2117b0e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:43.488302 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cdbe8d-d6a0-4da6-990e-c77cb6ec52ec admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:43.488833 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57892b99-1978-48b7-b331-3ee8fd5a6052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:43.489859 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57892b99-1978-48b7-b331-3ee8fd5a6052 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:43.490140 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57892b99-1978-48b7-b331-3ee8fd5a6052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:43.490460 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57892b99-1978-48b7-b331-3ee8fd5a6052 admin admin] PATH_INFO: `/v3/groups/d966599a0b324538bcd070faebf51e35` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:43.491635 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57892b99-1978-48b7-b331-3ee8fd5a6052 admin admin] RBAC: Authorizing `identity:get_group(group_id=d966599a0b324538bcd070faebf51e35)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:43.493699 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57892b99-1978-48b7-b331-3ee8fd5a6052 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:43.494584 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785d271-c906-4c43-8e88-ceb619dd660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:43.495457 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785d271-c906-4c43-8e88-ceb619dd660d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:43.500213 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 218/436] 10.222.0.75 () {56 vars in 1201 bytes} [Wed Feb 16 05:20:43 2022] GET /identity/v3/groups/d966599a0b324538bcd070faebf51e35 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:43.500338 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785d271-c906-4c43-8e88-ceb619dd660d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:43.500338 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785d271-c906-4c43-8e88-ceb619dd660d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:43.500338 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785d271-c906-4c43-8e88-ceb619dd660d admin admin] RBAC: Adding query filter params (group.id=d966599a0b324538bcd070faebf51e35, role.id=3bbfe5a5163345b2b0d0cee3ea713919, scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:43.500338 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785d271-c906-4c43-8e88-ceb619dd660d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:43.501920 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57892b99-1978-48b7-b331-3ee8fd5a6052 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:43.502485 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785d271-c906-4c43-8e88-ceb619dd660d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:43.510590 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 219/437] 10.222.0.75 () {56 vars in 1397 bytes} [Wed Feb 16 05:20:43 2022] GET /identity/v3/role_assignments?group.id=d966599a0b324538bcd070faebf51e35&scope.project.id=a04bbe2fdd09464e83b9c4e39549e8ad&role.id=3bbfe5a5163345b2b0d0cee3ea713919 => generated 611 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:43.514400 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57892b99-1978-48b7-b331-3ee8fd5a6052 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:43.519576 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f2214-d1ba-413c-a0ff-0c062dbc92be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:43.520294 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f2214-d1ba-413c-a0ff-0c062dbc92be admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:43.520569 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f2214-d1ba-413c-a0ff-0c062dbc92be admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:43.520891 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f2214-d1ba-413c-a0ff-0c062dbc92be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:43.521884 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f2214-d1ba-413c-a0ff-0c062dbc92be admin admin] RBAC: Adding query filter params (group.id=d966599a0b324538bcd070faebf51e35, role.id=3bbfe5a5163345b2b0d0cee3ea713919, scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:43.522192 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f2214-d1ba-413c-a0ff-0c062dbc92be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:43.524274 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f2214-d1ba-413c-a0ff-0c062dbc92be admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:43.532253 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 219/438] 10.222.0.75 () {56 vars in 1397 bytes} [Wed Feb 16 05:20:43 2022] GET /identity/v3/role_assignments?group.id=d966599a0b324538bcd070faebf51e35&scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6&role.id=3bbfe5a5163345b2b0d0cee3ea713919 => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:44.586522 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c5ff5-569c-475b-879b-47305b0477a1 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:44.587042 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c5ff5-569c-475b-879b-47305b0477a1 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:44.587042 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c5ff5-569c-475b-879b-47305b0477a1 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:44.588821 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 220/439] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:44.594063 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba67e3-f82d-471f-8d4c-0598b7873f1a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:44.594443 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba67e3-f82d-471f-8d4c-0598b7873f1a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:44.594604 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba67e3-f82d-471f-8d4c-0598b7873f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:44.612565 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-0bba67e3-f82d-471f-8d4c-0598b7873f1a None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:44.613774 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0bba67e3-f82d-471f-8d4c-0598b7873f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:44.621958 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 220/440] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:44.645983 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c5ff5-569c-475b-879b-47305b0477a1 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:44.657748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c5ff5-569c-475b-879b-47305b0477a1 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:44.661812 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdbcb8-100e-48e1-a56c-fc9577d6e818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:44.662584 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdbcb8-100e-48e1-a56c-fc9577d6e818 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:44.662857 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdbcb8-100e-48e1-a56c-fc9577d6e818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:44.663122 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdbcb8-100e-48e1-a56c-fc9577d6e818 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:44.674101 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafdbcb8-100e-48e1-a56c-fc9577d6e818 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:44.681236 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-cafdbcb8-100e-48e1-a56c-fc9577d6e818 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 05:20:44.682698 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 221/441] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Feb 16 05:20:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:44.688944 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba67e3-f82d-471f-8d4c-0598b7873f1a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:44.697733 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba67e3-f82d-471f-8d4c-0598b7873f1a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:44.702574 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e77aa-df6d-4b77-b3fe-8d271fe0764d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:44.703233 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e77aa-df6d-4b77-b3fe-8d271fe0764d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:44.703509 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e77aa-df6d-4b77-b3fe-8d271fe0764d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:44.703778 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e77aa-df6d-4b77-b3fe-8d271fe0764d admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:44.704510 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e77aa-df6d-4b77-b3fe-8d271fe0764d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:44.704807 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e77aa-df6d-4b77-b3fe-8d271fe0764d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:44.706425 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e77aa-df6d-4b77-b3fe-8d271fe0764d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:44.714951 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 221/442] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:44.719981 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdbcb8-100e-48e1-a56c-fc9577d6e818 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:44.730067 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdbcb8-100e-48e1-a56c-fc9577d6e818 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:44.734298 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace08be-efef-4c97-b04a-b912204f82f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:44.734910 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace08be-efef-4c97-b04a-b912204f82f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:44.735187 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace08be-efef-4c97-b04a-b912204f82f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:44.735449 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace08be-efef-4c97-b04a-b912204f82f4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:44.743097 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace08be-efef-4c97-b04a-b912204f82f4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:44.744833 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ace08be-efef-4c97-b04a-b912204f82f4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:44.753796 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 222/443] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:44.759108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e77aa-df6d-4b77-b3fe-8d271fe0764d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:44.769088 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e77aa-df6d-4b77-b3fe-8d271fe0764d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:44.773328 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec721691-10c0-4c4c-a1e2-64307bc1024e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:44.774144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec721691-10c0-4c4c-a1e2-64307bc1024e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:44.774421 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec721691-10c0-4c4c-a1e2-64307bc1024e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:44.774688 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec721691-10c0-4c4c-a1e2-64307bc1024e admin admin] PATH_INFO: `/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:44.775840 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec721691-10c0-4c4c-a1e2-64307bc1024e admin admin] RBAC: Authorizing `identity:get_project(project_id=aa2bf2f9b4e84d3b9b6409c5ba0984a6)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:44.777928 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec721691-10c0-4c4c-a1e2-64307bc1024e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:44.779528 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 222/444] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:44 2022] GET /identity/v3/projects/aa2bf2f9b4e84d3b9b6409c5ba0984a6 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:44.784614 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace08be-efef-4c97-b04a-b912204f82f4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:44.793121 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace08be-efef-4c97-b04a-b912204f82f4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:44.797342 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80264b30-c0fe-415e-b7eb-196e3c856f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:44.798149 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80264b30-c0fe-415e-b7eb-196e3c856f6d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:44.798424 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80264b30-c0fe-415e-b7eb-196e3c856f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:44.798687 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80264b30-c0fe-415e-b7eb-196e3c856f6d admin admin] PATH_INFO: `/v3/groups/d966599a0b324538bcd070faebf51e35` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:44.799828 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80264b30-c0fe-415e-b7eb-196e3c856f6d admin admin] RBAC: Authorizing `identity:get_group(group_id=d966599a0b324538bcd070faebf51e35)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:44.801720 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80264b30-c0fe-415e-b7eb-196e3c856f6d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:44.803277 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 223/445] 10.222.0.75 () {56 vars in 1201 bytes} [Wed Feb 16 05:20:44 2022] GET /identity/v3/groups/d966599a0b324538bcd070faebf51e35 => generated 226 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:44.809376 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec721691-10c0-4c4c-a1e2-64307bc1024e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:44.818593 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec721691-10c0-4c4c-a1e2-64307bc1024e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:44.822851 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29414e17-7cc1-45e1-be5a-4ea764d0a3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:44.823460 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29414e17-7cc1-45e1-be5a-4ea764d0a3db admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:44.824356 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29414e17-7cc1-45e1-be5a-4ea764d0a3db admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:44.824627 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29414e17-7cc1-45e1-be5a-4ea764d0a3db admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:44.825469 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29414e17-7cc1-45e1-be5a-4ea764d0a3db admin admin] RBAC: Adding query filter params (group.id=d966599a0b324538bcd070faebf51e35, role.id=997c650af0d54f31940fbb188fe4172c, scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:44.825774 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29414e17-7cc1-45e1-be5a-4ea764d0a3db admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:44.827614 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29414e17-7cc1-45e1-be5a-4ea764d0a3db admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:44.833531 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 223/446] 10.222.0.75 () {56 vars in 1397 bytes} [Wed Feb 16 05:20:44 2022] GET /identity/v3/role_assignments?group.id=d966599a0b324538bcd070faebf51e35&scope.project.id=aa2bf2f9b4e84d3b9b6409c5ba0984a6&role.id=997c650af0d54f31940fbb188fe4172c => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:44.983758 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb6468-b91b-4307-8a19-59cbb15009a7 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:44.984036 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb6468-b91b-4307-8a19-59cbb15009a7 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:44.984328 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb6468-b91b-4307-8a19-59cbb15009a7 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:44.986157 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 224/447] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:44.991882 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8786c9c-80e1-4463-9c57-bd8a230b8a6e None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:44.992168 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8786c9c-80e1-4463-9c57-bd8a230b8a6e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:44.992442 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8786c9c-80e1-4463-9c57-bd8a230b8a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:45.010702 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c8786c9c-80e1-4463-9c57-bd8a230b8a6e None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:45.012454 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c8786c9c-80e1-4463-9c57-bd8a230b8a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:45.019948 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 224/448] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:45.044828 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb6468-b91b-4307-8a19-59cbb15009a7 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:45.058051 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb6468-b91b-4307-8a19-59cbb15009a7 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:45.062426 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd15e6-fff6-4bab-83c8-6b24f32344e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:45.063199 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd15e6-fff6-4bab-83c8-6b24f32344e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:45.063475 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd15e6-fff6-4bab-83c8-6b24f32344e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:45.063742 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd15e6-fff6-4bab-83c8-6b24f32344e2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:45.074313 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd15e6-fff6-4bab-83c8-6b24f32344e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:45.081110 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-40dd15e6-fff6-4bab-83c8-6b24f32344e2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:20:45.082317 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 225/449] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:20:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:45.087999 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8786c9c-80e1-4463-9c57-bd8a230b8a6e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:45.097463 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8786c9c-80e1-4463-9c57-bd8a230b8a6e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:45.101849 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c883d-0f63-47b2-aedd-28bfba2fc10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:45.102487 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c883d-0f63-47b2-aedd-28bfba2fc10a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:45.102764 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c883d-0f63-47b2-aedd-28bfba2fc10a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:45.103031 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c883d-0f63-47b2-aedd-28bfba2fc10a admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:45.103805 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c883d-0f63-47b2-aedd-28bfba2fc10a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:45.104104 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c883d-0f63-47b2-aedd-28bfba2fc10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:45.105814 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c883d-0f63-47b2-aedd-28bfba2fc10a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:45.114050 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 225/450] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:45.119462 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd15e6-fff6-4bab-83c8-6b24f32344e2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:45.129164 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd15e6-fff6-4bab-83c8-6b24f32344e2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:45.133421 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747b158-a6ea-47e8-bfe2-7edfd32f1426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:45.134036 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747b158-a6ea-47e8-bfe2-7edfd32f1426 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:45.134313 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747b158-a6ea-47e8-bfe2-7edfd32f1426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:45.134573 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747b158-a6ea-47e8-bfe2-7edfd32f1426 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:45.143371 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747b158-a6ea-47e8-bfe2-7edfd32f1426 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:45.145099 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747b158-a6ea-47e8-bfe2-7edfd32f1426 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:45.154620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 226/451] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:45.160201 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c883d-0f63-47b2-aedd-28bfba2fc10a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:45.169999 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c883d-0f63-47b2-aedd-28bfba2fc10a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:45.174420 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32773fbf-7b4f-4e67-a2b4-dcf28acf6795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:45.175261 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32773fbf-7b4f-4e67-a2b4-dcf28acf6795 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:45.175535 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32773fbf-7b4f-4e67-a2b4-dcf28acf6795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:45.175800 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32773fbf-7b4f-4e67-a2b4-dcf28acf6795 admin admin] PATH_INFO: `/v3/projects/b93c4f51f61141d6b4554752db1f615b` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:45.177044 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32773fbf-7b4f-4e67-a2b4-dcf28acf6795 admin admin] RBAC: Authorizing `identity:get_project(project_id=b93c4f51f61141d6b4554752db1f615b)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:45.178907 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32773fbf-7b4f-4e67-a2b4-dcf28acf6795 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:45.180576 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 226/452] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:20:45 2022] GET /identity/v3/projects/b93c4f51f61141d6b4554752db1f615b => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:45.186440 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747b158-a6ea-47e8-bfe2-7edfd32f1426 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:45.195358 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747b158-a6ea-47e8-bfe2-7edfd32f1426 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:45.200278 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e02203-c2bf-4030-89f2-a50b3f18073b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:45.201093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e02203-c2bf-4030-89f2-a50b3f18073b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:45.201404 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e02203-c2bf-4030-89f2-a50b3f18073b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:45.201672 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e02203-c2bf-4030-89f2-a50b3f18073b admin admin] PATH_INFO: `/v3/groups/4a342ba79dae4793a5a6510ebe5008de` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:45.202816 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e02203-c2bf-4030-89f2-a50b3f18073b admin admin] RBAC: Authorizing `identity:get_group(group_id=4a342ba79dae4793a5a6510ebe5008de)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:45.204684 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e02203-c2bf-4030-89f2-a50b3f18073b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:45.206254 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 227/453] 10.222.0.75 () {56 vars in 1201 bytes} [Wed Feb 16 05:20:45 2022] GET /identity/v3/groups/4a342ba79dae4793a5a6510ebe5008de => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:45.211871 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32773fbf-7b4f-4e67-a2b4-dcf28acf6795 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:45.221887 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32773fbf-7b4f-4e67-a2b4-dcf28acf6795 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:45.226110 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a0aa1-82b1-416b-8d5f-daaa11a67051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:45.226721 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a0aa1-82b1-416b-8d5f-daaa11a67051 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:45.226996 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a0aa1-82b1-416b-8d5f-daaa11a67051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:45.227262 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a0aa1-82b1-416b-8d5f-daaa11a67051 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:45.228072 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a0aa1-82b1-416b-8d5f-daaa11a67051 admin admin] RBAC: Adding query filter params (group.id=4a342ba79dae4793a5a6510ebe5008de, role.id=9ba4a5967ed243178927661616f08901, scope.project.id=b93c4f51f61141d6b4554752db1f615b) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:45.228381 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a0aa1-82b1-416b-8d5f-daaa11a67051 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:45.230305 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a0aa1-82b1-416b-8d5f-daaa11a67051 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:45.235849 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 227/454] 10.222.0.75 () {56 vars in 1397 bytes} [Wed Feb 16 05:20:45 2022] GET /identity/v3/role_assignments?group.id=4a342ba79dae4793a5a6510ebe5008de&scope.project.id=b93c4f51f61141d6b4554752db1f615b&role.id=9ba4a5967ed243178927661616f08901 => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:48.098565 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade30533-8512-433c-9857-4184363ea52c None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:48.099083 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade30533-8512-433c-9857-4184363ea52c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:48.099165 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade30533-8512-433c-9857-4184363ea52c None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:48.101159 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 228/455] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:48.107277 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8470864-f333-4eb4-881a-0506e844956a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:48.107735 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8470864-f333-4eb4-881a-0506e844956a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:48.107811 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8470864-f333-4eb4-881a-0506e844956a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:48.133335 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-d8470864-f333-4eb4-881a-0506e844956a None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:48.134524 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d8470864-f333-4eb4-881a-0506e844956a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:48.142596 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 228/456] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:48.168146 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade30533-8512-433c-9857-4184363ea52c None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:48.181126 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade30533-8512-433c-9857-4184363ea52c None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:48.186357 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41217a49-72d3-4cf3-8033-c3d02412f2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:48.187133 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41217a49-72d3-4cf3-8033-c3d02412f2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:48.187412 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41217a49-72d3-4cf3-8033-c3d02412f2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:48.187685 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41217a49-72d3-4cf3-8033-c3d02412f2f6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:48.198336 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41217a49-72d3-4cf3-8033-c3d02412f2f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:48.200269 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41217a49-72d3-4cf3-8033-c3d02412f2f6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:48.217851 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-41217a49-72d3-4cf3-8033-c3d02412f2f6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:48.219393 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 229/457] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:48.225047 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8470864-f333-4eb4-881a-0506e844956a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:48.235052 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8470864-f333-4eb4-881a-0506e844956a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:48.242409 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10bec4-02ba-4b9a-ae4e-ec14250c4dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:48.243096 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10bec4-02ba-4b9a-ae4e-ec14250c4dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:48.243375 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10bec4-02ba-4b9a-ae4e-ec14250c4dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:48.243650 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10bec4-02ba-4b9a-ae4e-ec14250c4dc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:48.244406 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10bec4-02ba-4b9a-ae4e-ec14250c4dc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:48.244714 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10bec4-02ba-4b9a-ae4e-ec14250c4dc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:48.246994 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10bec4-02ba-4b9a-ae4e-ec14250c4dc2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:48.264770 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 229/458] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:48.270367 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41217a49-72d3-4cf3-8033-c3d02412f2f6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:48.282020 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41217a49-72d3-4cf3-8033-c3d02412f2f6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:48.293901 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6199c-66a3-4e0d-83f2-ce0117d59506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:48.294587 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6199c-66a3-4e0d-83f2-ce0117d59506 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:48.294871 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6199c-66a3-4e0d-83f2-ce0117d59506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:48.295153 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6199c-66a3-4e0d-83f2-ce0117d59506 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:48.295899 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6199c-66a3-4e0d-83f2-ce0117d59506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:48.297916 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6199c-66a3-4e0d-83f2-ce0117d59506 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:48.334436 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 230/459] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Feb 16 05:20:48 2022] POST /identity/v3/users => generated 248 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:20:48.425377 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de6160-84e6-423c-8f91-b5c123a4a53b None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:48.425692 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de6160-84e6-423c-8f91-b5c123a4a53b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:48.425895 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de6160-84e6-423c-8f91-b5c123a4a53b None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:48.428047 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 230/460] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:48.433738 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c63720-eabf-4c48-96ab-641dce8dfe16 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:48.434150 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c63720-eabf-4c48-96ab-641dce8dfe16 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:48.434363 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c63720-eabf-4c48-96ab-641dce8dfe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:48.458042 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33c496-4bd1-48fb-a793-d7628f552207 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:48.458375 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33c496-4bd1-48fb-a793-d7628f552207 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:48.458661 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e33c496-4bd1-48fb-a793-d7628f552207 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:48.460443 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 231/461] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:48.461617 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-27c63720-eabf-4c48-96ab-641dce8dfe16 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:48.462860 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-27c63720-eabf-4c48-96ab-641dce8dfe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:48.471015 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e65a7-3b00-485b-8567-7315fe889f88 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:48.471625 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e65a7-3b00-485b-8567-7315fe889f88 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:48.472108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e65a7-3b00-485b-8567-7315fe889f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:48.475806 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 231/462] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:48.502003 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c63720-eabf-4c48-96ab-641dce8dfe16 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:48.503010 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ab3e65a7-3b00-485b-8567-7315fe889f88 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:48.504441 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ab3e65a7-3b00-485b-8567-7315fe889f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:48.511732 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c63720-eabf-4c48-96ab-641dce8dfe16 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:48.517067 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a083672-e29b-4e3f-a8bb-48389d933afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:48.518076 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a083672-e29b-4e3f-a8bb-48389d933afd admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:48.518368 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a083672-e29b-4e3f-a8bb-48389d933afd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:48.518636 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a083672-e29b-4e3f-a8bb-48389d933afd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:48.520279 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 232/463] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:48.538474 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a083672-e29b-4e3f-a8bb-48389d933afd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:48.540384 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a083672-e29b-4e3f-a8bb-48389d933afd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:48.559513 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-6a083672-e29b-4e3f-a8bb-48389d933afd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:48.561053 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 232/464] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:48.566761 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e65a7-3b00-485b-8567-7315fe889f88 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:48.576908 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e65a7-3b00-485b-8567-7315fe889f88 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:48.581045 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a083672-e29b-4e3f-a8bb-48389d933afd admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:48.582534 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf466a41-dbc0-4b59-b4dd-fe6c7eeae99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:48.583351 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf466a41-dbc0-4b59-b4dd-fe6c7eeae99c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:48.583772 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf466a41-dbc0-4b59-b4dd-fe6c7eeae99c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:48.584203 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf466a41-dbc0-4b59-b4dd-fe6c7eeae99c admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:48.585070 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf466a41-dbc0-4b59-b4dd-fe6c7eeae99c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:48.585549 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf466a41-dbc0-4b59-b4dd-fe6c7eeae99c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:48.587381 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf466a41-dbc0-4b59-b4dd-fe6c7eeae99c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:48.591806 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a083672-e29b-4e3f-a8bb-48389d933afd admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:48.595836 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea115568-6f4a-427e-8ef1-fae09cc4b873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:48.596688 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea115568-6f4a-427e-8ef1-fae09cc4b873 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:48.597043 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea115568-6f4a-427e-8ef1-fae09cc4b873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:48.597433 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea115568-6f4a-427e-8ef1-fae09cc4b873 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:48.608812 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 233/465] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:48.613521 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea115568-6f4a-427e-8ef1-fae09cc4b873 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:48.613521 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea115568-6f4a-427e-8ef1-fae09cc4b873 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:48.615003 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf466a41-dbc0-4b59-b4dd-fe6c7eeae99c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:48.628294 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf466a41-dbc0-4b59-b4dd-fe6c7eeae99c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:48.632998 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-ea115568-6f4a-427e-8ef1-fae09cc4b873 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:48.635025 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 233/466] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:48.638334 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb059b53-e97a-4993-a82b-f527da231a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:48.639015 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb059b53-e97a-4993-a82b-f527da231a0a admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:48.639296 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb059b53-e97a-4993-a82b-f527da231a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:48.639568 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb059b53-e97a-4993-a82b-f527da231a0a admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:48.640288 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb059b53-e97a-4993-a82b-f527da231a0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:48.643184 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea115568-6f4a-427e-8ef1-fae09cc4b873 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:48.644108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb059b53-e97a-4993-a82b-f527da231a0a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:48.653759 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea115568-6f4a-427e-8ef1-fae09cc4b873 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:48.659675 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b66d88-4da9-4b3e-b679-2439edfb2aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:48.660315 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b66d88-4da9-4b3e-b679-2439edfb2aaa admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:48.660939 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b66d88-4da9-4b3e-b679-2439edfb2aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:48.661925 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b66d88-4da9-4b3e-b679-2439edfb2aaa admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:48.663061 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b66d88-4da9-4b3e-b679-2439edfb2aaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:48.663785 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b66d88-4da9-4b3e-b679-2439edfb2aaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:48.665129 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-a3b66d88-4da9-4b3e-b679-2439edfb2aaa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:20:48.665129 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Feb 16 05:20:48.665129 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: Feb 16 05:20:48.667557 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b66d88-4da9-4b3e-b679-2439edfb2aaa admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:48.679984 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 234/467] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Feb 16 05:20:48 2022] POST /identity/v3/users => generated 248 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:20:48.688880 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 234/468] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:48.698752 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb059b53-e97a-4993-a82b-f527da231a0a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:48.711148 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb059b53-e97a-4993-a82b-f527da231a0a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:48.718608 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c78ab-628f-4616-aca7-8d54cb6efdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:48.719323 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c78ab-628f-4616-aca7-8d54cb6efdbe admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:48.719573 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c78ab-628f-4616-aca7-8d54cb6efdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:48.719844 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c78ab-628f-4616-aca7-8d54cb6efdbe admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:48.720560 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c78ab-628f-4616-aca7-8d54cb6efdbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:48.722632 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70c78ab-628f-4616-aca7-8d54cb6efdbe admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:48.765621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 235/469] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Feb 16 05:20:48 2022] POST /identity/v3/users => generated 246 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:20:48.823178 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b751a6-a249-4ef9-a3a8-d8937a946046 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:48.823507 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b751a6-a249-4ef9-a3a8-d8937a946046 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:48.823726 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b751a6-a249-4ef9-a3a8-d8937a946046 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:48.826373 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 235/470] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:48.832173 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e3e41-9f87-4cf0-a6f9-26d8fa53fadd None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:48.832801 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e3e41-9f87-4cf0-a6f9-26d8fa53fadd None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:48.833330 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e3e41-9f87-4cf0-a6f9-26d8fa53fadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:48.857514 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-510e3e41-9f87-4cf0-a6f9-26d8fa53fadd None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:48.859139 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-510e3e41-9f87-4cf0-a6f9-26d8fa53fadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:48.868229 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 236/471] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:48.894266 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b751a6-a249-4ef9-a3a8-d8937a946046 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:48.909454 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b751a6-a249-4ef9-a3a8-d8937a946046 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:48.915713 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e3611-fbbc-4784-8328-891b3ecb5842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:48.916518 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e3611-fbbc-4784-8328-891b3ecb5842 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:48.916800 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e3611-fbbc-4784-8328-891b3ecb5842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:48.917072 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e3611-fbbc-4784-8328-891b3ecb5842 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:48.929439 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e3611-fbbc-4784-8328-891b3ecb5842 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:48.931655 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e3611-fbbc-4784-8328-891b3ecb5842 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:48.951181 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-f89e3611-fbbc-4784-8328-891b3ecb5842 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:48.952778 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 236/472] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:48.958353 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e3e41-9f87-4cf0-a6f9-26d8fa53fadd None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:48.972821 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e3e41-9f87-4cf0-a6f9-26d8fa53fadd None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:48.978793 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520a7a1-1de4-4bf3-8f69-c0c80c628f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:48.979786 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520a7a1-1de4-4bf3-8f69-c0c80c628f72 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:48.980266 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520a7a1-1de4-4bf3-8f69-c0c80c628f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:48.980795 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520a7a1-1de4-4bf3-8f69-c0c80c628f72 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:48.981772 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520a7a1-1de4-4bf3-8f69-c0c80c628f72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:48.982302 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520a7a1-1de4-4bf3-8f69-c0c80c628f72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:48.984199 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520a7a1-1de4-4bf3-8f69-c0c80c628f72 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:48.998101 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 237/473] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:49.003267 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e3611-fbbc-4784-8328-891b3ecb5842 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:49.015974 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e3611-fbbc-4784-8328-891b3ecb5842 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:49.024017 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d3ee0-e24a-452c-88eb-82e8d3c0d883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:49.024711 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d3ee0-e24a-452c-88eb-82e8d3c0d883 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:49.024994 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d3ee0-e24a-452c-88eb-82e8d3c0d883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:49.025303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d3ee0-e24a-452c-88eb-82e8d3c0d883 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:49.026063 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d3ee0-e24a-452c-88eb-82e8d3c0d883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:49.028599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d3ee0-e24a-452c-88eb-82e8d3c0d883 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:49.051660 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 237/474] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Feb 16 05:20:49 2022] POST /identity/v3/users => generated 249 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:20:49.570010 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6efb58-0202-4e40-9faf-21af314acd26 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:49.570506 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6efb58-0202-4e40-9faf-21af314acd26 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:49.570604 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6efb58-0202-4e40-9faf-21af314acd26 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:49.572432 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 238/475] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:49.578400 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fef03-818e-4c47-bc20-9694026476b5 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:49.579205 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fef03-818e-4c47-bc20-9694026476b5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:49.579683 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fef03-818e-4c47-bc20-9694026476b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:49.599570 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-670fef03-818e-4c47-bc20-9694026476b5 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:49.601351 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-670fef03-818e-4c47-bc20-9694026476b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:49.610980 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 238/476] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:49.634380 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6efb58-0202-4e40-9faf-21af314acd26 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:49.647552 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6efb58-0202-4e40-9faf-21af314acd26 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:49.652182 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3555f-8e54-4000-9e55-232e1eedce40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:49.653659 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3555f-8e54-4000-9e55-232e1eedce40 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:49.654166 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3555f-8e54-4000-9e55-232e1eedce40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:49.654642 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3555f-8e54-4000-9e55-232e1eedce40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:49.655624 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3555f-8e54-4000-9e55-232e1eedce40 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:49.657465 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3555f-8e54-4000-9e55-232e1eedce40 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:49.665677 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.sql.core [None req-eed3555f-8e54-4000-9e55-232e1eedce40 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 16 05:20:49.665677 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 16 05:20:49.665677 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [parameters: {'id': 'd0858a4ff7a94d228fa67efc30726ae4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 16 05:20:49.665677 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79197) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 16 05:20:49.680640 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-eed3555f-8e54-4000-9e55-232e1eedce40 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 16 05:20:49.682824 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 239/477] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:20:49 2022] POST /identity/v3/roles => generated 144 bytes in 49 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:49.688728 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fef03-818e-4c47-bc20-9694026476b5 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:49.698249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fef03-818e-4c47-bc20-9694026476b5 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:49.704449 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32805f-7e8f-4aae-9267-390b63664e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:49.705586 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32805f-7e8f-4aae-9267-390b63664e14 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:49.706069 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32805f-7e8f-4aae-9267-390b63664e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:49.706569 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32805f-7e8f-4aae-9267-390b63664e14 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:49.726317 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32805f-7e8f-4aae-9267-390b63664e14 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:49.734523 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-fb32805f-7e8f-4aae-9267-390b63664e14 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 16 05:20:49.736050 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 239/478] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Feb 16 05:20:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:49.741964 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3555f-8e54-4000-9e55-232e1eedce40 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:49.754187 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3555f-8e54-4000-9e55-232e1eedce40 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:49.759131 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829a41c-b7ea-4395-a88c-3b25faff7a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:49.760063 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829a41c-b7ea-4395-a88c-3b25faff7a1c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:49.760646 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829a41c-b7ea-4395-a88c-3b25faff7a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:49.761121 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829a41c-b7ea-4395-a88c-3b25faff7a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:49.762162 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829a41c-b7ea-4395-a88c-3b25faff7a1c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:49.762669 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829a41c-b7ea-4395-a88c-3b25faff7a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:49.764526 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829a41c-b7ea-4395-a88c-3b25faff7a1c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:49.774195 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 240/479] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:51.534172 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e79f38-4d9f-48c1-a4d5-10f72278b54d None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:51.535268 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e79f38-4d9f-48c1-a4d5-10f72278b54d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:51.535754 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e79f38-4d9f-48c1-a4d5-10f72278b54d None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:51.538174 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 240/480] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:51.543255 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16946c7-2f12-44ae-af46-1d3c20cbe5f2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:51.544631 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16946c7-2f12-44ae-af46-1d3c20cbe5f2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:51.545400 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16946c7-2f12-44ae-af46-1d3c20cbe5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:51.574290 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f16946c7-2f12-44ae-af46-1d3c20cbe5f2 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:51.576440 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f16946c7-2f12-44ae-af46-1d3c20cbe5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:51.588713 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 241/481] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:51.618478 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5213e7e-487d-411a-9149-1555ec090457 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:51.619147 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5213e7e-487d-411a-9149-1555ec090457 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:51.619847 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5213e7e-487d-411a-9149-1555ec090457 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:51.622249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 241/482] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:51.623444 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16946c7-2f12-44ae-af46-1d3c20cbe5f2 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:51.627352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4bf49-a2fb-42e2-acbc-5f8ffdbfb4fa None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:51.627641 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4bf49-a2fb-42e2-acbc-5f8ffdbfb4fa None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:51.627917 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4bf49-a2fb-42e2-acbc-5f8ffdbfb4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:51.634143 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16946c7-2f12-44ae-af46-1d3c20cbe5f2 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:51.640013 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3960e5-1958-4c9c-b71c-9e7ebaa6264e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:51.641110 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3960e5-1958-4c9c-b71c-9e7ebaa6264e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:51.641622 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3960e5-1958-4c9c-b71c-9e7ebaa6264e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:51.642108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3960e5-1958-4c9c-b71c-9e7ebaa6264e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:51.655106 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3960e5-1958-4c9c-b71c-9e7ebaa6264e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:51.659109 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-33e4bf49-a2fb-42e2-acbc-5f8ffdbfb4fa None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:51.660358 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-33e4bf49-a2fb-42e2-acbc-5f8ffdbfb4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:51.663329 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-eb3960e5-1958-4c9c-b71c-9e7ebaa6264e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 05:20:51.664784 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 242/483] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:20:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:51.677174 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3960e5-1958-4c9c-b71c-9e7ebaa6264e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:51.679132 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 242/484] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:51.687955 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa35980-7338-4f47-ab8b-f8f1573069d2 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:51.688234 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa35980-7338-4f47-ab8b-f8f1573069d2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:51.688504 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa35980-7338-4f47-ab8b-f8f1573069d2 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:51.690634 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 243/485] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:51.695527 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3960e5-1958-4c9c-b71c-9e7ebaa6264e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:51.702170 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eda4b-f5e1-45d9-9b96-f1f13a5c1b12 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:51.702453 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eda4b-f5e1-45d9-9b96-f1f13a5c1b12 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:51.702730 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eda4b-f5e1-45d9-9b96-f1f13a5c1b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:51.704802 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5a020-7001-4a32-821a-dc7e2e06a8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:51.705552 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5a020-7001-4a32-821a-dc7e2e06a8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:51.705835 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5a020-7001-4a32-821a-dc7e2e06a8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:51.706104 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5a020-7001-4a32-821a-dc7e2e06a8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:51.706864 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5a020-7001-4a32-821a-dc7e2e06a8b4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:51.707166 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5a020-7001-4a32-821a-dc7e2e06a8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:51.708832 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5a020-7001-4a32-821a-dc7e2e06a8b4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:51.722596 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 243/486] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Feb 16 05:20:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:51.723478 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5a020-7001-4a32-821a-dc7e2e06a8b4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:51.726798 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-972eda4b-f5e1-45d9-9b96-f1f13a5c1b12 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:51.727999 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-972eda4b-f5e1-45d9-9b96-f1f13a5c1b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:51.733809 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5a020-7001-4a32-821a-dc7e2e06a8b4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:51.738353 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b042b9-210e-4450-a3a9-8cdc17fae24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:51.738484 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 244/487] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:51.739133 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b042b9-210e-4450-a3a9-8cdc17fae24c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:51.739371 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972eda4b-f5e1-45d9-9b96-f1f13a5c1b12 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:51.739474 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b042b9-210e-4450-a3a9-8cdc17fae24c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:51.739659 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b042b9-210e-4450-a3a9-8cdc17fae24c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:51.750984 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972eda4b-f5e1-45d9-9b96-f1f13a5c1b12 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:51.763012 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b042b9-210e-4450-a3a9-8cdc17fae24c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:51.765974 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0c2ec-839e-41d5-87bb-6fc771448fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:51.767015 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0c2ec-839e-41d5-87bb-6fc771448fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:51.767492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0c2ec-839e-41d5-87bb-6fc771448fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:51.767967 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0c2ec-839e-41d5-87bb-6fc771448fb7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:51.770054 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-81b042b9-210e-4450-a3a9-8cdc17fae24c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 05:20:51.771248 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 244/488] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:20:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:51.775858 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b042b9-210e-4450-a3a9-8cdc17fae24c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:51.785723 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0c2ec-839e-41d5-87bb-6fc771448fb7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:51.787156 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b042b9-210e-4450-a3a9-8cdc17fae24c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:51.787511 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0c2ec-839e-41d5-87bb-6fc771448fb7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:51.792262 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23947b-fde7-4f4f-a90d-14822c049e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:51.793852 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23947b-fde7-4f4f-a90d-14822c049e33 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:51.794334 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23947b-fde7-4f4f-a90d-14822c049e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:51.794800 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23947b-fde7-4f4f-a90d-14822c049e33 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:51.805712 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23947b-fde7-4f4f-a90d-14822c049e33 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:51.806989 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-77d0c2ec-839e-41d5-87bb-6fc771448fb7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:51.808239 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 245/489] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:51.809801 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0c2ec-839e-41d5-87bb-6fc771448fb7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:51.814486 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-6e23947b-fde7-4f4f-a90d-14822c049e33 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 05:20:51.815868 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 245/490] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:20:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:51.816808 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23947b-fde7-4f4f-a90d-14822c049e33 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:51.826797 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0c2ec-839e-41d5-87bb-6fc771448fb7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:51.831884 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23947b-fde7-4f4f-a90d-14822c049e33 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:51.834495 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afba5d8-947e-4cac-8de5-221e38a4bbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:51.836057 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afba5d8-947e-4cac-8de5-221e38a4bbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:51.836592 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afba5d8-947e-4cac-8de5-221e38a4bbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:51.837197 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afba5d8-947e-4cac-8de5-221e38a4bbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:51.837599 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1ae97-db29-45b7-add6-21d631c49e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:51.838179 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afba5d8-947e-4cac-8de5-221e38a4bbb3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:51.838552 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afba5d8-947e-4cac-8de5-221e38a4bbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:51.838799 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1ae97-db29-45b7-add6-21d631c49e7f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:51.839242 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1ae97-db29-45b7-add6-21d631c49e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:51.839692 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1ae97-db29-45b7-add6-21d631c49e7f admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:51.840443 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afba5d8-947e-4cac-8de5-221e38a4bbb3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:51.840800 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1ae97-db29-45b7-add6-21d631c49e7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:51.841298 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1ae97-db29-45b7-add6-21d631c49e7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:51.843075 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1ae97-db29-45b7-add6-21d631c49e7f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:51.851181 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 246/491] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Feb 16 05:20:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:51.852186 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afba5d8-947e-4cac-8de5-221e38a4bbb3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:51.861105 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 246/492] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:51.862054 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1ae97-db29-45b7-add6-21d631c49e7f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:51.863690 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afba5d8-947e-4cac-8de5-221e38a4bbb3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:51.869149 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02613d3-337a-437a-a1c9-8c6dbdc25a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:51.870241 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02613d3-337a-437a-a1c9-8c6dbdc25a1c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:51.870689 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02613d3-337a-437a-a1c9-8c6dbdc25a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:51.871113 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02613d3-337a-437a-a1c9-8c6dbdc25a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:51.872546 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02613d3-337a-437a-a1c9-8c6dbdc25a1c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:51.872831 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1ae97-db29-45b7-add6-21d631c49e7f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:51.873196 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02613d3-337a-437a-a1c9-8c6dbdc25a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:51.875251 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02613d3-337a-437a-a1c9-8c6dbdc25a1c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:51.877545 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457b969-dc86-44d3-b5e1-cbe2c1f38ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:51.878400 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457b969-dc86-44d3-b5e1-cbe2c1f38ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:51.878781 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457b969-dc86-44d3-b5e1-cbe2c1f38ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:51.879153 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457b969-dc86-44d3-b5e1-cbe2c1f38ae8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:51.884868 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 247/493] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Feb 16 05:20:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:51.886834 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02613d3-337a-437a-a1c9-8c6dbdc25a1c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:51.894319 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457b969-dc86-44d3-b5e1-cbe2c1f38ae8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:51.896405 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6457b969-dc86-44d3-b5e1-cbe2c1f38ae8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:51.900639 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02613d3-337a-437a-a1c9-8c6dbdc25a1c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:51.905599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc23c1-73a6-42e4-aa81-0936208b285b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:51.906485 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc23c1-73a6-42e4-aa81-0936208b285b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:51.906863 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc23c1-73a6-42e4-aa81-0936208b285b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:51.907232 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc23c1-73a6-42e4-aa81-0936208b285b admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:51.915130 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc23c1-73a6-42e4-aa81-0936208b285b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:51.915394 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-6457b969-dc86-44d3-b5e1-cbe2c1f38ae8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:51.917168 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 247/494] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:51.918692 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457b969-dc86-44d3-b5e1-cbe2c1f38ae8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:51.921440 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc23c1-73a6-42e4-aa81-0936208b285b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:51.932352 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457b969-dc86-44d3-b5e1-cbe2c1f38ae8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:51.938633 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67380e-e2f3-48cb-b77f-8c7a20d62bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:51.939504 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67380e-e2f3-48cb-b77f-8c7a20d62bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:51.939879 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67380e-e2f3-48cb-b77f-8c7a20d62bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:51.940251 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67380e-e2f3-48cb-b77f-8c7a20d62bd5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:51.941877 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-0ebc23c1-73a6-42e4-aa81-0936208b285b admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 16 05:20:51.944110 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 248/495] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:51.945152 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc23c1-73a6-42e4-aa81-0936208b285b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:51.951268 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67380e-e2f3-48cb-b77f-8c7a20d62bd5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:51.953243 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67380e-e2f3-48cb-b77f-8c7a20d62bd5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:51.957384 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc23c1-73a6-42e4-aa81-0936208b285b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:51.963096 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe2bcf-d8bc-4c84-8bbd-9e52de61dac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:51.964207 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe2bcf-d8bc-4c84-8bbd-9e52de61dac3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:51.964649 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe2bcf-d8bc-4c84-8bbd-9e52de61dac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:51.965138 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe2bcf-d8bc-4c84-8bbd-9e52de61dac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:51.966030 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe2bcf-d8bc-4c84-8bbd-9e52de61dac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:51.966587 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe2bcf-d8bc-4c84-8bbd-9e52de61dac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:51.968419 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe2bcf-d8bc-4c84-8bbd-9e52de61dac3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:51.971326 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-2e67380e-e2f3-48cb-b77f-8c7a20d62bd5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:51.976987 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 248/496] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:51.976987 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67380e-e2f3-48cb-b77f-8c7a20d62bd5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:51.983752 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67380e-e2f3-48cb-b77f-8c7a20d62bd5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:51.989041 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff4f66-61e0-4c22-a4c4-e1fa313662b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:51.989761 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff4f66-61e0-4c22-a4c4-e1fa313662b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:51.990109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff4f66-61e0-4c22-a4c4-e1fa313662b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:51.990449 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff4f66-61e0-4c22-a4c4-e1fa313662b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:51.991371 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff4f66-61e0-4c22-a4c4-e1fa313662b3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:51.991742 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff4f66-61e0-4c22-a4c4-e1fa313662b3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:51.992304 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 249/497] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:51.992889 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-98ff4f66-61e0-4c22-a4c4-e1fa313662b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:20:51.992889 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Feb 16 05:20:51.992889 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: Feb 16 05:20:51.993750 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe2bcf-d8bc-4c84-8bbd-9e52de61dac3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:51.999029 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff4f66-61e0-4c22-a4c4-e1fa313662b3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.005871 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe2bcf-d8bc-4c84-8bbd-9e52de61dac3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.012110 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba5e38-3260-4d2c-85ec-c903e1117437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.012979 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba5e38-3260-4d2c-85ec-c903e1117437 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.013470 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba5e38-3260-4d2c-85ec-c903e1117437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.013925 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba5e38-3260-4d2c-85ec-c903e1117437 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.014881 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba5e38-3260-4d2c-85ec-c903e1117437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:52.015394 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba5e38-3260-4d2c-85ec-c903e1117437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.017195 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba5e38-3260-4d2c-85ec-c903e1117437 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.035003 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 250/498] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:52.036052 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba5e38-3260-4d2c-85ec-c903e1117437 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.037734 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 249/499] 10.222.0.75 () {56 vars in 1158 bytes} [Wed Feb 16 05:20:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:52.046216 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff4f66-61e0-4c22-a4c4-e1fa313662b3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.051070 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba5e38-3260-4d2c-85ec-c903e1117437 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.055995 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff4f66-61e0-4c22-a4c4-e1fa313662b3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.056559 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91323ffc-acce-4a24-9786-f2669bd079fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.057634 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91323ffc-acce-4a24-9786-f2669bd079fa admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.058177 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91323ffc-acce-4a24-9786-f2669bd079fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.058651 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91323ffc-acce-4a24-9786-f2669bd079fa admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.061228 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c29db-d56b-4d52-ae61-2c392693b6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.062027 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c29db-d56b-4d52-ae61-2c392693b6aa admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.062302 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c29db-d56b-4d52-ae61-2c392693b6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.062634 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c29db-d56b-4d52-ae61-2c392693b6aa admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.068422 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91323ffc-acce-4a24-9786-f2669bd079fa admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.070388 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c29db-d56b-4d52-ae61-2c392693b6aa admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.070993 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91323ffc-acce-4a24-9786-f2669bd079fa admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.072536 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c29db-d56b-4d52-ae61-2c392693b6aa admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.084981 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-91323ffc-acce-4a24-9786-f2669bd079fa admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 16 05:20:52.086307 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 251/500] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:52.087447 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-270c29db-d56b-4d52-ae61-2c392693b6aa admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 05:20:52.087571 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91323ffc-acce-4a24-9786-f2669bd079fa admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.092421 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 250/501] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:52.093658 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab20e17-523c-417c-bfaa-aedc47277caf None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.093946 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab20e17-523c-417c-bfaa-aedc47277caf None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.094308 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab20e17-523c-417c-bfaa-aedc47277caf None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.096014 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 251/502] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:52.096550 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91323ffc-acce-4a24-9786-f2669bd079fa admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.096657 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab20e17-523c-417c-bfaa-aedc47277caf None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.101018 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb58662-b434-45e5-9b32-78a6ef55ed1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.101659 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb58662-b434-45e5-9b32-78a6ef55ed1d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.101940 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb58662-b434-45e5-9b32-78a6ef55ed1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.102214 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb58662-b434-45e5-9b32-78a6ef55ed1d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.109364 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab20e17-523c-417c-bfaa-aedc47277caf None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.110777 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb58662-b434-45e5-9b32-78a6ef55ed1d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.112547 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb58662-b434-45e5-9b32-78a6ef55ed1d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.113754 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc13ed8-8aeb-445b-8989-12e603582eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.114363 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc13ed8-8aeb-445b-8989-12e603582eac admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.114641 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc13ed8-8aeb-445b-8989-12e603582eac admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.114905 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc13ed8-8aeb-445b-8989-12e603582eac admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.115730 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc13ed8-8aeb-445b-8989-12e603582eac admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:52.116034 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc13ed8-8aeb-445b-8989-12e603582eac admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.118003 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc13ed8-8aeb-445b-8989-12e603582eac admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.122020 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 252/503] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:52.125579 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb58662-b434-45e5-9b32-78a6ef55ed1d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.135723 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb58662-b434-45e5-9b32-78a6ef55ed1d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.137607 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 252/504] 10.222.0.75 () {56 vars in 1158 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:52.142593 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd644fd-ee46-4ed1-9899-e6aceaf0c928 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.142875 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd644fd-ee46-4ed1-9899-e6aceaf0c928 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.143146 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd644fd-ee46-4ed1-9899-e6aceaf0c928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.144748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe23f9-d1df-4b09-ab16-afd85499e1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.145405 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe23f9-d1df-4b09-ab16-afd85499e1cc admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.145691 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe23f9-d1df-4b09-ab16-afd85499e1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.145968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe23f9-d1df-4b09-ab16-afd85499e1cc admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.146801 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe23f9-d1df-4b09-ab16-afd85499e1cc admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:52.147112 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe23f9-d1df-4b09-ab16-afd85499e1cc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.148118 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-50fe23f9-d1df-4b09-ab16-afd85499e1cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:20:52.148118 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Feb 16 05:20:52.148118 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: Feb 16 05:20:52.149240 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe23f9-d1df-4b09-ab16-afd85499e1cc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.160579 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-9cd644fd-ee46-4ed1-9899-e6aceaf0c928 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:52.161906 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9cd644fd-ee46-4ed1-9899-e6aceaf0c928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:52.173302 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 253/505] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:52.173302 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd644fd-ee46-4ed1-9899-e6aceaf0c928 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.189015 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd644fd-ee46-4ed1-9899-e6aceaf0c928 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.193207 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 253/506] 10.222.0.75 () {56 vars in 1154 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:52.193685 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec741e0d-e0de-4f12-b4ba-47004db230f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.194444 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec741e0d-e0de-4f12-b4ba-47004db230f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.194733 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec741e0d-e0de-4f12-b4ba-47004db230f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.195001 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec741e0d-e0de-4f12-b4ba-47004db230f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.195242 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe23f9-d1df-4b09-ab16-afd85499e1cc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.206196 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec741e0d-e0de-4f12-b4ba-47004db230f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.208062 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec741e0d-e0de-4f12-b4ba-47004db230f5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.208465 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe23f9-d1df-4b09-ab16-afd85499e1cc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.216293 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c5301-9e8b-41c1-9603-1f825223953f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.216920 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c5301-9e8b-41c1-9603-1f825223953f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.217202 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c5301-9e8b-41c1-9603-1f825223953f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.217712 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c5301-9e8b-41c1-9603-1f825223953f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.225381 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c5301-9e8b-41c1-9603-1f825223953f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.225922 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-ec741e0d-e0de-4f12-b4ba-47004db230f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:52.227095 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 254/507] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:52.227190 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c5301-9e8b-41c1-9603-1f825223953f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.231846 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec741e0d-e0de-4f12-b4ba-47004db230f5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.236377 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 254/508] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:52.240791 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c5301-9e8b-41c1-9603-1f825223953f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.242079 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec741e0d-e0de-4f12-b4ba-47004db230f5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.247808 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d62ec8-5a8e-4bdd-ab2e-102bc2650926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.248425 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d62ec8-5a8e-4bdd-ab2e-102bc2650926 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.248705 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d62ec8-5a8e-4bdd-ab2e-102bc2650926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.248974 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d62ec8-5a8e-4bdd-ab2e-102bc2650926 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.249623 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c5301-9e8b-41c1-9603-1f825223953f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.253999 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216d9f6-fe66-4d82-aba2-8859e245b54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.254915 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216d9f6-fe66-4d82-aba2-8859e245b54e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.255681 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216d9f6-fe66-4d82-aba2-8859e245b54e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.255964 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216d9f6-fe66-4d82-aba2-8859e245b54e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.257557 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d62ec8-5a8e-4bdd-ab2e-102bc2650926 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.259508 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d62ec8-5a8e-4bdd-ab2e-102bc2650926 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.267737 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216d9f6-fe66-4d82-aba2-8859e245b54e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:52.268726 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 255/509] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:52.269508 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d62ec8-5a8e-4bdd-ab2e-102bc2650926 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.276291 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-8216d9f6-fe66-4d82-aba2-8859e245b54e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 05:20:52.278539 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 255/510] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:52.278939 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d62ec8-5a8e-4bdd-ab2e-102bc2650926 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.279646 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216d9f6-fe66-4d82-aba2-8859e245b54e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.286807 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f358f-97f4-4e37-bb24-5abeaafa2366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.287363 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f358f-97f4-4e37-bb24-5abeaafa2366 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.287644 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f358f-97f4-4e37-bb24-5abeaafa2366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.287911 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f358f-97f4-4e37-bb24-5abeaafa2366 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.288643 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f358f-97f4-4e37-bb24-5abeaafa2366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:52.288940 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f358f-97f4-4e37-bb24-5abeaafa2366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.290590 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f358f-97f4-4e37-bb24-5abeaafa2366 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.291106 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216d9f6-fe66-4d82-aba2-8859e245b54e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.296846 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9c9f3-5f72-424e-965d-7685f4e45d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.297766 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9c9f3-5f72-424e-965d-7685f4e45d47 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.298155 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9c9f3-5f72-424e-965d-7685f4e45d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.298531 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9c9f3-5f72-424e-965d-7685f4e45d47 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.307920 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 256/511] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:52.307920 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f358f-97f4-4e37-bb24-5abeaafa2366 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.309917 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9c9f3-5f72-424e-965d-7685f4e45d47 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.311863 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9c9f3-5f72-424e-965d-7685f4e45d47 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.319476 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f358f-97f4-4e37-bb24-5abeaafa2366 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.325070 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1306d-6891-4a39-adbb-08ec2cf6b1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.325924 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1306d-6891-4a39-adbb-08ec2cf6b1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.326271 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1306d-6891-4a39-adbb-08ec2cf6b1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.326614 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1306d-6891-4a39-adbb-08ec2cf6b1b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.329467 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-17c9c9f3-5f72-424e-965d-7685f4e45d47 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:52.335129 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 256/512] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:52.335129 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9c9f3-5f72-424e-965d-7685f4e45d47 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.339314 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1306d-6891-4a39-adbb-08ec2cf6b1b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.341828 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1306d-6891-4a39-adbb-08ec2cf6b1b1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.345040 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9c9f3-5f72-424e-965d-7685f4e45d47 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.349743 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecc611-d76c-4115-b6bb-d6d8ed470055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.350454 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecc611-d76c-4115-b6bb-d6d8ed470055 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.350797 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecc611-d76c-4115-b6bb-d6d8ed470055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.351136 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ecc611-d76c-4115-b6bb-d6d8ed470055 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.351944 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecc611-d76c-4115-b6bb-d6d8ed470055 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:52.352310 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecc611-d76c-4115-b6bb-d6d8ed470055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.353990 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ecc611-d76c-4115-b6bb-d6d8ed470055 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.359732 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-01a1306d-6891-4a39-adbb-08ec2cf6b1b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:52.365229 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 257/513] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:52.365229 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1306d-6891-4a39-adbb-08ec2cf6b1b1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.369204 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 257/514] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:52.370383 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecc611-d76c-4115-b6bb-d6d8ed470055 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.374277 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1306d-6891-4a39-adbb-08ec2cf6b1b1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.379107 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df9b26-8acd-451b-a386-57d870917d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.379913 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df9b26-8acd-451b-a386-57d870917d79 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.380254 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df9b26-8acd-451b-a386-57d870917d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.380450 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ecc611-d76c-4115-b6bb-d6d8ed470055 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.380644 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df9b26-8acd-451b-a386-57d870917d79 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.386759 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e1515-1983-4e3f-b652-b8176f7b0145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.387391 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e1515-1983-4e3f-b652-b8176f7b0145 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.387703 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df9b26-8acd-451b-a386-57d870917d79 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.387804 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e1515-1983-4e3f-b652-b8176f7b0145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.388098 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e1515-1983-4e3f-b652-b8176f7b0145 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.388872 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e1515-1983-4e3f-b652-b8176f7b0145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:52.389240 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e1515-1983-4e3f-b652-b8176f7b0145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.389727 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84df9b26-8acd-451b-a386-57d870917d79 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.390964 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e1515-1983-4e3f-b652-b8176f7b0145 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.403327 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 258/515] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:52.404025 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e1515-1983-4e3f-b652-b8176f7b0145 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.405949 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-84df9b26-8acd-451b-a386-57d870917d79 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:20:52.407323 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 258/516] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:52.408270 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df9b26-8acd-451b-a386-57d870917d79 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.413636 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e1515-1983-4e3f-b652-b8176f7b0145 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.418031 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606564d-3b22-4e63-879d-66c7b6bcd5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.419257 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606564d-3b22-4e63-879d-66c7b6bcd5bc admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.419535 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606564d-3b22-4e63-879d-66c7b6bcd5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.419804 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606564d-3b22-4e63-879d-66c7b6bcd5bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.420504 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606564d-3b22-4e63-879d-66c7b6bcd5bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:52.420800 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606564d-3b22-4e63-879d-66c7b6bcd5bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.421022 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84df9b26-8acd-451b-a386-57d870917d79 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.422412 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606564d-3b22-4e63-879d-66c7b6bcd5bc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.426305 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc196b-1fbf-426a-ab3e-e38264aa74a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.427203 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc196b-1fbf-426a-ab3e-e38264aa74a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.427641 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc196b-1fbf-426a-ab3e-e38264aa74a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.428061 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdc196b-1fbf-426a-ab3e-e38264aa74a2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.434059 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 259/517] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:52.434678 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606564d-3b22-4e63-879d-66c7b6bcd5bc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.441223 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc196b-1fbf-426a-ab3e-e38264aa74a2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.443497 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdc196b-1fbf-426a-ab3e-e38264aa74a2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.443636 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606564d-3b22-4e63-879d-66c7b6bcd5bc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.448563 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f90327-52f2-4ff9-819a-bc1861cc90a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.449177 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f90327-52f2-4ff9-819a-bc1861cc90a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.449505 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f90327-52f2-4ff9-819a-bc1861cc90a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.449774 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f90327-52f2-4ff9-819a-bc1861cc90a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.450536 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f90327-52f2-4ff9-819a-bc1861cc90a7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:52.450833 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f90327-52f2-4ff9-819a-bc1861cc90a7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.451828 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-81f90327-52f2-4ff9-819a-bc1861cc90a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:20:52.451828 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Feb 16 05:20:52.451828 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: Feb 16 05:20:52.452948 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f90327-52f2-4ff9-819a-bc1861cc90a7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.463484 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-afdc196b-1fbf-426a-ab3e-e38264aa74a2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:52.470285 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 259/518] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:52.470285 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc196b-1fbf-426a-ab3e-e38264aa74a2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.478389 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 260/519] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:52.479074 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f90327-52f2-4ff9-819a-bc1861cc90a7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.485835 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdc196b-1fbf-426a-ab3e-e38264aa74a2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.488913 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f90327-52f2-4ff9-819a-bc1861cc90a7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.490231 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee2d32-d315-4b61-9ab5-72abd9e40243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.490996 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee2d32-d315-4b61-9ab5-72abd9e40243 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.491276 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee2d32-d315-4b61-9ab5-72abd9e40243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.491548 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee2d32-d315-4b61-9ab5-72abd9e40243 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.493533 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba761d-82d6-4559-8d90-a7975dd9d69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.494432 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba761d-82d6-4559-8d90-a7975dd9d69e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.494533 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba761d-82d6-4559-8d90-a7975dd9d69e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.494756 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba761d-82d6-4559-8d90-a7975dd9d69e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.498610 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee2d32-d315-4b61-9ab5-72abd9e40243 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.500645 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee2d32-d315-4b61-9ab5-72abd9e40243 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.501616 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba761d-82d6-4559-8d90-a7975dd9d69e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.503542 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba761d-82d6-4559-8d90-a7975dd9d69e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.513230 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-d2ee2d32-d315-4b61-9ab5-72abd9e40243 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:20:52.519032 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 260/520] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:52.519032 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee2d32-d315-4b61-9ab5-72abd9e40243 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.519218 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-1aba761d-82d6-4559-8d90-a7975dd9d69e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:20:52.519218 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 261/521] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:52.519218 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba761d-82d6-4559-8d90-a7975dd9d69e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.529893 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee2d32-d315-4b61-9ab5-72abd9e40243 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.531188 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba761d-82d6-4559-8d90-a7975dd9d69e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.534291 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfc3ef-3570-43bd-9788-1997722da819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.535007 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfc3ef-3570-43bd-9788-1997722da819 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.535349 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfc3ef-3570-43bd-9788-1997722da819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.535677 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfc3ef-3570-43bd-9788-1997722da819 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.536049 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e94df-f7c4-4851-9d20-210a74eb106f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.536543 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfc3ef-3570-43bd-9788-1997722da819 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:52.536715 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e94df-f7c4-4851-9d20-210a74eb106f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.537019 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfc3ef-3570-43bd-9788-1997722da819 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.537122 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e94df-f7c4-4851-9d20-210a74eb106f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.537220 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e94df-f7c4-4851-9d20-210a74eb106f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.538078 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e94df-f7c4-4851-9d20-210a74eb106f admin admin] RBAC: Adding query filter params (role.id=0660c2b0286b42c78d66c437b4713a2f, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=ba8e4a7763524f4190c5cd66e27b5910) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:52.538389 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e94df-f7c4-4851-9d20-210a74eb106f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.538773 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfc3ef-3570-43bd-9788-1997722da819 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.540493 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811e94df-f7c4-4851-9d20-210a74eb106f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.546955 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 262/522] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/role_assignments?user.id=ba8e4a7763524f4190c5cd66e27b5910&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=0660c2b0286b42c78d66c437b4713a2f => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:52.547738 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e94df-f7c4-4851-9d20-210a74eb106f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.558742 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811e94df-f7c4-4851-9d20-210a74eb106f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.561096 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 261/523] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:52.562768 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfc3ef-3570-43bd-9788-1997722da819 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.565348 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b4b05-8457-484b-a19b-ec9faf4bd48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.572204 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b4b05-8457-484b-a19b-ec9faf4bd48b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.572204 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b4b05-8457-484b-a19b-ec9faf4bd48b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.572204 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b4b05-8457-484b-a19b-ec9faf4bd48b admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.572204 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b4b05-8457-484b-a19b-ec9faf4bd48b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:52.572204 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b4b05-8457-484b-a19b-ec9faf4bd48b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.576424 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7b4b05-8457-484b-a19b-ec9faf4bd48b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.581064 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfc3ef-3570-43bd-9788-1997722da819 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.593209 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 263/524] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:52.593915 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9cbb6-3311-4e7d-8eea-0bde92381969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.594856 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9cbb6-3311-4e7d-8eea-0bde92381969 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.595344 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9cbb6-3311-4e7d-8eea-0bde92381969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.595848 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9cbb6-3311-4e7d-8eea-0bde92381969 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.596877 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9cbb6-3311-4e7d-8eea-0bde92381969 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:52.597443 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9cbb6-3311-4e7d-8eea-0bde92381969 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.598316 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b4b05-8457-484b-a19b-ec9faf4bd48b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.599255 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-5db9cbb6-3311-4e7d-8eea-0bde92381969 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:20:52.599255 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Feb 16 05:20:52.599255 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: Feb 16 05:20:52.600793 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9cbb6-3311-4e7d-8eea-0bde92381969 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.611314 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b4b05-8457-484b-a19b-ec9faf4bd48b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.618904 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8baed4-df96-4918-bee6-6488557b141f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.620919 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8baed4-df96-4918-bee6-6488557b141f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.620919 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8baed4-df96-4918-bee6-6488557b141f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.621425 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8baed4-df96-4918-bee6-6488557b141f admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.635058 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8baed4-df96-4918-bee6-6488557b141f admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.635058 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8baed4-df96-4918-bee6-6488557b141f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.636061 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 262/525] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:52.642695 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9cbb6-3311-4e7d-8eea-0bde92381969 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.651388 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-2c8baed4-df96-4918-bee6-6488557b141f admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 16 05:20:52.653559 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 264/526] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:52.654783 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9cbb6-3311-4e7d-8eea-0bde92381969 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.658220 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8baed4-df96-4918-bee6-6488557b141f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.664510 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a964a-45ce-4969-ad49-316e07c96827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.665323 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a964a-45ce-4969-ad49-316e07c96827 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.665825 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a964a-45ce-4969-ad49-316e07c96827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.666199 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a964a-45ce-4969-ad49-316e07c96827 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.667310 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a964a-45ce-4969-ad49-316e07c96827 admin admin] RBAC: Adding query filter params (role.id=0660c2b0286b42c78d66c437b4713a2f, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=ff019ca0eef8455ba680191b8ae1fdba) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:52.667618 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a964a-45ce-4969-ad49-316e07c96827 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.670946 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a964a-45ce-4969-ad49-316e07c96827 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.676241 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8baed4-df96-4918-bee6-6488557b141f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.678094 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 263/527] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/role_assignments?user.id=ff019ca0eef8455ba680191b8ae1fdba&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=0660c2b0286b42c78d66c437b4713a2f => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:52.679154 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a964a-45ce-4969-ad49-316e07c96827 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.696049 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457915a2-8ce2-40a9-ad6e-cbee852852a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.696988 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457915a2-8ce2-40a9-ad6e-cbee852852a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.697453 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457915a2-8ce2-40a9-ad6e-cbee852852a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.697880 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457915a2-8ce2-40a9-ad6e-cbee852852a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.698956 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457915a2-8ce2-40a9-ad6e-cbee852852a9 admin admin] RBAC: Adding query filter params (role.id=0660c2b0286b42c78d66c437b4713a2f, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=6522d231532a48ad8dbc9c9e79a021dd) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:52.699980 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457915a2-8ce2-40a9-ad6e-cbee852852a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.702149 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457915a2-8ce2-40a9-ad6e-cbee852852a9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.709858 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a964a-45ce-4969-ad49-316e07c96827 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.725984 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 265/528] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/role_assignments?user.id=6522d231532a48ad8dbc9c9e79a021dd&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=0660c2b0286b42c78d66c437b4713a2f => generated 259 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:52.729364 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a01bdd-0d47-4690-876a-2aa5a2d2ce75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.730282 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a01bdd-0d47-4690-876a-2aa5a2d2ce75 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.731251 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a01bdd-0d47-4690-876a-2aa5a2d2ce75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.731706 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a01bdd-0d47-4690-876a-2aa5a2d2ce75 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.734052 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a01bdd-0d47-4690-876a-2aa5a2d2ce75 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:52.734714 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a01bdd-0d47-4690-876a-2aa5a2d2ce75 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.736849 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a01bdd-0d47-4690-876a-2aa5a2d2ce75 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.775986 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 264/529] 10.222.0.75 () {56 vars in 1160 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:52.783066 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457915a2-8ce2-40a9-ad6e-cbee852852a9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.800506 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457915a2-8ce2-40a9-ad6e-cbee852852a9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.816739 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a183d-13cd-48a4-8fa6-849ce6c40374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.818229 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a183d-13cd-48a4-8fa6-849ce6c40374 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.818671 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a183d-13cd-48a4-8fa6-849ce6c40374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.819096 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a183d-13cd-48a4-8fa6-849ce6c40374 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.834050 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a183d-13cd-48a4-8fa6-849ce6c40374 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.837657 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a183d-13cd-48a4-8fa6-849ce6c40374 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.859397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 266/530] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:52.865415 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a01bdd-0d47-4690-876a-2aa5a2d2ce75 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.885863 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a01bdd-0d47-4690-876a-2aa5a2d2ce75 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.896734 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b58f54-9028-4af0-8893-91fa0524d5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.897614 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b58f54-9028-4af0-8893-91fa0524d5bc admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.897893 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b58f54-9028-4af0-8893-91fa0524d5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.898162 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b58f54-9028-4af0-8893-91fa0524d5bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.914737 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b58f54-9028-4af0-8893-91fa0524d5bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.916975 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b58f54-9028-4af0-8893-91fa0524d5bc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.936954 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-69b58f54-9028-4af0-8893-91fa0524d5bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:52.938324 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a50319-1578-4920-b17b-51461f1e0ff1 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.938484 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 265/531] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:52.938612 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a50319-1578-4920-b17b-51461f1e0ff1 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.938890 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a50319-1578-4920-b17b-51461f1e0ff1 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.940778 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 267/532] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:52.943886 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b58f54-9028-4af0-8893-91fa0524d5bc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.946550 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791ff2f-7b7f-4ee0-99ea-b68c3d59efca None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.947029 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791ff2f-7b7f-4ee0-99ea-b68c3d59efca None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.947516 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791ff2f-7b7f-4ee0-99ea-b68c3d59efca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.954293 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b58f54-9028-4af0-8893-91fa0524d5bc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:52.963071 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad277a-a526-4805-9210-79d3e44d85de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:52.964030 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad277a-a526-4805-9210-79d3e44d85de admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:52.964462 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad277a-a526-4805-9210-79d3e44d85de admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:52.965486 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad277a-a526-4805-9210-79d3e44d85de admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:52.966436 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad277a-a526-4805-9210-79d3e44d85de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:52.966982 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad277a-a526-4805-9210-79d3e44d85de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:52.968821 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad277a-a526-4805-9210-79d3e44d85de admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:52.983067 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 266/533] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:52.993317 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d791ff2f-7b7f-4ee0-99ea-b68c3d59efca None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:52.993547 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad277a-a526-4805-9210-79d3e44d85de admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:52.993640 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d791ff2f-7b7f-4ee0-99ea-b68c3d59efca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:53.001993 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad277a-a526-4805-9210-79d3e44d85de admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:53.009570 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea108ca-60e1-4e4c-9627-1ee505b4f465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:53.011270 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea108ca-60e1-4e4c-9627-1ee505b4f465 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:53.012146 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea108ca-60e1-4e4c-9627-1ee505b4f465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:53.014113 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea108ca-60e1-4e4c-9627-1ee505b4f465 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:53.021423 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 268/534] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:53.029947 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea108ca-60e1-4e4c-9627-1ee505b4f465 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:53.032288 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea108ca-60e1-4e4c-9627-1ee505b4f465 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:53.048461 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791ff2f-7b7f-4ee0-99ea-b68c3d59efca None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:53.054353 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-0ea108ca-60e1-4e4c-9627-1ee505b4f465 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:20:53.059906 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791ff2f-7b7f-4ee0-99ea-b68c3d59efca None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:53.061124 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 267/535] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:53.063576 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea108ca-60e1-4e4c-9627-1ee505b4f465 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:53.068569 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c1b0d-005b-41aa-b3a7-e811d46e1373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:53.070507 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c1b0d-005b-41aa-b3a7-e811d46e1373 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:53.070981 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c1b0d-005b-41aa-b3a7-e811d46e1373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:53.071395 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c1b0d-005b-41aa-b3a7-e811d46e1373 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:53.085328 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea108ca-60e1-4e4c-9627-1ee505b4f465 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:53.093302 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46015233-060e-4bc9-9206-36d7123160e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:53.094371 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c1b0d-005b-41aa-b3a7-e811d46e1373 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:53.095227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46015233-060e-4bc9-9206-36d7123160e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:53.096398 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46015233-060e-4bc9-9206-36d7123160e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:53.096844 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46015233-060e-4bc9-9206-36d7123160e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:53.098377 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46015233-060e-4bc9-9206-36d7123160e9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:53.099543 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46015233-060e-4bc9-9206-36d7123160e9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:53.099801 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c1b0d-005b-41aa-b3a7-e811d46e1373 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:53.103740 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46015233-060e-4bc9-9206-36d7123160e9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:53.129894 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-039c1b0d-005b-41aa-b3a7-e811d46e1373 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:53.131751 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 269/537] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:53.131908 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 268/537] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:20:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:53.141459 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46015233-060e-4bc9-9206-36d7123160e9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:53.142738 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c1b0d-005b-41aa-b3a7-e811d46e1373 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:53.158557 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46015233-060e-4bc9-9206-36d7123160e9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:53.162892 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c1b0d-005b-41aa-b3a7-e811d46e1373 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:53.168582 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022e708-4cc8-4c5b-b144-39ffcf7d1bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:53.169234 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022e708-4cc8-4c5b-b144-39ffcf7d1bff admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:53.169538 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022e708-4cc8-4c5b-b144-39ffcf7d1bff admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:53.169814 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022e708-4cc8-4c5b-b144-39ffcf7d1bff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:53.170648 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022e708-4cc8-4c5b-b144-39ffcf7d1bff admin admin] RBAC: Adding query filter params (role.id=0660c2b0286b42c78d66c437b4713a2f, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=fd4eac62484c47988657d2a730f2d056) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:53.170959 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022e708-4cc8-4c5b-b144-39ffcf7d1bff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:53.172857 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c022e708-4cc8-4c5b-b144-39ffcf7d1bff admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:53.177467 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5879448-c62d-4a70-a9db-bf6cc2c6b315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:53.178407 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5879448-c62d-4a70-a9db-bf6cc2c6b315 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:53.178896 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5879448-c62d-4a70-a9db-bf6cc2c6b315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:53.179331 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5879448-c62d-4a70-a9db-bf6cc2c6b315 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:53.180067 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5879448-c62d-4a70-a9db-bf6cc2c6b315 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:53.180449 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5879448-c62d-4a70-a9db-bf6cc2c6b315 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:53.182355 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5879448-c62d-4a70-a9db-bf6cc2c6b315 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:53.194281 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 269/538] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:53 2022] GET /identity/v3/role_assignments?user.id=fd4eac62484c47988657d2a730f2d056&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=0660c2b0286b42c78d66c437b4713a2f => generated 259 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:53.202673 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 270/539] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:53.208509 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022e708-4cc8-4c5b-b144-39ffcf7d1bff admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:53.224663 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022e708-4cc8-4c5b-b144-39ffcf7d1bff admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:53.234233 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0bae2-1b14-4244-801e-5eefab7c9d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:53.235017 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0bae2-1b14-4244-801e-5eefab7c9d10 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:53.235297 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0bae2-1b14-4244-801e-5eefab7c9d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:53.235572 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0bae2-1b14-4244-801e-5eefab7c9d10 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:53.236312 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0bae2-1b14-4244-801e-5eefab7c9d10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:53.238365 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0bae2-1b14-4244-801e-5eefab7c9d10 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:53.274867 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 270/540] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Feb 16 05:20:53 2022] POST /identity/v3/users => generated 247 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:20:55.372119 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1fa07-733e-4c12-91a1-9ce5b9326c86 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.372664 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1fa07-733e-4c12-91a1-9ce5b9326c86 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.372664 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1fa07-733e-4c12-91a1-9ce5b9326c86 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.374688 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 271/541] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:55.380103 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3a8af-f162-4402-a827-c39c95c78d8d None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.380893 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3a8af-f162-4402-a827-c39c95c78d8d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.381435 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3a8af-f162-4402-a827-c39c95c78d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.402776 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c632f2-1a1b-4080-b7c9-88275a82deeb None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.403074 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c632f2-1a1b-4080-b7c9-88275a82deeb None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.403332 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c632f2-1a1b-4080-b7c9-88275a82deeb None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.405363 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 272/542] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:55.407736 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-bcd3a8af-f162-4402-a827-c39c95c78d8d None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:55.409177 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-bcd3a8af-f162-4402-a827-c39c95c78d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:55.410835 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033a59f-ddb3-4b2a-8d0f-6f8c8fc40417 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.411124 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033a59f-ddb3-4b2a-8d0f-6f8c8fc40417 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.411397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033a59f-ddb3-4b2a-8d0f-6f8c8fc40417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.418122 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 271/543] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:55.439213 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-c033a59f-ddb3-4b2a-8d0f-6f8c8fc40417 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:55.440406 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c033a59f-ddb3-4b2a-8d0f-6f8c8fc40417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:55.442378 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3a8af-f162-4402-a827-c39c95c78d8d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:55.452199 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3a8af-f162-4402-a827-c39c95c78d8d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:55.455720 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 273/544] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:55.457408 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434e20e-a443-458a-9146-8774c1e8e4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:55.458406 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434e20e-a443-458a-9146-8774c1e8e4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.458905 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434e20e-a443-458a-9146-8774c1e8e4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.459372 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434e20e-a443-458a-9146-8774c1e8e4b7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.477890 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434e20e-a443-458a-9146-8774c1e8e4b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:55.478629 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033a59f-ddb3-4b2a-8d0f-6f8c8fc40417 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:55.485249 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-9434e20e-a443-458a-9146-8774c1e8e4b7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 05:20:55.486740 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 272/545] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:20:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:55.488021 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad655f-e675-4796-aa56-2c9e717b7e86 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.488256 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad655f-e675-4796-aa56-2c9e717b7e86 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.488523 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad655f-e675-4796-aa56-2c9e717b7e86 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.490207 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 273/546] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:55.492070 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033a59f-ddb3-4b2a-8d0f-6f8c8fc40417 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:55.497520 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad655f-e675-4796-aa56-2c9e717b7e86 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:55.500979 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482db56-f843-44ab-8d8a-490ae2154153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:55.502099 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482db56-f843-44ab-8d8a-490ae2154153 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.502582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482db56-f843-44ab-8d8a-490ae2154153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.503073 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482db56-f843-44ab-8d8a-490ae2154153 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.508243 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad655f-e675-4796-aa56-2c9e717b7e86 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:55.513214 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf127cd-ebc3-4c14-889b-11fe56e24f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:55.513879 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf127cd-ebc3-4c14-889b-11fe56e24f1f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.514159 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf127cd-ebc3-4c14-889b-11fe56e24f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.514432 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf127cd-ebc3-4c14-889b-11fe56e24f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.515174 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf127cd-ebc3-4c14-889b-11fe56e24f1f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:55.515477 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf127cd-ebc3-4c14-889b-11fe56e24f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:55.517162 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf127cd-ebc3-4c14-889b-11fe56e24f1f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:55.517441 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482db56-f843-44ab-8d8a-490ae2154153 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:55.524391 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-0482db56-f843-44ab-8d8a-490ae2154153 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 05:20:55.530062 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 274/548] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Feb 16 05:20:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:55.530062 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125b767-a7c4-4884-b292-07351f9034d8 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.530062 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125b767-a7c4-4884-b292-07351f9034d8 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.530062 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125b767-a7c4-4884-b292-07351f9034d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.530657 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 274/548] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:20:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:55.532720 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482db56-f843-44ab-8d8a-490ae2154153 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:55.544660 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482db56-f843-44ab-8d8a-490ae2154153 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:55.549227 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7cc0b-d99b-4e55-9a6f-1a0955bc7ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:55.549892 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7cc0b-d99b-4e55-9a6f-1a0955bc7ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.550172 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7cc0b-d99b-4e55-9a6f-1a0955bc7ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.550445 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7cc0b-d99b-4e55-9a6f-1a0955bc7ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.551189 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7cc0b-d99b-4e55-9a6f-1a0955bc7ce6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:55.551492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7cc0b-d99b-4e55-9a6f-1a0955bc7ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:55.551748 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-2125b767-a7c4-4884-b292-07351f9034d8 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:55.553110 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7cc0b-d99b-4e55-9a6f-1a0955bc7ce6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:55.553344 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2125b767-a7c4-4884-b292-07351f9034d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:55.562016 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 275/549] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:55.567026 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 275/550] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Feb 16 05:20:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:55.567026 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7cc0b-d99b-4e55-9a6f-1a0955bc7ce6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:55.570207 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125b767-a7c4-4884-b292-07351f9034d8 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:55.583175 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7cc0b-d99b-4e55-9a6f-1a0955bc7ce6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:55.587542 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125b767-a7c4-4884-b292-07351f9034d8 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:55.593755 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cdabd-1196-466e-89fd-46730e6ac475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:55.595686 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cdabd-1196-466e-89fd-46730e6ac475 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.596118 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cdabd-1196-466e-89fd-46730e6ac475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.596666 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cdabd-1196-466e-89fd-46730e6ac475 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.597944 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4eb398-6e6a-4f18-9e65-9629835a4eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:55.598494 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4eb398-6e6a-4f18-9e65-9629835a4eea admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.599686 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4eb398-6e6a-4f18-9e65-9629835a4eea admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.600075 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4eb398-6e6a-4f18-9e65-9629835a4eea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.616839 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cdabd-1196-466e-89fd-46730e6ac475 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:55.618739 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cdabd-1196-466e-89fd-46730e6ac475 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:55.619211 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4eb398-6e6a-4f18-9e65-9629835a4eea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:55.622724 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4eb398-6e6a-4f18-9e65-9629835a4eea admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:55.637849 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-975cdabd-1196-466e-89fd-46730e6ac475 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:55.639462 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 276/551] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:55.643927 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cdabd-1196-466e-89fd-46730e6ac475 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:55.647824 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-1d4eb398-6e6a-4f18-9e65-9629835a4eea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:55.649766 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 276/552] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:55.650720 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4eb398-6e6a-4f18-9e65-9629835a4eea admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:55.654951 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cdabd-1196-466e-89fd-46730e6ac475 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:55.659959 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f4771-3833-4dfa-ab21-fbb3ef4d0a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:55.660803 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f4771-3833-4dfa-ab21-fbb3ef4d0a73 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.661151 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f4771-3833-4dfa-ab21-fbb3ef4d0a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.661573 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f4771-3833-4dfa-ab21-fbb3ef4d0a73 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.661677 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4eb398-6e6a-4f18-9e65-9629835a4eea admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:55.670375 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbffaf1-2f65-4026-9110-0d7afc738637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:55.672282 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbffaf1-2f65-4026-9110-0d7afc738637 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.672745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbffaf1-2f65-4026-9110-0d7afc738637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.673194 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbffaf1-2f65-4026-9110-0d7afc738637 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.674423 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbffaf1-2f65-4026-9110-0d7afc738637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:55.674847 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f4771-3833-4dfa-ab21-fbb3ef4d0a73 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:55.675114 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbffaf1-2f65-4026-9110-0d7afc738637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:55.676936 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbffaf1-2f65-4026-9110-0d7afc738637 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:55.682343 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-8b3f4771-3833-4dfa-ab21-fbb3ef4d0a73 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 05:20:55.683679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 277/553] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:20:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:55.689975 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f4771-3833-4dfa-ab21-fbb3ef4d0a73 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:55.691178 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 277/554] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:55.697840 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbffaf1-2f65-4026-9110-0d7afc738637 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:55.702300 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f4771-3833-4dfa-ab21-fbb3ef4d0a73 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:55.707106 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e3fcf-70ca-4440-8a7f-c29a86818f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:55.707843 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e3fcf-70ca-4440-8a7f-c29a86818f6d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.708192 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e3fcf-70ca-4440-8a7f-c29a86818f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.708552 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e3fcf-70ca-4440-8a7f-c29a86818f6d admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.709408 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e3fcf-70ca-4440-8a7f-c29a86818f6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:55.709781 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e3fcf-70ca-4440-8a7f-c29a86818f6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:55.710984 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbffaf1-2f65-4026-9110-0d7afc738637 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:55.711611 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e3fcf-70ca-4440-8a7f-c29a86818f6d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:55.721345 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013741af-80ba-4d30-ac45-e9e0dcad748e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:55.722768 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013741af-80ba-4d30-ac45-e9e0dcad748e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.723412 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013741af-80ba-4d30-ac45-e9e0dcad748e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.723971 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013741af-80ba-4d30-ac45-e9e0dcad748e admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.724921 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013741af-80ba-4d30-ac45-e9e0dcad748e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:55.725446 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013741af-80ba-4d30-ac45-e9e0dcad748e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:55.725771 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 278/555] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:55.727468 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013741af-80ba-4d30-ac45-e9e0dcad748e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:55.731514 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e3fcf-70ca-4440-8a7f-c29a86818f6d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:55.739954 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 278/556] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Feb 16 05:20:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:55.741002 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013741af-80ba-4d30-ac45-e9e0dcad748e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:55.745799 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e3fcf-70ca-4440-8a7f-c29a86818f6d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:55.751387 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ce016-3749-4556-b0dd-aa7d2f451ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:55.752200 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013741af-80ba-4d30-ac45-e9e0dcad748e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:55.752322 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ce016-3749-4556-b0dd-aa7d2f451ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.752593 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ce016-3749-4556-b0dd-aa7d2f451ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.752934 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ce016-3749-4556-b0dd-aa7d2f451ae6 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.758445 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1036b01-7d92-471a-9a36-2dea7e9c1328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:55.759410 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1036b01-7d92-471a-9a36-2dea7e9c1328 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.759922 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1036b01-7d92-471a-9a36-2dea7e9c1328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.760628 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1036b01-7d92-471a-9a36-2dea7e9c1328 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.761209 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ce016-3749-4556-b0dd-aa7d2f451ae6 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:55.763580 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ce016-3749-4556-b0dd-aa7d2f451ae6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:55.769970 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1036b01-7d92-471a-9a36-2dea7e9c1328 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:55.772537 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1036b01-7d92-471a-9a36-2dea7e9c1328 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:55.778080 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-285ce016-3749-4556-b0dd-aa7d2f451ae6 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 16 05:20:55.779513 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 279/557] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:55.784864 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ce016-3749-4556-b0dd-aa7d2f451ae6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:55.795815 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ce016-3749-4556-b0dd-aa7d2f451ae6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:55.800569 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92632930-56c2-4be4-844b-56c7464dabd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:55.801527 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92632930-56c2-4be4-844b-56c7464dabd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.801878 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92632930-56c2-4be4-844b-56c7464dabd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.802225 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92632930-56c2-4be4-844b-56c7464dabd9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.814797 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92632930-56c2-4be4-844b-56c7464dabd9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:55.816915 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92632930-56c2-4be4-844b-56c7464dabd9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:55.836292 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-92632930-56c2-4be4-844b-56c7464dabd9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:55.843021 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 280/558] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:55.844159 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92632930-56c2-4be4-844b-56c7464dabd9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:55.856465 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92632930-56c2-4be4-844b-56c7464dabd9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:55.861363 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912be44-cd0e-414a-ab75-b78f07fdbbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:55.862183 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912be44-cd0e-414a-ab75-b78f07fdbbab admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.862528 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912be44-cd0e-414a-ab75-b78f07fdbbab admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.862872 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912be44-cd0e-414a-ab75-b78f07fdbbab admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.863827 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912be44-cd0e-414a-ab75-b78f07fdbbab admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:55.864646 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912be44-cd0e-414a-ab75-b78f07fdbbab admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:55.866706 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912be44-cd0e-414a-ab75-b78f07fdbbab admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:55.891583 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 281/559] 10.222.0.75 () {56 vars in 1158 bytes} [Wed Feb 16 05:20:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:55.892721 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912be44-cd0e-414a-ab75-b78f07fdbbab admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:55.911319 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912be44-cd0e-414a-ab75-b78f07fdbbab admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:55.916104 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24444c-8a43-477e-b6e3-405b3aa21487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:55.916866 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24444c-8a43-477e-b6e3-405b3aa21487 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.917209 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24444c-8a43-477e-b6e3-405b3aa21487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.917612 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24444c-8a43-477e-b6e3-405b3aa21487 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.919057 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24444c-8a43-477e-b6e3-405b3aa21487 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:55.919431 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24444c-8a43-477e-b6e3-405b3aa21487 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:55.921170 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24444c-8a43-477e-b6e3-405b3aa21487 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:55.928767 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-f1036b01-7d92-471a-9a36-2dea7e9c1328 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 05:20:55.930963 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 279/560] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Feb 16 05:20:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:55.932337 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1036b01-7d92-471a-9a36-2dea7e9c1328 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:55.938623 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 282/561] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:55.939643 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24444c-8a43-477e-b6e3-405b3aa21487 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:55.948852 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1036b01-7d92-471a-9a36-2dea7e9c1328 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:55.951866 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24444c-8a43-477e-b6e3-405b3aa21487 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:55.954795 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fff04-bf0e-4e48-a1a1-679d6593e733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:55.955829 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fff04-bf0e-4e48-a1a1-679d6593e733 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.956281 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fff04-bf0e-4e48-a1a1-679d6593e733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.956619 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fff04-bf0e-4e48-a1a1-679d6593e733 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.957592 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a1a9f-3f66-41e7-a021-95655cd51493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:55.958430 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a1a9f-3f66-41e7-a021-95655cd51493 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:55.959079 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a1a9f-3f66-41e7-a021-95655cd51493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:55.959532 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a1a9f-3f66-41e7-a021-95655cd51493 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:55.960896 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a1a9f-3f66-41e7-a021-95655cd51493 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:55.961446 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a1a9f-3f66-41e7-a021-95655cd51493 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:55.963496 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a1a9f-3f66-41e7-a021-95655cd51493 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:55.970092 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fff04-bf0e-4e48-a1a1-679d6593e733 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:55.971946 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fff04-bf0e-4e48-a1a1-679d6593e733 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:55.997343 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 283/562] 10.222.0.75 () {56 vars in 1154 bytes} [Wed Feb 16 05:20:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:55.998219 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a1a9f-3f66-41e7-a021-95655cd51493 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:55.999149 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-d07fff04-bf0e-4e48-a1a1-679d6593e733 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:56.000777 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 280/563] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:56.001809 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fff04-bf0e-4e48-a1a1-679d6593e733 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.014926 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a1a9f-3f66-41e7-a021-95655cd51493 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.015128 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fff04-bf0e-4e48-a1a1-679d6593e733 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.019675 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff9c49-d199-428e-a9db-7b566d8338e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.020463 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff9c49-d199-428e-a9db-7b566d8338e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.020745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff9c49-d199-428e-a9db-7b566d8338e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.021018 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff9c49-d199-428e-a9db-7b566d8338e7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.021693 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b668e27-5dad-4328-8a9a-0974f2296e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.022756 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b668e27-5dad-4328-8a9a-0974f2296e1c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.023214 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b668e27-5dad-4328-8a9a-0974f2296e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.023702 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b668e27-5dad-4328-8a9a-0974f2296e1c admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.032302 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b668e27-5dad-4328-8a9a-0974f2296e1c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.033704 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff9c49-d199-428e-a9db-7b566d8338e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.035011 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b668e27-5dad-4328-8a9a-0974f2296e1c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.035564 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ff9c49-d199-428e-a9db-7b566d8338e7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.050304 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-9b668e27-5dad-4328-8a9a-0974f2296e1c admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 16 05:20:56.052028 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 284/564] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:56.053068 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b668e27-5dad-4328-8a9a-0974f2296e1c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.055246 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-24ff9c49-d199-428e-a9db-7b566d8338e7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:56.056918 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 281/565] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:56.061518 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff9c49-d199-428e-a9db-7b566d8338e7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.068008 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b668e27-5dad-4328-8a9a-0974f2296e1c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.072521 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a379b-66ba-4639-a560-98dd399d0a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.073163 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a379b-66ba-4639-a560-98dd399d0a37 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.073480 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a379b-66ba-4639-a560-98dd399d0a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.073754 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a379b-66ba-4639-a560-98dd399d0a37 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.073856 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff9c49-d199-428e-a9db-7b566d8338e7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.074511 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a379b-66ba-4639-a560-98dd399d0a37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:56.074813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a379b-66ba-4639-a560-98dd399d0a37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.076410 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a379b-66ba-4639-a560-98dd399d0a37 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.078681 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68805ac6-a303-4810-9278-d86213f886e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.079429 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68805ac6-a303-4810-9278-d86213f886e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.079809 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68805ac6-a303-4810-9278-d86213f886e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.080181 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68805ac6-a303-4810-9278-d86213f886e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.081113 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68805ac6-a303-4810-9278-d86213f886e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:56.081563 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68805ac6-a303-4810-9278-d86213f886e4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.083514 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68805ac6-a303-4810-9278-d86213f886e4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.093479 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 285/566] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:56.093479 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a379b-66ba-4639-a560-98dd399d0a37 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.102160 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 282/567] 10.222.0.75 () {56 vars in 1158 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:56.103265 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a379b-66ba-4639-a560-98dd399d0a37 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.107238 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7a9af-ead9-46c2-8fb9-22556add9474 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.107238 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7a9af-ead9-46c2-8fb9-22556add9474 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.107238 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7a9af-ead9-46c2-8fb9-22556add9474 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.107238 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 283/568] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:56.107238 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7a9af-ead9-46c2-8fb9-22556add9474 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.114496 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe210ce-5a34-4c61-9eab-8a19158b0933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.115146 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe210ce-5a34-4c61-9eab-8a19158b0933 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.115435 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe210ce-5a34-4c61-9eab-8a19158b0933 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.115712 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe210ce-5a34-4c61-9eab-8a19158b0933 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.116434 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe210ce-5a34-4c61-9eab-8a19158b0933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:56.116741 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe210ce-5a34-4c61-9eab-8a19158b0933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.118379 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe210ce-5a34-4c61-9eab-8a19158b0933 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.120227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7a9af-ead9-46c2-8fb9-22556add9474 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.124770 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793bc81-48ef-4c1f-9995-55edde65f5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.125699 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793bc81-48ef-4c1f-9995-55edde65f5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.126081 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793bc81-48ef-4c1f-9995-55edde65f5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.126452 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793bc81-48ef-4c1f-9995-55edde65f5f2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.135113 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 286/569] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:56.135113 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1c3d6-2a66-4ff6-88c7-356f80ef47b8 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.135113 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1c3d6-2a66-4ff6-88c7-356f80ef47b8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.135113 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1c3d6-2a66-4ff6-88c7-356f80ef47b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.136779 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793bc81-48ef-4c1f-9995-55edde65f5f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.139002 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793bc81-48ef-4c1f-9995-55edde65f5f2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.150096 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-37d1c3d6-2a66-4ff6-88c7-356f80ef47b8 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:56.151244 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-37d1c3d6-2a66-4ff6-88c7-356f80ef47b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:56.153984 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-e793bc81-48ef-4c1f-9995-55edde65f5f2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:20:56.155659 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 284/570] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:56.156535 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793bc81-48ef-4c1f-9995-55edde65f5f2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.164104 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 287/571] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:56.165073 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1c3d6-2a66-4ff6-88c7-356f80ef47b8 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.169125 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793bc81-48ef-4c1f-9995-55edde65f5f2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.173915 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc1de5-11e8-4952-9154-8502fe047763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.174781 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc1de5-11e8-4952-9154-8502fe047763 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.175192 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc1de5-11e8-4952-9154-8502fe047763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.175559 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc1de5-11e8-4952-9154-8502fe047763 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.176071 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d1c3d6-2a66-4ff6-88c7-356f80ef47b8 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.181082 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1438bcb-b479-4ce8-8cc2-758b509330d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.182454 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1438bcb-b479-4ce8-8cc2-758b509330d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.183028 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1438bcb-b479-4ce8-8cc2-758b509330d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.183503 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1438bcb-b479-4ce8-8cc2-758b509330d3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.186727 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc1de5-11e8-4952-9154-8502fe047763 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.188701 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc1de5-11e8-4952-9154-8502fe047763 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.192008 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1438bcb-b479-4ce8-8cc2-758b509330d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.195040 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1438bcb-b479-4ce8-8cc2-758b509330d3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.206712 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-74cc1de5-11e8-4952-9154-8502fe047763 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:56.213178 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 285/572] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:56.213418 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-b1438bcb-b479-4ce8-8cc2-758b509330d3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:20:56.213514 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc1de5-11e8-4952-9154-8502fe047763 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.213599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 288/573] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:56.213599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1438bcb-b479-4ce8-8cc2-758b509330d3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.226117 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc1de5-11e8-4952-9154-8502fe047763 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.226370 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1438bcb-b479-4ce8-8cc2-758b509330d3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.231439 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f226e21-e643-4624-a5d1-ee6628f42508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.231621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25eb59-b4fa-48ae-8497-83fafad2b60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.232251 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f226e21-e643-4624-a5d1-ee6628f42508 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.232376 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25eb59-b4fa-48ae-8497-83fafad2b60f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.232525 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f226e21-e643-4624-a5d1-ee6628f42508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.233174 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f226e21-e643-4624-a5d1-ee6628f42508 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.233309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25eb59-b4fa-48ae-8497-83fafad2b60f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.233309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25eb59-b4fa-48ae-8497-83fafad2b60f admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.234244 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25eb59-b4fa-48ae-8497-83fafad2b60f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:56.234721 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25eb59-b4fa-48ae-8497-83fafad2b60f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.236720 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25eb59-b4fa-48ae-8497-83fafad2b60f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.243834 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f226e21-e643-4624-a5d1-ee6628f42508 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:56.249288 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 286/574] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:56.254055 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-6f226e21-e643-4624-a5d1-ee6628f42508 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 05:20:56.254177 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25eb59-b4fa-48ae-8497-83fafad2b60f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.254251 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 289/575] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:56.254251 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f226e21-e643-4624-a5d1-ee6628f42508 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.266808 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f226e21-e643-4624-a5d1-ee6628f42508 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.268130 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25eb59-b4fa-48ae-8497-83fafad2b60f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.271257 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9e7e5-0359-4cee-b4ed-d350568f1d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.271951 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9e7e5-0359-4cee-b4ed-d350568f1d97 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.272232 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9e7e5-0359-4cee-b4ed-d350568f1d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.272523 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b9e7e5-0359-4cee-b4ed-d350568f1d97 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.273120 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c06e3-81d5-42fd-8edc-471987dbf9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.273344 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9e7e5-0359-4cee-b4ed-d350568f1d97 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:56.273609 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9e7e5-0359-4cee-b4ed-d350568f1d97 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.273798 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c06e3-81d5-42fd-8edc-471987dbf9fe admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.274069 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c06e3-81d5-42fd-8edc-471987dbf9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.274345 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c06e3-81d5-42fd-8edc-471987dbf9fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.275084 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c06e3-81d5-42fd-8edc-471987dbf9fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:56.275368 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c06e3-81d5-42fd-8edc-471987dbf9fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.275460 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b9e7e5-0359-4cee-b4ed-d350568f1d97 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.277161 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c06e3-81d5-42fd-8edc-471987dbf9fe admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.293883 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 290/576] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:56.293883 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9e7e5-0359-4cee-b4ed-d350568f1d97 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.298759 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b9e7e5-0359-4cee-b4ed-d350568f1d97 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.299040 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 287/577] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:56.300106 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c06e3-81d5-42fd-8edc-471987dbf9fe admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.306662 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beedff9-d936-4add-aa50-da775abcce5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.307634 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beedff9-d936-4add-aa50-da775abcce5c admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.308013 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beedff9-d936-4add-aa50-da775abcce5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.308361 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beedff9-d936-4add-aa50-da775abcce5c admin admin] PATH_INFO: `/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/ff019ca0eef8455ba680191b8ae1fdba/roles/0660c2b0286b42c78d66c437b4713a2f` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.310297 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c06e3-81d5-42fd-8edc-471987dbf9fe admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.314740 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa134b-019e-4630-b5a6-214abb4304b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.315482 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa134b-019e-4630-b5a6-214abb4304b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.315832 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa134b-019e-4630-b5a6-214abb4304b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.316171 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa134b-019e-4630-b5a6-214abb4304b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.316988 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa134b-019e-4630-b5a6-214abb4304b7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:56.317397 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa134b-019e-4630-b5a6-214abb4304b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.319117 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa134b-019e-4630-b5a6-214abb4304b7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.323698 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beedff9-d936-4add-aa50-da775abcce5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4d0b5a3f7d4542a47a26e623500b4f, user_id=ff019ca0eef8455ba680191b8ae1fdba, role_id=0660c2b0286b42c78d66c437b4713a2f)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.327023 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beedff9-d936-4add-aa50-da775abcce5c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.332576 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 288/578] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:56.332576 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa134b-019e-4630-b5a6-214abb4304b7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.342941 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa134b-019e-4630-b5a6-214abb4304b7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.353337 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 291/579] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:20:56 2022] PUT /identity/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/ff019ca0eef8455ba680191b8ae1fdba/roles/0660c2b0286b42c78d66c437b4713a2f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:20:56.353337 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beedff9-d936-4add-aa50-da775abcce5c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.415382 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1b33a-72e5-402c-8b10-50078d967bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.417900 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1b33a-72e5-402c-8b10-50078d967bec admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.419057 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1b33a-72e5-402c-8b10-50078d967bec admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.419558 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1b33a-72e5-402c-8b10-50078d967bec admin admin] PATH_INFO: `/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/6522d231532a48ad8dbc9c9e79a021dd/roles/0660c2b0286b42c78d66c437b4713a2f` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.443010 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beedff9-d936-4add-aa50-da775abcce5c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.443621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1b33a-72e5-402c-8b10-50078d967bec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4d0b5a3f7d4542a47a26e623500b4f, user_id=6522d231532a48ad8dbc9c9e79a021dd, role_id=0660c2b0286b42c78d66c437b4713a2f)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.446886 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1b33a-72e5-402c-8b10-50078d967bec admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.448097 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15a5ad-e36d-4cf4-b124-9fd9b18af581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.449033 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15a5ad-e36d-4cf4-b124-9fd9b18af581 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.449705 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15a5ad-e36d-4cf4-b124-9fd9b18af581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.450056 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f15a5ad-e36d-4cf4-b124-9fd9b18af581 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.466701 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 289/580] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:20:56 2022] PUT /identity/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/6522d231532a48ad8dbc9c9e79a021dd/roles/0660c2b0286b42c78d66c437b4713a2f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:20:56.467608 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1b33a-72e5-402c-8b10-50078d967bec admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.470676 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15a5ad-e36d-4cf4-b124-9fd9b18af581 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.472903 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f15a5ad-e36d-4cf4-b124-9fd9b18af581 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.508175 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-7f15a5ad-e36d-4cf4-b124-9fd9b18af581 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:20:56.512282 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 292/581] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:56.520129 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15a5ad-e36d-4cf4-b124-9fd9b18af581 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.542060 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f15a5ad-e36d-4cf4-b124-9fd9b18af581 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.585886 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1b33a-72e5-402c-8b10-50078d967bec admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.591564 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4519d8-b851-435a-849b-e56589a8332f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.592479 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4519d8-b851-435a-849b-e56589a8332f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.592769 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4519d8-b851-435a-849b-e56589a8332f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.593081 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4519d8-b851-435a-849b-e56589a8332f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.604667 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4519d8-b851-435a-849b-e56589a8332f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.607747 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4519d8-b851-435a-849b-e56589a8332f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.612428 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6048773-f178-4c45-8be4-da27ae059e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.613514 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6048773-f178-4c45-8be4-da27ae059e46 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.613998 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6048773-f178-4c45-8be4-da27ae059e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.614468 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6048773-f178-4c45-8be4-da27ae059e46 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.615493 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6048773-f178-4c45-8be4-da27ae059e46 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:56.616010 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6048773-f178-4c45-8be4-da27ae059e46 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.618171 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6048773-f178-4c45-8be4-da27ae059e46 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.628745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-1b4519d8-b851-435a-849b-e56589a8332f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:56.630384 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 290/582] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:56.631845 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470790e0-deed-40f2-84e5-6d68f1bd0f9b None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.632315 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 293/583] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:56.637616 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470790e0-deed-40f2-84e5-6d68f1bd0f9b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.637923 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470790e0-deed-40f2-84e5-6d68f1bd0f9b None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.638812 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6048773-f178-4c45-8be4-da27ae059e46 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.640254 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 291/584] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:56.645710 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310be708-d498-4a1c-899f-0147a83697a0 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.646125 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310be708-d498-4a1c-899f-0147a83697a0 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.646510 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310be708-d498-4a1c-899f-0147a83697a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.654071 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6048773-f178-4c45-8be4-da27ae059e46 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.659055 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea9be0-c39e-4587-9088-d3cba000ac2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.660170 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea9be0-c39e-4587-9088-d3cba000ac2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.660594 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea9be0-c39e-4587-9088-d3cba000ac2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.661004 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea9be0-c39e-4587-9088-d3cba000ac2f admin admin] PATH_INFO: `/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/ba8e4a7763524f4190c5cd66e27b5910/roles/0660c2b0286b42c78d66c437b4713a2f` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.667711 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-310be708-d498-4a1c-899f-0147a83697a0 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:56.669034 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-310be708-d498-4a1c-899f-0147a83697a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:56.678332 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 292/585] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 05:20:56.679365 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310be708-d498-4a1c-899f-0147a83697a0 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.679568 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea9be0-c39e-4587-9088-d3cba000ac2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4d0b5a3f7d4542a47a26e623500b4f, user_id=ba8e4a7763524f4190c5cd66e27b5910, role_id=0660c2b0286b42c78d66c437b4713a2f)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.682706 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea9be0-c39e-4587-9088-d3cba000ac2f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.691852 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310be708-d498-4a1c-899f-0147a83697a0 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.696581 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162f2df-2689-4b68-98a8-8217815ac5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.697721 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162f2df-2689-4b68-98a8-8217815ac5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.698109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162f2df-2689-4b68-98a8-8217815ac5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.699713 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162f2df-2689-4b68-98a8-8217815ac5d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.700575 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 294/586] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:20:56 2022] PUT /identity/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/ba8e4a7763524f4190c5cd66e27b5910/roles/0660c2b0286b42c78d66c437b4713a2f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:20:56.700689 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162f2df-2689-4b68-98a8-8217815ac5d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:56.701126 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162f2df-2689-4b68-98a8-8217815ac5d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.702895 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162f2df-2689-4b68-98a8-8217815ac5d1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.705120 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea9be0-c39e-4587-9088-d3cba000ac2f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.724761 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 293/587] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:56.730706 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162f2df-2689-4b68-98a8-8217815ac5d1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.753652 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162f2df-2689-4b68-98a8-8217815ac5d1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.793686 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea9be0-c39e-4587-9088-d3cba000ac2f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.798718 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc8a29-503c-403f-b16d-1ba41baf09da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.799669 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc8a29-503c-403f-b16d-1ba41baf09da admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.800061 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc8a29-503c-403f-b16d-1ba41baf09da admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.800446 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc8a29-503c-403f-b16d-1ba41baf09da admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.813193 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc8a29-503c-403f-b16d-1ba41baf09da admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:56.820549 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-98bc8a29-503c-403f-b16d-1ba41baf09da admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 05:20:56.822358 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 295/588] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:56.830496 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc8a29-503c-403f-b16d-1ba41baf09da admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.834068 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39330ad-3510-4373-95eb-a45ac823efec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.835206 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39330ad-3510-4373-95eb-a45ac823efec admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.835690 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39330ad-3510-4373-95eb-a45ac823efec admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.836420 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39330ad-3510-4373-95eb-a45ac823efec admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.844279 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc8a29-503c-403f-b16d-1ba41baf09da admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.851579 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39330ad-3510-4373-95eb-a45ac823efec admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.855218 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39330ad-3510-4373-95eb-a45ac823efec admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.859152 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b065aa-d5a3-4e48-af27-e4729c451f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.860175 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b065aa-d5a3-4e48-af27-e4729c451f62 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.860633 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b065aa-d5a3-4e48-af27-e4729c451f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.861484 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b065aa-d5a3-4e48-af27-e4729c451f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.863321 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b065aa-d5a3-4e48-af27-e4729c451f62 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:56.864527 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b065aa-d5a3-4e48-af27-e4729c451f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.868397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b065aa-d5a3-4e48-af27-e4729c451f62 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.886361 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-e39330ad-3510-4373-95eb-a45ac823efec admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 16 05:20:56.892927 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 296/589] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:56.893733 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 294/590] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:56.897207 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b065aa-d5a3-4e48-af27-e4729c451f62 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.899603 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39330ad-3510-4373-95eb-a45ac823efec admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.915964 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b065aa-d5a3-4e48-af27-e4729c451f62 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.921109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39330ad-3510-4373-95eb-a45ac823efec admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.928794 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb39d3a-8ffd-4bc5-93b9-a0575ef2ba65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.930348 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb39d3a-8ffd-4bc5-93b9-a0575ef2ba65 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.931089 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dab9c4-7809-4260-b5a8-48860edd3fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.932002 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dab9c4-7809-4260-b5a8-48860edd3fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.932275 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dab9c4-7809-4260-b5a8-48860edd3fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.932542 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dab9c4-7809-4260-b5a8-48860edd3fc3 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.933408 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dab9c4-7809-4260-b5a8-48860edd3fc3 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:56.933741 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dab9c4-7809-4260-b5a8-48860edd3fc3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.934093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb39d3a-8ffd-4bc5-93b9-a0575ef2ba65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.934570 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb39d3a-8ffd-4bc5-93b9-a0575ef2ba65 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.936622 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dab9c4-7809-4260-b5a8-48860edd3fc3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.950001 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb39d3a-8ffd-4bc5-93b9-a0575ef2ba65 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:56.952236 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb39d3a-8ffd-4bc5-93b9-a0575ef2ba65 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:56.960039 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 295/591] 10.222.0.75 () {56 vars in 1160 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:56.968201 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dab9c4-7809-4260-b5a8-48860edd3fc3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.975216 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-2eb39d3a-8ffd-4bc5-93b9-a0575ef2ba65 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:56.976989 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 297/592] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:56.979262 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dab9c4-7809-4260-b5a8-48860edd3fc3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:56.982095 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb39d3a-8ffd-4bc5-93b9-a0575ef2ba65 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:56.985300 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f018dc-6511-436c-b73b-0f997b3c8f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:56.986378 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f018dc-6511-436c-b73b-0f997b3c8f31 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:56.986859 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f018dc-6511-436c-b73b-0f997b3c8f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:56.987360 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f018dc-6511-436c-b73b-0f997b3c8f31 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:56.997901 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb39d3a-8ffd-4bc5-93b9-a0575ef2ba65 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:57.000035 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f018dc-6511-436c-b73b-0f997b3c8f31 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:57.002758 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f018dc-6511-436c-b73b-0f997b3c8f31 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:57.004278 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279b7b6-8958-4ad7-916a-e0df68089727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:57.004933 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279b7b6-8958-4ad7-916a-e0df68089727 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:57.005313 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279b7b6-8958-4ad7-916a-e0df68089727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:57.005516 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279b7b6-8958-4ad7-916a-e0df68089727 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:57.006241 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279b7b6-8958-4ad7-916a-e0df68089727 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:57.006542 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279b7b6-8958-4ad7-916a-e0df68089727 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:57.008114 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279b7b6-8958-4ad7-916a-e0df68089727 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:57.022980 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-a9f018dc-6511-436c-b73b-0f997b3c8f31 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:57.024817 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 296/593] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:57.029009 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 298/594] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:57.031517 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f018dc-6511-436c-b73b-0f997b3c8f31 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:57.034252 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279b7b6-8958-4ad7-916a-e0df68089727 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:57.042493 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f018dc-6511-436c-b73b-0f997b3c8f31 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:57.047873 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373893a0-de8a-4133-a617-02e233e6e05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:57.048817 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373893a0-de8a-4133-a617-02e233e6e05b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:57.049366 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373893a0-de8a-4133-a617-02e233e6e05b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:57.049865 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373893a0-de8a-4133-a617-02e233e6e05b admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:57.050838 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373893a0-de8a-4133-a617-02e233e6e05b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:57.051373 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373893a0-de8a-4133-a617-02e233e6e05b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:57.053281 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373893a0-de8a-4133-a617-02e233e6e05b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:57.056554 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279b7b6-8958-4ad7-916a-e0df68089727 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:57.067283 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 297/595] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:57.072884 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373893a0-de8a-4133-a617-02e233e6e05b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:57.073000 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d7f46-f2a9-4d23-a4cf-284f1b0e66e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:57.073837 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d7f46-f2a9-4d23-a4cf-284f1b0e66e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:57.074114 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d7f46-f2a9-4d23-a4cf-284f1b0e66e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:57.074927 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d7f46-f2a9-4d23-a4cf-284f1b0e66e8 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:57.084367 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373893a0-de8a-4133-a617-02e233e6e05b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:57.089282 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cba0ab-24f7-4009-baba-7829f0f3f5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:57.090885 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cba0ab-24f7-4009-baba-7829f0f3f5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:57.091448 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cba0ab-24f7-4009-baba-7829f0f3f5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:57.092030 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cba0ab-24f7-4009-baba-7829f0f3f5b8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:57.095369 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d7f46-f2a9-4d23-a4cf-284f1b0e66e8 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:57.097425 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d7f46-f2a9-4d23-a4cf-284f1b0e66e8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:57.100222 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cba0ab-24f7-4009-baba-7829f0f3f5b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:57.102355 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cba0ab-24f7-4009-baba-7829f0f3f5b8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:57.111970 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-e20d7f46-f2a9-4d23-a4cf-284f1b0e66e8 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 05:20:57.113659 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 299/596] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:20:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:57.117315 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-31cba0ab-24f7-4009-baba-7829f0f3f5b8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:20:57.117967 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 298/597] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:57.119607 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d7f46-f2a9-4d23-a4cf-284f1b0e66e8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:57.123383 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cba0ab-24f7-4009-baba-7829f0f3f5b8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:57.133366 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d7f46-f2a9-4d23-a4cf-284f1b0e66e8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:57.135614 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cba0ab-24f7-4009-baba-7829f0f3f5b8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:57.138859 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230d933-1f40-4d8e-b0be-183d8f896275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:57.139723 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230d933-1f40-4d8e-b0be-183d8f896275 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:57.140206 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230d933-1f40-4d8e-b0be-183d8f896275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:57.140677 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230d933-1f40-4d8e-b0be-183d8f896275 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:57.141320 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f446137-54c0-4171-ad74-fafd14e89023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:57.142003 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230d933-1f40-4d8e-b0be-183d8f896275 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:57.142110 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f446137-54c0-4171-ad74-fafd14e89023 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:57.142289 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f446137-54c0-4171-ad74-fafd14e89023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:57.142615 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f446137-54c0-4171-ad74-fafd14e89023 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:57.142969 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230d933-1f40-4d8e-b0be-183d8f896275 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:57.143404 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f446137-54c0-4171-ad74-fafd14e89023 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:57.143758 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f446137-54c0-4171-ad74-fafd14e89023 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:57.145465 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230d933-1f40-4d8e-b0be-183d8f896275 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:57.145745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f446137-54c0-4171-ad74-fafd14e89023 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:57.166918 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 299/598] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:20:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:57.173359 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f446137-54c0-4171-ad74-fafd14e89023 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:57.187621 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 300/599] 10.222.0.75 () {56 vars in 1156 bytes} [Wed Feb 16 05:20:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:57.193470 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230d933-1f40-4d8e-b0be-183d8f896275 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:57.196847 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f446137-54c0-4171-ad74-fafd14e89023 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:57.204046 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230d933-1f40-4d8e-b0be-183d8f896275 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:57.205922 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3371c02-cc22-4111-9f26-a88eabdc731e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:57.207008 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3371c02-cc22-4111-9f26-a88eabdc731e admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:57.207292 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3371c02-cc22-4111-9f26-a88eabdc731e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:57.207578 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3371c02-cc22-4111-9f26-a88eabdc731e admin admin] PATH_INFO: `/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/fd4eac62484c47988657d2a730f2d056/roles/0660c2b0286b42c78d66c437b4713a2f` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:57.209599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c9387-d34a-4ef5-ae8c-8b5a5e77f8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:57.210685 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c9387-d34a-4ef5-ae8c-8b5a5e77f8fb admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:57.211165 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c9387-d34a-4ef5-ae8c-8b5a5e77f8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:57.211634 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c9387-d34a-4ef5-ae8c-8b5a5e77f8fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:57.229300 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c9387-d34a-4ef5-ae8c-8b5a5e77f8fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:57.231929 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c9387-d34a-4ef5-ae8c-8b5a5e77f8fb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:57.241847 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 301/600] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 05:20:57.246987 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3371c02-cc22-4111-9f26-a88eabdc731e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4d0b5a3f7d4542a47a26e623500b4f, user_id=fd4eac62484c47988657d2a730f2d056, role_id=0660c2b0286b42c78d66c437b4713a2f)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:57.248053 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c9387-d34a-4ef5-ae8c-8b5a5e77f8fb admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:57.254002 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3371c02-cc22-4111-9f26-a88eabdc731e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:57.257703 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c9387-d34a-4ef5-ae8c-8b5a5e77f8fb admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:57.262716 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645e8c0-ea8f-4467-9555-f60181e2bbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:57.263735 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645e8c0-ea8f-4467-9555-f60181e2bbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:57.264238 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645e8c0-ea8f-4467-9555-f60181e2bbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:57.264683 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645e8c0-ea8f-4467-9555-f60181e2bbe2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:57.276088 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645e8c0-ea8f-4467-9555-f60181e2bbe2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:57.278605 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645e8c0-ea8f-4467-9555-f60181e2bbe2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:57.289400 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 300/601] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:20:57 2022] PUT /identity/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/fd4eac62484c47988657d2a730f2d056/roles/0660c2b0286b42c78d66c437b4713a2f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:20:57.297740 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-0645e8c0-ea8f-4467-9555-f60181e2bbe2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:57.299621 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 302/602] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:57.305397 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3371c02-cc22-4111-9f26-a88eabdc731e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:57.410529 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3371c02-cc22-4111-9f26-a88eabdc731e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:57.419892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f6eb8-d69a-4b15-b317-a7d6d7067eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:57.420618 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f6eb8-d69a-4b15-b317-a7d6d7067eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:57.420845 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f6eb8-d69a-4b15-b317-a7d6d7067eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:57.421117 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f6eb8-d69a-4b15-b317-a7d6d7067eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:57.421952 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f6eb8-d69a-4b15-b317-a7d6d7067eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:57.422253 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f6eb8-d69a-4b15-b317-a7d6d7067eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:57.423949 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f6eb8-d69a-4b15-b317-a7d6d7067eb4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:57.442714 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 301/603] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:57.448542 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645e8c0-ea8f-4467-9555-f60181e2bbe2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:57.463219 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645e8c0-ea8f-4467-9555-f60181e2bbe2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:57.475831 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b98f6-51e0-435b-833c-318120777985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:57.476908 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b98f6-51e0-435b-833c-318120777985 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:57.477386 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b98f6-51e0-435b-833c-318120777985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:57.477856 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b98f6-51e0-435b-833c-318120777985 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:57.487068 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b98f6-51e0-435b-833c-318120777985 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:57.489236 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b98f6-51e0-435b-833c-318120777985 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:57.502991 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-064b98f6-51e0-435b-833c-318120777985 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:20:57.504676 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 303/604] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:57.510500 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f6eb8-d69a-4b15-b317-a7d6d7067eb4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:57.521213 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f6eb8-d69a-4b15-b317-a7d6d7067eb4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:57.526173 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1fe9d-16fe-4aff-aef2-913e43af3bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:57.527034 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1fe9d-16fe-4aff-aef2-913e43af3bdd admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:57.527552 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1fe9d-16fe-4aff-aef2-913e43af3bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:57.528016 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1fe9d-16fe-4aff-aef2-913e43af3bdd admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:57.529084 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1fe9d-16fe-4aff-aef2-913e43af3bdd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:57.529619 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1fe9d-16fe-4aff-aef2-913e43af3bdd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:57.531728 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1fe9d-16fe-4aff-aef2-913e43af3bdd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:57.545396 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 302/605] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:20:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:57.551397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b98f6-51e0-435b-833c-318120777985 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:57.563409 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b98f6-51e0-435b-833c-318120777985 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:57.568333 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f7bb6-4531-457c-a5d3-eb81c7075cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:57.569215 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f7bb6-4531-457c-a5d3-eb81c7075cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:57.569695 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f7bb6-4531-457c-a5d3-eb81c7075cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:57.570180 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f7bb6-4531-457c-a5d3-eb81c7075cd4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:57.571249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f7bb6-4531-457c-a5d3-eb81c7075cd4 admin admin] RBAC: Adding query filter params (role.id=0660c2b0286b42c78d66c437b4713a2f, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=92eb49cac0c94e73a70361831dd789b2) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:57.571766 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f7bb6-4531-457c-a5d3-eb81c7075cd4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:57.573866 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f7bb6-4531-457c-a5d3-eb81c7075cd4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:57.580661 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 304/606] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:57 2022] GET /identity/v3/role_assignments?user.id=92eb49cac0c94e73a70361831dd789b2&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=0660c2b0286b42c78d66c437b4713a2f => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:58.997795 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a9a97-c750-4b09-a073-d2df29152174 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:58.998776 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a9a97-c750-4b09-a073-d2df29152174 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:58.999257 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a9a97-c750-4b09-a073-d2df29152174 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.001530 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 303/607] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:59.006872 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cb044-289b-40ca-a354-cb0dbffa7083 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.007791 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cb044-289b-40ca-a354-cb0dbffa7083 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.008262 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cb044-289b-40ca-a354-cb0dbffa7083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.034480 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2b4cb044-289b-40ca-a354-cb0dbffa7083 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:59.035721 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2b4cb044-289b-40ca-a354-cb0dbffa7083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:59.044679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 305/608] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:59.084720 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a9a97-c750-4b09-a073-d2df29152174 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:59.107408 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a9a97-c750-4b09-a073-d2df29152174 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:59.112277 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d3806-74e7-4d02-8cfd-6814544cbf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:59.113408 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d3806-74e7-4d02-8cfd-6814544cbf90 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.113885 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d3806-74e7-4d02-8cfd-6814544cbf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.114350 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d3806-74e7-4d02-8cfd-6814544cbf90 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.130071 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d3806-74e7-4d02-8cfd-6814544cbf90 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:59.137324 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-586d3806-74e7-4d02-8cfd-6814544cbf90 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 05:20:59.138755 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 304/609] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:20:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:59.144481 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cb044-289b-40ca-a354-cb0dbffa7083 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:59.154181 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cb044-289b-40ca-a354-cb0dbffa7083 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:59.165911 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec6026-48e2-499a-8ab3-9b586bcbe987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:59.166572 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec6026-48e2-499a-8ab3-9b586bcbe987 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.166863 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec6026-48e2-499a-8ab3-9b586bcbe987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.167197 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec6026-48e2-499a-8ab3-9b586bcbe987 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.168564 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec6026-48e2-499a-8ab3-9b586bcbe987 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:59.168870 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec6026-48e2-499a-8ab3-9b586bcbe987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:59.170543 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec6026-48e2-499a-8ab3-9b586bcbe987 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:59.179338 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 306/610] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Feb 16 05:20:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:59.185146 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d3806-74e7-4d02-8cfd-6814544cbf90 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:59.196177 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d3806-74e7-4d02-8cfd-6814544cbf90 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:59.212246 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd1a60-5e88-4f05-b6c7-fbde1c4fbba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:59.213442 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd1a60-5e88-4f05-b6c7-fbde1c4fbba7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.213953 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd1a60-5e88-4f05-b6c7-fbde1c4fbba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.214432 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd1a60-5e88-4f05-b6c7-fbde1c4fbba7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.233138 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd1a60-5e88-4f05-b6c7-fbde1c4fbba7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:59.235595 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd1a60-5e88-4f05-b6c7-fbde1c4fbba7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:59.263609 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-4dbd1a60-5e88-4f05-b6c7-fbde1c4fbba7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:59.265155 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 305/611] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:59.270605 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec6026-48e2-499a-8ab3-9b586bcbe987 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:59.289899 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec6026-48e2-499a-8ab3-9b586bcbe987 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:59.298758 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df27c9-f445-409d-b043-6b00c99cf430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:59.299406 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df27c9-f445-409d-b043-6b00c99cf430 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.299682 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df27c9-f445-409d-b043-6b00c99cf430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.299945 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df27c9-f445-409d-b043-6b00c99cf430 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.300660 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df27c9-f445-409d-b043-6b00c99cf430 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:59.300956 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df27c9-f445-409d-b043-6b00c99cf430 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:59.302643 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df27c9-f445-409d-b043-6b00c99cf430 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:59.316048 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 307/612] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:59.321113 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd1a60-5e88-4f05-b6c7-fbde1c4fbba7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:59.331803 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd1a60-5e88-4f05-b6c7-fbde1c4fbba7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:59.346505 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e878e-481b-4e16-ba2a-0ee94569044a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:59.347640 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e878e-481b-4e16-ba2a-0ee94569044a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.348152 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e878e-481b-4e16-ba2a-0ee94569044a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.348621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e878e-481b-4e16-ba2a-0ee94569044a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.358268 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e878e-481b-4e16-ba2a-0ee94569044a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:59.360666 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e878e-481b-4e16-ba2a-0ee94569044a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:59.383249 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-3b1e878e-481b-4e16-ba2a-0ee94569044a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 16 05:20:59.385065 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 306/613] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:20:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:59.390367 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df27c9-f445-409d-b043-6b00c99cf430 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:59.401973 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df27c9-f445-409d-b043-6b00c99cf430 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:59.414881 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6a6c5-ba95-4259-a91f-c399c1d4e95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:59.415539 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6a6c5-ba95-4259-a91f-c399c1d4e95e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.415869 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6a6c5-ba95-4259-a91f-c399c1d4e95e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.416138 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6a6c5-ba95-4259-a91f-c399c1d4e95e admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.416968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6a6c5-ba95-4259-a91f-c399c1d4e95e admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:59.417345 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6a6c5-ba95-4259-a91f-c399c1d4e95e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:59.419769 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6a6c5-ba95-4259-a91f-c399c1d4e95e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:59.443071 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 308/614] 10.222.0.75 () {56 vars in 1158 bytes} [Wed Feb 16 05:20:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:59.448030 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e878e-481b-4e16-ba2a-0ee94569044a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:59.458880 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e878e-481b-4e16-ba2a-0ee94569044a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:59.470504 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569362bc-5b1c-4bbf-8ba3-4bf79db5545a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:59.471396 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569362bc-5b1c-4bbf-8ba3-4bf79db5545a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.471898 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569362bc-5b1c-4bbf-8ba3-4bf79db5545a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.472367 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569362bc-5b1c-4bbf-8ba3-4bf79db5545a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.485626 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569362bc-5b1c-4bbf-8ba3-4bf79db5545a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:59.487792 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569362bc-5b1c-4bbf-8ba3-4bf79db5545a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:59.502929 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 307/615] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:20:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:20:59.508416 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6a6c5-ba95-4259-a91f-c399c1d4e95e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:59.522031 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6a6c5-ba95-4259-a91f-c399c1d4e95e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:59.534134 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c17ed1-41f9-4f34-8fbc-124c77ed76cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:59.534967 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c17ed1-41f9-4f34-8fbc-124c77ed76cb admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.535246 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c17ed1-41f9-4f34-8fbc-124c77ed76cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.535514 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c17ed1-41f9-4f34-8fbc-124c77ed76cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.556953 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c17ed1-41f9-4f34-8fbc-124c77ed76cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:59.559546 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c17ed1-41f9-4f34-8fbc-124c77ed76cb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:59.566300 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed6672-4d57-47a4-a570-903a06f68c9a None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.566827 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed6672-4d57-47a4-a570-903a06f68c9a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.567321 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed6672-4d57-47a4-a570-903a06f68c9a None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.569570 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 308/616] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 05:20:59.574738 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2de2f8-b3cc-4b21-b226-6257ded26a79 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.575246 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2de2f8-b3cc-4b21-b226-6257ded26a79 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.575720 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2de2f8-b3cc-4b21-b226-6257ded26a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.582833 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-62c17ed1-41f9-4f34-8fbc-124c77ed76cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:59.584348 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 309/617] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:59.589514 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c17ed1-41f9-4f34-8fbc-124c77ed76cb admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:59.595046 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-7b2de2f8-b3cc-4b21-b226-6257ded26a79 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:59.596440 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7b2de2f8-b3cc-4b21-b226-6257ded26a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:59.599054 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c17ed1-41f9-4f34-8fbc-124c77ed76cb admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:59.606011 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 309/618] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:59.610707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c1574-dec5-4d13-8bc8-2726d9d0bb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:59.611363 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c1574-dec5-4d13-8bc8-2726d9d0bb88 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.611642 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c1574-dec5-4d13-8bc8-2726d9d0bb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.611958 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c1574-dec5-4d13-8bc8-2726d9d0bb88 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.612781 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c1574-dec5-4d13-8bc8-2726d9d0bb88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:59.613084 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c1574-dec5-4d13-8bc8-2726d9d0bb88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:59.614837 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c1574-dec5-4d13-8bc8-2726d9d0bb88 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:59.631876 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2de2f8-b3cc-4b21-b226-6257ded26a79 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:59.634536 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 310/619] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:20:59.643287 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c1574-dec5-4d13-8bc8-2726d9d0bb88 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:59.645501 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2de2f8-b3cc-4b21-b226-6257ded26a79 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:59.654030 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c1574-dec5-4d13-8bc8-2726d9d0bb88 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:59.659416 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c48469e-c914-455b-aee4-a8452cde50f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:59.660295 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48469e-c914-455b-aee4-a8452cde50f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.660676 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48469e-c914-455b-aee4-a8452cde50f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.660949 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c48469e-c914-455b-aee4-a8452cde50f9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.661520 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f4abb-c349-4cd7-b9f9-272f2aece7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:59.662557 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f4abb-c349-4cd7-b9f9-272f2aece7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.663031 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f4abb-c349-4cd7-b9f9-272f2aece7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.663493 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f4abb-c349-4cd7-b9f9-272f2aece7d2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.668860 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48469e-c914-455b-aee4-a8452cde50f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:59.671088 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c48469e-c914-455b-aee4-a8452cde50f9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:59.685699 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f4abb-c349-4cd7-b9f9-272f2aece7d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:59.686068 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-8c48469e-c914-455b-aee4-a8452cde50f9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:20:59.687599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 311/620] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:20:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:59.688901 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2415c-1bc1-4301-b35f-da0d2e57284f None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.689294 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2415c-1bc1-4301-b35f-da0d2e57284f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.689575 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2415c-1bc1-4301-b35f-da0d2e57284f None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.695302 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 312/621] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:20:59.695302 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2415c-1bc1-4301-b35f-da0d2e57284f None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:59.698756 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-044f4abb-c349-4cd7-b9f9-272f2aece7d2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 05:20:59.701076 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 310/622] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:20:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:20:59.707093 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf84fa3-c0ba-4d03-9844-79ac159f2835 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.707619 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf84fa3-c0ba-4d03-9844-79ac159f2835 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.708144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf84fa3-c0ba-4d03-9844-79ac159f2835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.708507 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2415c-1bc1-4301-b35f-da0d2e57284f None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:59.713218 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed6bbd-ee50-4310-85e5-31cb41494247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:59.713950 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed6bbd-ee50-4310-85e5-31cb41494247 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.714338 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed6bbd-ee50-4310-85e5-31cb41494247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.714679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ed6bbd-ee50-4310-85e5-31cb41494247 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.716158 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed6bbd-ee50-4310-85e5-31cb41494247 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:59.716521 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed6bbd-ee50-4310-85e5-31cb41494247 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:59.718604 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ed6bbd-ee50-4310-85e5-31cb41494247 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:59.731814 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 313/623] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:20:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:59.732898 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed6bbd-ee50-4310-85e5-31cb41494247 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:59.733725 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-9cf84fa3-c0ba-4d03-9844-79ac159f2835 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:20:59.735306 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9cf84fa3-c0ba-4d03-9844-79ac159f2835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:20:59.743249 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 311/624] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:20:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:20:59.749281 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ed6bbd-ee50-4310-85e5-31cb41494247 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:59.750524 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf84fa3-c0ba-4d03-9844-79ac159f2835 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:59.756992 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180debc0-b2cb-431c-9c81-c8a417c30a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:59.757766 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180debc0-b2cb-431c-9c81-c8a417c30a55 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.758102 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180debc0-b2cb-431c-9c81-c8a417c30a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.758422 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180debc0-b2cb-431c-9c81-c8a417c30a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.759208 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180debc0-b2cb-431c-9c81-c8a417c30a55 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:59.759504 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180debc0-b2cb-431c-9c81-c8a417c30a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:59.763487 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180debc0-b2cb-431c-9c81-c8a417c30a55 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:59.771209 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf84fa3-c0ba-4d03-9844-79ac159f2835 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:59.778752 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4983a-3fda-4b4f-a2c1-60cb261c1020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:59.779630 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4983a-3fda-4b4f-a2c1-60cb261c1020 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.779827 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 314/625] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Feb 16 05:20:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:59.780290 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4983a-3fda-4b4f-a2c1-60cb261c1020 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.780620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180debc0-b2cb-431c-9c81-c8a417c30a55 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:59.781061 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4983a-3fda-4b4f-a2c1-60cb261c1020 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.782235 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4983a-3fda-4b4f-a2c1-60cb261c1020 admin admin] RBAC: Adding query filter params (role.id=0660c2b0286b42c78d66c437b4713a2f, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=ff019ca0eef8455ba680191b8ae1fdba) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:59.782759 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4983a-3fda-4b4f-a2c1-60cb261c1020 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:59.784807 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4983a-3fda-4b4f-a2c1-60cb261c1020 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:59.790623 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180debc0-b2cb-431c-9c81-c8a417c30a55 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:59.795643 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64ca5e-6904-4d96-bcac-7931958b80eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:59.796413 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64ca5e-6904-4d96-bcac-7931958b80eb admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.796740 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64ca5e-6904-4d96-bcac-7931958b80eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.797003 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64ca5e-6904-4d96-bcac-7931958b80eb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.798223 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 312/626] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:20:59 2022] GET /identity/v3/role_assignments?user.id=ff019ca0eef8455ba680191b8ae1fdba&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=0660c2b0286b42c78d66c437b4713a2f => generated 608 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:59.799416 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4983a-3fda-4b4f-a2c1-60cb261c1020 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:59.816881 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64ca5e-6904-4d96-bcac-7931958b80eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:20:59.827631 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4983a-3fda-4b4f-a2c1-60cb261c1020 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:59.832414 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-6b64ca5e-6904-4d96-bcac-7931958b80eb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 05:20:59.836785 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 315/627] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:20:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:59.837558 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff02e9-953e-4397-a19b-d170cab8a64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:59.838475 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff02e9-953e-4397-a19b-d170cab8a64a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.838800 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff02e9-953e-4397-a19b-d170cab8a64a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.839072 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff02e9-953e-4397-a19b-d170cab8a64a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.843114 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64ca5e-6904-4d96-bcac-7931958b80eb admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:59.860103 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64ca5e-6904-4d96-bcac-7931958b80eb admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:59.866295 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff02e9-953e-4397-a19b-d170cab8a64a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:59.869925 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff02e9-953e-4397-a19b-d170cab8a64a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:59.872759 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e1f15-a62f-43c4-91ee-c812ee898b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:59.873463 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e1f15-a62f-43c4-91ee-c812ee898b5a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.874955 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e1f15-a62f-43c4-91ee-c812ee898b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.875352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e1f15-a62f-43c4-91ee-c812ee898b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.876116 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e1f15-a62f-43c4-91ee-c812ee898b5a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:59.876417 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e1f15-a62f-43c4-91ee-c812ee898b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:59.881661 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e1f15-a62f-43c4-91ee-c812ee898b5a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:59.907483 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 316/628] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Feb 16 05:20:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:59.908454 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e1f15-a62f-43c4-91ee-c812ee898b5a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:59.910675 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-88ff02e9-953e-4397-a19b-d170cab8a64a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:20:59.916514 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 313/629] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:20:59.922323 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff02e9-953e-4397-a19b-d170cab8a64a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:59.923777 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e1f15-a62f-43c4-91ee-c812ee898b5a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:59.936123 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff02e9-953e-4397-a19b-d170cab8a64a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:59.939195 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af43c1-20ce-4661-b398-a1624255eb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:59.940059 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af43c1-20ce-4661-b398-a1624255eb93 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.940334 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af43c1-20ce-4661-b398-a1624255eb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.940601 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af43c1-20ce-4661-b398-a1624255eb93 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.948702 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d8cbf-ccf5-4016-84bf-b78d1d1155e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:59.951023 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d8cbf-ccf5-4016-84bf-b78d1d1155e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.951343 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d8cbf-ccf5-4016-84bf-b78d1d1155e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.951608 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d8cbf-ccf5-4016-84bf-b78d1d1155e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:20:59.954147 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d8cbf-ccf5-4016-84bf-b78d1d1155e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:20:59.954507 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d8cbf-ccf5-4016-84bf-b78d1d1155e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:59.957995 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d8cbf-ccf5-4016-84bf-b78d1d1155e0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:59.969543 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af43c1-20ce-4661-b398-a1624255eb93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:20:59.971508 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af43c1-20ce-4661-b398-a1624255eb93 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:20:59.975361 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 314/630] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:20:59.981158 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d8cbf-ccf5-4016-84bf-b78d1d1155e0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:20:59.992204 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d8cbf-ccf5-4016-84bf-b78d1d1155e0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:20:59.997460 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0d547-50d3-4354-bd53-e7f76058739b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:20:59.998473 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0d547-50d3-4354-bd53-e7f76058739b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:20:59.999338 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0d547-50d3-4354-bd53-e7f76058739b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:20:59.999825 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0d547-50d3-4354-bd53-e7f76058739b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.000076 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-f5af43c1-20ce-4661-b398-a1624255eb93 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:00.003730 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 317/631] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:20:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:00.008805 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af43c1-20ce-4661-b398-a1624255eb93 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.010065 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0d547-50d3-4354-bd53-e7f76058739b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.012312 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0d547-50d3-4354-bd53-e7f76058739b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.018882 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af43c1-20ce-4661-b398-a1624255eb93 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.024159 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a87ad-78f8-44fb-8827-b99426949ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.024861 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a87ad-78f8-44fb-8827-b99426949ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.025146 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a87ad-78f8-44fb-8827-b99426949ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.025496 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a87ad-78f8-44fb-8827-b99426949ef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.026321 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a87ad-78f8-44fb-8827-b99426949ef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:00.026628 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a87ad-78f8-44fb-8827-b99426949ef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.028892 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a87ad-78f8-44fb-8827-b99426949ef7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.029595 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-ace0d547-50d3-4354-bd53-e7f76058739b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 05:21:00.032057 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 315/632] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Feb 16 05:20:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:00.037073 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0d547-50d3-4354-bd53-e7f76058739b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.041774 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 318/633] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:00.047703 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a87ad-78f8-44fb-8827-b99426949ef7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.051062 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0d547-50d3-4354-bd53-e7f76058739b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.056708 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f83f7-2fbc-47dd-8030-46bd6663e564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.057853 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f83f7-2fbc-47dd-8030-46bd6663e564 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.058294 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f83f7-2fbc-47dd-8030-46bd6663e564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.058727 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f83f7-2fbc-47dd-8030-46bd6663e564 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.059696 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f83f7-2fbc-47dd-8030-46bd6663e564 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:00.059866 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a87ad-78f8-44fb-8827-b99426949ef7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.060290 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f83f7-2fbc-47dd-8030-46bd6663e564 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.062341 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f83f7-2fbc-47dd-8030-46bd6663e564 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.066636 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb557e-bdca-43b8-b422-2614e87d98fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.066636 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb557e-bdca-43b8-b422-2614e87d98fe admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.066997 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb557e-bdca-43b8-b422-2614e87d98fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.067350 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb557e-bdca-43b8-b422-2614e87d98fe admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.078781 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb557e-bdca-43b8-b422-2614e87d98fe admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.080912 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb557e-bdca-43b8-b422-2614e87d98fe admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.088296 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 316/634] 10.222.0.75 () {56 vars in 1154 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:00.093886 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f83f7-2fbc-47dd-8030-46bd6663e564 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.098053 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-9cdb557e-bdca-43b8-b422-2614e87d98fe admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 16 05:21:00.099600 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 319/635] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:00.105080 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb557e-bdca-43b8-b422-2614e87d98fe admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.107230 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f83f7-2fbc-47dd-8030-46bd6663e564 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.113798 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d7b19-c98a-478b-a921-b6ff6a27c048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.114901 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d7b19-c98a-478b-a921-b6ff6a27c048 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.115385 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d7b19-c98a-478b-a921-b6ff6a27c048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.115868 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d7b19-c98a-478b-a921-b6ff6a27c048 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.116846 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb557e-bdca-43b8-b422-2614e87d98fe admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.122529 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5e638-48c0-426f-b620-657fc87340e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.123816 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5e638-48c0-426f-b620-657fc87340e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.124165 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5e638-48c0-426f-b620-657fc87340e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.124699 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5e638-48c0-426f-b620-657fc87340e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.125486 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d7b19-c98a-478b-a921-b6ff6a27c048 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.125659 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5e638-48c0-426f-b620-657fc87340e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:00.126002 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5e638-48c0-426f-b620-657fc87340e4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.127870 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d7b19-c98a-478b-a921-b6ff6a27c048 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.127992 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5e638-48c0-426f-b620-657fc87340e4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.140636 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 317/636] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 05:21:00.146265 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d7b19-c98a-478b-a921-b6ff6a27c048 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.147966 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 320/637] 10.222.0.75 () {56 vars in 1158 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:00.154204 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5e638-48c0-426f-b620-657fc87340e4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.156862 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d7b19-c98a-478b-a921-b6ff6a27c048 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.162552 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566ee7a-4946-4695-be28-fe814d756a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.163484 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566ee7a-4946-4695-be28-fe814d756a0e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.163901 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566ee7a-4946-4695-be28-fe814d756a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.164307 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566ee7a-4946-4695-be28-fe814d756a0e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.164752 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5e638-48c0-426f-b620-657fc87340e4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.170989 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8877d8-eef0-41f1-9f9a-e91e724a90a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.171752 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8877d8-eef0-41f1-9f9a-e91e724a90a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.172182 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8877d8-eef0-41f1-9f9a-e91e724a90a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.172553 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8877d8-eef0-41f1-9f9a-e91e724a90a3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.176938 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566ee7a-4946-4695-be28-fe814d756a0e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.178974 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566ee7a-4946-4695-be28-fe814d756a0e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.183509 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8877d8-eef0-41f1-9f9a-e91e724a90a3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.185554 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8877d8-eef0-41f1-9f9a-e91e724a90a3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.196266 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 321/638] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 05:21:00.199727 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-8566ee7a-4946-4695-be28-fe814d756a0e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:00.201166 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 318/639] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:00.202093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8877d8-eef0-41f1-9f9a-e91e724a90a3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.206590 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566ee7a-4946-4695-be28-fe814d756a0e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.211586 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8877d8-eef0-41f1-9f9a-e91e724a90a3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.219631 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566ee7a-4946-4695-be28-fe814d756a0e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.220858 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93421d0-5a67-44f8-9755-e9a8681d041f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.221764 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93421d0-5a67-44f8-9755-e9a8681d041f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.222115 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93421d0-5a67-44f8-9755-e9a8681d041f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.222459 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93421d0-5a67-44f8-9755-e9a8681d041f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.225954 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5ac9c-3bd1-4ef3-9510-a4d07afbb062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.226919 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5ac9c-3bd1-4ef3-9510-a4d07afbb062 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.227354 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5ac9c-3bd1-4ef3-9510-a4d07afbb062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.227795 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5ac9c-3bd1-4ef3-9510-a4d07afbb062 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.228731 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5ac9c-3bd1-4ef3-9510-a4d07afbb062 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:00.229035 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5ac9c-3bd1-4ef3-9510-a4d07afbb062 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.230905 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5ac9c-3bd1-4ef3-9510-a4d07afbb062 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.237831 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93421d0-5a67-44f8-9755-e9a8681d041f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.239879 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93421d0-5a67-44f8-9755-e9a8681d041f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.249319 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 319/640] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:00.251439 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf092b-dda9-47ae-be78-41c5c91d8a5f None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.251736 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf092b-dda9-47ae-be78-41c5c91d8a5f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.252008 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf092b-dda9-47ae-be78-41c5c91d8a5f None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.254348 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 320/641] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:00.255103 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf092b-dda9-47ae-be78-41c5c91d8a5f None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.263193 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-b93421d0-5a67-44f8-9755-e9a8681d041f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:00.264551 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 322/642] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:00.269301 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2ffb3-f898-46b4-8467-0bd8bee4895a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.269301 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2ffb3-f898-46b4-8467-0bd8bee4895a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.269301 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2ffb3-f898-46b4-8467-0bd8bee4895a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.280710 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf092b-dda9-47ae-be78-41c5c91d8a5f None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.285787 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9aac87-07b4-4978-b403-2cbeccbeb885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.285955 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4eb2ffb3-f898-46b4-8467-0bd8bee4895a None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:00.286865 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9aac87-07b4-4978-b403-2cbeccbeb885 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.287129 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4eb2ffb3-f898-46b4-8467-0bd8bee4895a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:00.287447 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9aac87-07b4-4978-b403-2cbeccbeb885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.287865 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9aac87-07b4-4978-b403-2cbeccbeb885 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.296368 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9aac87-07b4-4978-b403-2cbeccbeb885 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.296964 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 323/643] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:21:00.298014 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2ffb3-f898-46b4-8467-0bd8bee4895a None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.298971 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9aac87-07b4-4978-b403-2cbeccbeb885 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.309319 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2ffb3-f898-46b4-8467-0bd8bee4895a None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.313974 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a0e4b-2e97-418b-ac3f-c30df17c7ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.314710 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a0e4b-2e97-418b-ac3f-c30df17c7ada admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.315057 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a0e4b-2e97-418b-ac3f-c30df17c7ada admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.315427 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a0e4b-2e97-418b-ac3f-c30df17c7ada admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.316040 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-4f9aac87-07b4-4978-b403-2cbeccbeb885 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:21:00.316319 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a0e4b-2e97-418b-ac3f-c30df17c7ada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:00.316727 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a0e4b-2e97-418b-ac3f-c30df17c7ada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.317993 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 321/644] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:00.318665 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a0e4b-2e97-418b-ac3f-c30df17c7ada admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.323046 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9aac87-07b4-4978-b403-2cbeccbeb885 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.334910 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 324/645] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:00.334910 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a0e4b-2e97-418b-ac3f-c30df17c7ada admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.339396 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9aac87-07b4-4978-b403-2cbeccbeb885 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.343755 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a0e4b-2e97-418b-ac3f-c30df17c7ada admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.345539 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a105fb4-da74-444b-b677-0678de61c7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.346642 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a105fb4-da74-444b-b677-0678de61c7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.347168 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a105fb4-da74-444b-b677-0678de61c7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.347729 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a105fb4-da74-444b-b677-0678de61c7a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.348216 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8c7ef-22c9-4e54-957c-9519c8db42d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.348980 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8c7ef-22c9-4e54-957c-9519c8db42d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.349272 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8c7ef-22c9-4e54-957c-9519c8db42d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.349551 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8c7ef-22c9-4e54-957c-9519c8db42d9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.349731 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a105fb4-da74-444b-b677-0678de61c7a5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:00.350475 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a105fb4-da74-444b-b677-0678de61c7a5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.353232 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a105fb4-da74-444b-b677-0678de61c7a5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.361082 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8c7ef-22c9-4e54-957c-9519c8db42d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:21:00.368037 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 322/646] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:00.369161 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a105fb4-da74-444b-b677-0678de61c7a5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.369687 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-0be8c7ef-22c9-4e54-957c-9519c8db42d9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 05:21:00.371727 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 325/647] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:00.374136 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8c7ef-22c9-4e54-957c-9519c8db42d9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.380791 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a105fb4-da74-444b-b677-0678de61c7a5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.385248 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8c7ef-22c9-4e54-957c-9519c8db42d9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.386858 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2fb6a-98f7-4d67-afc8-bc7c13e96a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.388235 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2fb6a-98f7-4d67-afc8-bc7c13e96a4f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.388757 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2fb6a-98f7-4d67-afc8-bc7c13e96a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.389231 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2fb6a-98f7-4d67-afc8-bc7c13e96a4f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.389892 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d134f1-2776-47be-83a8-5cfafd08932d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.390681 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d134f1-2776-47be-83a8-5cfafd08932d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.390954 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d134f1-2776-47be-83a8-5cfafd08932d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.391230 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d134f1-2776-47be-83a8-5cfafd08932d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.392037 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d134f1-2776-47be-83a8-5cfafd08932d admin admin] RBAC: Adding query filter params (role.id=0660c2b0286b42c78d66c437b4713a2f, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=6522d231532a48ad8dbc9c9e79a021dd) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:00.392339 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d134f1-2776-47be-83a8-5cfafd08932d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.394707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d134f1-2776-47be-83a8-5cfafd08932d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.400061 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2fb6a-98f7-4d67-afc8-bc7c13e96a4f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.401319 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 326/648] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/role_assignments?user.id=6522d231532a48ad8dbc9c9e79a021dd&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=0660c2b0286b42c78d66c437b4713a2f => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:00.402271 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d134f1-2776-47be-83a8-5cfafd08932d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.403425 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2fb6a-98f7-4d67-afc8-bc7c13e96a4f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.413102 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d134f1-2776-47be-83a8-5cfafd08932d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.417726 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d76930-9679-4669-af80-77c67410a5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.418937 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d76930-9679-4669-af80-77c67410a5ac admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.419211 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d76930-9679-4669-af80-77c67410a5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.419481 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d76930-9679-4669-af80-77c67410a5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.420238 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d76930-9679-4669-af80-77c67410a5ac admin admin] RBAC: Adding query filter params (name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:00.420536 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d76930-9679-4669-af80-77c67410a5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.422211 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d76930-9679-4669-af80-77c67410a5ac admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.422977 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-07c2fb6a-98f7-4d67-afc8-bc7c13e96a4f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:21:00.429795 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 323/649] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:00.432287 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2fb6a-98f7-4d67-afc8-bc7c13e96a4f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.434304 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 327/650] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:00.442461 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d76930-9679-4669-af80-77c67410a5ac admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.450153 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2fb6a-98f7-4d67-afc8-bc7c13e96a4f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.462816 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80cb0a-25a3-40ee-ade7-3df5b176df48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.464093 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80cb0a-25a3-40ee-ade7-3df5b176df48 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.465589 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80cb0a-25a3-40ee-ade7-3df5b176df48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.466858 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d76930-9679-4669-af80-77c67410a5ac admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.467224 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80cb0a-25a3-40ee-ade7-3df5b176df48 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.468292 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80cb0a-25a3-40ee-ade7-3df5b176df48 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:00.469564 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80cb0a-25a3-40ee-ade7-3df5b176df48 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.472649 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80cb0a-25a3-40ee-ade7-3df5b176df48 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.479275 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfb0fc-8098-4a03-b465-1663cd12af86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.481348 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfb0fc-8098-4a03-b465-1663cd12af86 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.483098 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfb0fc-8098-4a03-b465-1663cd12af86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.484768 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfb0fc-8098-4a03-b465-1663cd12af86 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.503971 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 324/651] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:00.509633 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfb0fc-8098-4a03-b465-1663cd12af86 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.511931 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfb0fc-8098-4a03-b465-1663cd12af86 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.514775 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80cb0a-25a3-40ee-ade7-3df5b176df48 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.531716 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80cb0a-25a3-40ee-ade7-3df5b176df48 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.543709 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e792d-589b-4bef-ac06-fcb0c7160fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.545417 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e792d-589b-4bef-ac06-fcb0c7160fdf admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.547198 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e792d-589b-4bef-ac06-fcb0c7160fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.547683 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e792d-589b-4bef-ac06-fcb0c7160fdf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.548826 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e792d-589b-4bef-ac06-fcb0c7160fdf admin admin] RBAC: Adding query filter params (role.id=0660c2b0286b42c78d66c437b4713a2f, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=ba8e4a7763524f4190c5cd66e27b5910) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:00.551588 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e792d-589b-4bef-ac06-fcb0c7160fdf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.553842 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e792d-589b-4bef-ac06-fcb0c7160fdf admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.558720 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-7bdfb0fc-8098-4a03-b465-1663cd12af86 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:00.560916 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 328/652] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:00.565970 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 325/653] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/role_assignments?user.id=ba8e4a7763524f4190c5cd66e27b5910&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=0660c2b0286b42c78d66c437b4713a2f => generated 608 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:00.567286 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfb0fc-8098-4a03-b465-1663cd12af86 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.583823 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfb0fc-8098-4a03-b465-1663cd12af86 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.592759 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49907fa3-c421-4434-aa1e-d951c4f96591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.593878 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49907fa3-c421-4434-aa1e-d951c4f96591 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.594437 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49907fa3-c421-4434-aa1e-d951c4f96591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.594915 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49907fa3-c421-4434-aa1e-d951c4f96591 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.595930 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49907fa3-c421-4434-aa1e-d951c4f96591 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:00.596467 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49907fa3-c421-4434-aa1e-d951c4f96591 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.598447 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49907fa3-c421-4434-aa1e-d951c4f96591 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.612486 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 329/654] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:00.618066 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e792d-589b-4bef-ac06-fcb0c7160fdf admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.628957 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e792d-589b-4bef-ac06-fcb0c7160fdf admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.633895 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b53323-5e2d-467e-9ba9-634f30efafb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.634760 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b53323-5e2d-467e-9ba9-634f30efafb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.635041 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b53323-5e2d-467e-9ba9-634f30efafb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.635317 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b53323-5e2d-467e-9ba9-634f30efafb9 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.640793 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bebf1-7839-4f95-b9bc-26582f43f463 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.641075 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bebf1-7839-4f95-b9bc-26582f43f463 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.641382 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bebf1-7839-4f95-b9bc-26582f43f463 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.643468 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 330/655] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 05:21:00.648813 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b53323-5e2d-467e-9ba9-634f30efafb9 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.650997 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b4382-daa3-4dcd-9b00-cc984576a35d None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.651288 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b4382-daa3-4dcd-9b00-cc984576a35d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.651620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b4382-daa3-4dcd-9b00-cc984576a35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.652031 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b53323-5e2d-467e-9ba9-634f30efafb9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.669303 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-99b53323-5e2d-467e-9ba9-634f30efafb9 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 16 05:21:00.673098 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 326/656] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:00.682222 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b53323-5e2d-467e-9ba9-634f30efafb9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.684473 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-5b8b4382-daa3-4dcd-9b00-cc984576a35d None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:00.690542 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5b8b4382-daa3-4dcd-9b00-cc984576a35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:00.696827 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b53323-5e2d-467e-9ba9-634f30efafb9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.700186 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 331/657] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:21:00.708825 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cec792-36d6-466a-9eee-107feae1978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.709567 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cec792-36d6-466a-9eee-107feae1978e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.709848 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cec792-36d6-466a-9eee-107feae1978e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.710219 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cec792-36d6-466a-9eee-107feae1978e admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.711196 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cec792-36d6-466a-9eee-107feae1978e admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:00.714444 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cec792-36d6-466a-9eee-107feae1978e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.714444 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cec792-36d6-466a-9eee-107feae1978e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.731743 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b4382-daa3-4dcd-9b00-cc984576a35d None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.741575 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 327/658] 10.222.0.75 () {56 vars in 1160 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:00.743422 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b4382-daa3-4dcd-9b00-cc984576a35d None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.748816 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cec792-36d6-466a-9eee-107feae1978e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.752637 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d8d0c-959f-4f16-9346-edd5485499ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.753801 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d8d0c-959f-4f16-9346-edd5485499ef admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.754293 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d8d0c-959f-4f16-9346-edd5485499ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.755002 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d8d0c-959f-4f16-9346-edd5485499ef admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.759972 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cec792-36d6-466a-9eee-107feae1978e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.766346 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbbbcd-9a1a-4a1b-af6b-03601214ca95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.766826 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbbbcd-9a1a-4a1b-af6b-03601214ca95 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.767108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbbbcd-9a1a-4a1b-af6b-03601214ca95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.767431 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bbbbcd-9a1a-4a1b-af6b-03601214ca95 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.770756 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d8d0c-959f-4f16-9346-edd5485499ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:21:00.776704 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbbbcd-9a1a-4a1b-af6b-03601214ca95 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.778706 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bbbbcd-9a1a-4a1b-af6b-03601214ca95 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.779870 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-4c5d8d0c-959f-4f16-9346-edd5485499ef admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 05:21:00.781661 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 332/659] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:00.788357 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d8d0c-959f-4f16-9346-edd5485499ef admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.792309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 328/660] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:21:00.798114 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbbbcd-9a1a-4a1b-af6b-03601214ca95 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.800014 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d8d0c-959f-4f16-9346-edd5485499ef admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.806859 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb526b-e51d-4f19-9cf1-6dea9c3bb557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.808026 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb526b-e51d-4f19-9cf1-6dea9c3bb557 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.809745 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb526b-e51d-4f19-9cf1-6dea9c3bb557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.810199 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb526b-e51d-4f19-9cf1-6dea9c3bb557 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.810315 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bbbbcd-9a1a-4a1b-af6b-03601214ca95 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.811318 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb526b-e51d-4f19-9cf1-6dea9c3bb557 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:00.811908 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb526b-e51d-4f19-9cf1-6dea9c3bb557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.813866 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb526b-e51d-4f19-9cf1-6dea9c3bb557 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.815762 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8cc10-9210-4459-a9de-36f93cd3dc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.816605 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8cc10-9210-4459-a9de-36f93cd3dc83 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.816886 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8cc10-9210-4459-a9de-36f93cd3dc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.817497 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8cc10-9210-4459-a9de-36f93cd3dc83 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.826048 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 333/661] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:00.831691 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8cc10-9210-4459-a9de-36f93cd3dc83 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.832849 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb526b-e51d-4f19-9cf1-6dea9c3bb557 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.833799 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8cc10-9210-4459-a9de-36f93cd3dc83 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.844145 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb526b-e51d-4f19-9cf1-6dea9c3bb557 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.852266 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569be6a1-a34f-4ca2-8dbf-94ed18698a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.852417 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569be6a1-a34f-4ca2-8dbf-94ed18698a02 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.852631 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569be6a1-a34f-4ca2-8dbf-94ed18698a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.852897 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569be6a1-a34f-4ca2-8dbf-94ed18698a02 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.854596 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-0db8cc10-9210-4459-a9de-36f93cd3dc83 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:00.857421 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 329/662] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:00.862143 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8cc10-9210-4459-a9de-36f93cd3dc83 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.865653 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569be6a1-a34f-4ca2-8dbf-94ed18698a02 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.867543 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569be6a1-a34f-4ca2-8dbf-94ed18698a02 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.874569 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8cc10-9210-4459-a9de-36f93cd3dc83 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.880315 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511bea4-d831-415a-abc0-61dcdc2a22e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.881210 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511bea4-d831-415a-abc0-61dcdc2a22e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.881721 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511bea4-d831-415a-abc0-61dcdc2a22e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.882190 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511bea4-d831-415a-abc0-61dcdc2a22e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.883118 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511bea4-d831-415a-abc0-61dcdc2a22e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:00.883429 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511bea4-d831-415a-abc0-61dcdc2a22e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.885046 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511bea4-d831-415a-abc0-61dcdc2a22e7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.888604 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-569be6a1-a34f-4ca2-8dbf-94ed18698a02 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:00.890224 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 334/663] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:00.896173 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569be6a1-a34f-4ca2-8dbf-94ed18698a02 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.898265 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 330/664] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:00.903983 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511bea4-d831-415a-abc0-61dcdc2a22e7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.907815 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569be6a1-a34f-4ca2-8dbf-94ed18698a02 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.913297 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c27f7-75d4-4163-9388-e94459b90899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.913946 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c27f7-75d4-4163-9388-e94459b90899 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.914222 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c27f7-75d4-4163-9388-e94459b90899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.914493 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c27f7-75d4-4163-9388-e94459b90899 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.914996 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511bea4-d831-415a-abc0-61dcdc2a22e7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.915209 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c27f7-75d4-4163-9388-e94459b90899 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:00.915510 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c27f7-75d4-4163-9388-e94459b90899 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.917327 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c27f7-75d4-4163-9388-e94459b90899 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.920419 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eff44-dfb1-4504-afe6-9bd63d4777a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.921827 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eff44-dfb1-4504-afe6-9bd63d4777a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.922108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eff44-dfb1-4504-afe6-9bd63d4777a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.922376 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eff44-dfb1-4504-afe6-9bd63d4777a9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.931645 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659eff44-dfb1-4504-afe6-9bd63d4777a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.932008 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 335/665] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:00.934333 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659eff44-dfb1-4504-afe6-9bd63d4777a9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.938780 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c27f7-75d4-4163-9388-e94459b90899 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.951585 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c27f7-75d4-4163-9388-e94459b90899 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.951885 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-659eff44-dfb1-4504-afe6-9bd63d4777a9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:21:00.953395 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 331/666] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:00.959038 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eff44-dfb1-4504-afe6-9bd63d4777a9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:00.963836 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02195e-4c79-4e18-bd23-04bfc4f25847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.965428 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02195e-4c79-4e18-bd23-04bfc4f25847 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.965840 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02195e-4c79-4e18-bd23-04bfc4f25847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.966203 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02195e-4c79-4e18-bd23-04bfc4f25847 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.973455 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eff44-dfb1-4504-afe6-9bd63d4777a9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:00.975959 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02195e-4c79-4e18-bd23-04bfc4f25847 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.978359 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac472b7-efd7-4c8d-8f7c-6befa8ca7713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:00.978589 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02195e-4c79-4e18-bd23-04bfc4f25847 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.979339 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac472b7-efd7-4c8d-8f7c-6befa8ca7713 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:00.979761 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac472b7-efd7-4c8d-8f7c-6befa8ca7713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:00.980175 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac472b7-efd7-4c8d-8f7c-6befa8ca7713 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:00.981127 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac472b7-efd7-4c8d-8f7c-6befa8ca7713 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:00.981637 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac472b7-efd7-4c8d-8f7c-6befa8ca7713 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:00.983631 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac472b7-efd7-4c8d-8f7c-6befa8ca7713 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:00.993807 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-de02195e-4c79-4e18-bd23-04bfc4f25847 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 05:21:00.995135 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 336/667] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:01.000908 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 332/668] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:21:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:01.001761 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02195e-4c79-4e18-bd23-04bfc4f25847 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:01.007428 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac472b7-efd7-4c8d-8f7c-6befa8ca7713 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:01.012317 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02195e-4c79-4e18-bd23-04bfc4f25847 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:01.017796 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc9877-9f32-4afd-a411-e6c684336ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:01.018443 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc9877-9f32-4afd-a411-e6c684336ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:01.018719 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc9877-9f32-4afd-a411-e6c684336ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:01.018990 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc9877-9f32-4afd-a411-e6c684336ed4 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:01.019824 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc9877-9f32-4afd-a411-e6c684336ed4 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:01.020125 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc9877-9f32-4afd-a411-e6c684336ed4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:01.020823 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac472b7-efd7-4c8d-8f7c-6befa8ca7713 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:01.022012 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc9877-9f32-4afd-a411-e6c684336ed4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:01.026913 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35dbf7d-4d8d-4065-8bce-a4c222d3405e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:01.028400 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dbf7d-4d8d-4065-8bce-a4c222d3405e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:01.028881 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dbf7d-4d8d-4065-8bce-a4c222d3405e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:01.029496 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dbf7d-4d8d-4065-8bce-a4c222d3405e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:01.030532 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35dbf7d-4d8d-4065-8bce-a4c222d3405e admin admin] RBAC: Adding query filter params (role.id=0660c2b0286b42c78d66c437b4713a2f, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=fd4eac62484c47988657d2a730f2d056) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:01.031425 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35dbf7d-4d8d-4065-8bce-a4c222d3405e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:01.034771 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35dbf7d-4d8d-4065-8bce-a4c222d3405e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:01.042574 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 333/669] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:21:01 2022] GET /identity/v3/role_assignments?user.id=fd4eac62484c47988657d2a730f2d056&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=0660c2b0286b42c78d66c437b4713a2f => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:01.049297 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 337/670] 10.222.0.75 () {56 vars in 1156 bytes} [Wed Feb 16 05:21:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:01.050869 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35dbf7d-4d8d-4065-8bce-a4c222d3405e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:01.063720 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35dbf7d-4d8d-4065-8bce-a4c222d3405e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:01.068915 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354aec0-f76f-4a20-8a00-ef32047245a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:01.069864 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354aec0-f76f-4a20-8a00-ef32047245a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:01.070217 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354aec0-f76f-4a20-8a00-ef32047245a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:01.070798 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354aec0-f76f-4a20-8a00-ef32047245a5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:01.086090 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354aec0-f76f-4a20-8a00-ef32047245a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:01.088057 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354aec0-f76f-4a20-8a00-ef32047245a5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:01.107052 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-4354aec0-f76f-4a20-8a00-ef32047245a5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:01.113428 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 334/671] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:01.114503 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc9877-9f32-4afd-a411-e6c684336ed4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:01.135258 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc9877-9f32-4afd-a411-e6c684336ed4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:01.143170 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59ce8e-d98e-4ea7-bd1b-88499511ce02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:01.144115 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59ce8e-d98e-4ea7-bd1b-88499511ce02 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:01.144616 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59ce8e-d98e-4ea7-bd1b-88499511ce02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:01.145081 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59ce8e-d98e-4ea7-bd1b-88499511ce02 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:01.146030 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59ce8e-d98e-4ea7-bd1b-88499511ce02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:01.146544 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59ce8e-d98e-4ea7-bd1b-88499511ce02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:01.148342 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c59ce8e-d98e-4ea7-bd1b-88499511ce02 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:01.166966 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 338/672] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:01.172742 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354aec0-f76f-4a20-8a00-ef32047245a5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:01.187453 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354aec0-f76f-4a20-8a00-ef32047245a5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:01.199144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82a3f7-7326-4f3c-aa53-dc94ee4cacbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:01.200007 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82a3f7-7326-4f3c-aa53-dc94ee4cacbc admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:01.200284 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82a3f7-7326-4f3c-aa53-dc94ee4cacbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:01.200555 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82a3f7-7326-4f3c-aa53-dc94ee4cacbc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:01.210762 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82a3f7-7326-4f3c-aa53-dc94ee4cacbc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:01.212856 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82a3f7-7326-4f3c-aa53-dc94ee4cacbc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:01.236483 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-2d82a3f7-7326-4f3c-aa53-dc94ee4cacbc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:21:01.237770 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 335/673] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:01.243419 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59ce8e-d98e-4ea7-bd1b-88499511ce02 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:01.258404 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59ce8e-d98e-4ea7-bd1b-88499511ce02 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:01.272357 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67527a-9aea-41aa-95f9-dda2dcb6dc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:01.273444 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67527a-9aea-41aa-95f9-dda2dcb6dc3b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:01.273954 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67527a-9aea-41aa-95f9-dda2dcb6dc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:01.274426 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67527a-9aea-41aa-95f9-dda2dcb6dc3b admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:01.275419 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67527a-9aea-41aa-95f9-dda2dcb6dc3b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:01.275924 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67527a-9aea-41aa-95f9-dda2dcb6dc3b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:01.278552 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67527a-9aea-41aa-95f9-dda2dcb6dc3b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:01.300856 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 339/674] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:21:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:01.307026 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82a3f7-7326-4f3c-aa53-dc94ee4cacbc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:01.318257 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82a3f7-7326-4f3c-aa53-dc94ee4cacbc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:01.323788 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3c136-81e9-47f6-9cb9-053d7e3fba69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:01.324931 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3c136-81e9-47f6-9cb9-053d7e3fba69 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:01.325468 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3c136-81e9-47f6-9cb9-053d7e3fba69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:01.325941 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3c136-81e9-47f6-9cb9-053d7e3fba69 admin admin] PATH_INFO: `/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/92eb49cac0c94e73a70361831dd789b2/roles/0660c2b0286b42c78d66c437b4713a2f` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:01.345579 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3c136-81e9-47f6-9cb9-053d7e3fba69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4d0b5a3f7d4542a47a26e623500b4f, user_id=92eb49cac0c94e73a70361831dd789b2, role_id=0660c2b0286b42c78d66c437b4713a2f)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:01.348564 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3c136-81e9-47f6-9cb9-053d7e3fba69 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:01.378976 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 336/675] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:21:01 2022] PUT /identity/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/92eb49cac0c94e73a70361831dd789b2/roles/0660c2b0286b42c78d66c437b4713a2f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:21:02.581812 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a33260-e90c-41cb-beb4-e6e94de2d965 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:02.582324 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a33260-e90c-41cb-beb4-e6e94de2d965 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:02.582400 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a33260-e90c-41cb-beb4-e6e94de2d965 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:02.584282 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 340/676] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:02.589775 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dd092-80ce-49d8-9fa1-d40167b3e7af None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:02.590163 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dd092-80ce-49d8-9fa1-d40167b3e7af None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:02.590325 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dd092-80ce-49d8-9fa1-d40167b3e7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:02.614237 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-396dd092-80ce-49d8-9fa1-d40167b3e7af None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:02.615437 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-396dd092-80ce-49d8-9fa1-d40167b3e7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:02.684606 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 337/677] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:21:02.726787 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a33260-e90c-41cb-beb4-e6e94de2d965 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:02.742942 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a33260-e90c-41cb-beb4-e6e94de2d965 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:02.747515 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0785547-d4de-4326-ad1b-a7271d4faf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:02.748310 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0785547-d4de-4326-ad1b-a7271d4faf1e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:02.748590 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0785547-d4de-4326-ad1b-a7271d4faf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:02.748972 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0785547-d4de-4326-ad1b-a7271d4faf1e admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:02.749665 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0785547-d4de-4326-ad1b-a7271d4faf1e admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:02.750680 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-d0785547-d4de-4326-ad1b-a7271d4faf1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:21:02.750680 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Feb 16 05:21:02.750680 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: Feb 16 05:21:02.751563 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0785547-d4de-4326-ad1b-a7271d4faf1e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:02.770527 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-d0785547-d4de-4326-ad1b-a7271d4faf1e admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 16 05:21:02.772030 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 341/678] 10.222.0.75 () {56 vars in 1150 bytes} [Wed Feb 16 05:21:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:02.778575 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396dd092-80ce-49d8-9fa1-d40167b3e7af None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:02.787719 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396dd092-80ce-49d8-9fa1-d40167b3e7af None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:02.797630 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511e108-705f-4683-9c17-61bb6c0bbbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:02.798294 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511e108-705f-4683-9c17-61bb6c0bbbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:02.798577 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511e108-705f-4683-9c17-61bb6c0bbbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:02.798855 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511e108-705f-4683-9c17-61bb6c0bbbf0 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:02.799576 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511e108-705f-4683-9c17-61bb6c0bbbf0 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:02.799878 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511e108-705f-4683-9c17-61bb6c0bbbf0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:02.800908 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-8511e108-705f-4683-9c17-61bb6c0bbbf0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:21:02.800908 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Feb 16 05:21:02.800908 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: Feb 16 05:21:02.801814 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511e108-705f-4683-9c17-61bb6c0bbbf0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:02.806884 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 338/679] 10.222.0.75 () {56 vars in 1145 bytes} [Wed Feb 16 05:21:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:02.813348 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0785547-d4de-4326-ad1b-a7271d4faf1e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:02.827474 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0785547-d4de-4326-ad1b-a7271d4faf1e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:02.836243 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37459c-05ee-4a97-ae6e-a1ac4223e57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:02.836854 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37459c-05ee-4a97-ae6e-a1ac4223e57e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:02.837133 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37459c-05ee-4a97-ae6e-a1ac4223e57e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:02.837437 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37459c-05ee-4a97-ae6e-a1ac4223e57e admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:02.838179 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37459c-05ee-4a97-ae6e-a1ac4223e57e admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:02.838484 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37459c-05ee-4a97-ae6e-a1ac4223e57e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:02.839524 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-6d37459c-05ee-4a97-ae6e-a1ac4223e57e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:21:02.839524 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Feb 16 05:21:02.839524 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: Feb 16 05:21:02.840468 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d37459c-05ee-4a97-ae6e-a1ac4223e57e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:02.849930 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 342/680] 10.222.0.75 () {56 vars in 1145 bytes} [Wed Feb 16 05:21:02 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:03.486860 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381ecaa-2059-4773-a4c0-b8ef18b8d9d6 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:03.487571 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381ecaa-2059-4773-a4c0-b8ef18b8d9d6 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:03.488065 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381ecaa-2059-4773-a4c0-b8ef18b8d9d6 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:03.490359 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 339/681] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:03.495405 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932baa0-d6e5-4102-a239-7fa320e9ac01 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:03.495997 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932baa0-d6e5-4102-a239-7fa320e9ac01 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:03.496505 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932baa0-d6e5-4102-a239-7fa320e9ac01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:03.517396 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-c932baa0-d6e5-4102-a239-7fa320e9ac01 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:03.518905 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c932baa0-d6e5-4102-a239-7fa320e9ac01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:03.532238 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 343/682] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:21:03.556668 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381ecaa-2059-4773-a4c0-b8ef18b8d9d6 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:03.575081 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381ecaa-2059-4773-a4c0-b8ef18b8d9d6 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:03.585401 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6753fb-dda5-4fa6-8b12-e7225f101ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:03.586181 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6753fb-dda5-4fa6-8b12-e7225f101ded admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:03.586461 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6753fb-dda5-4fa6-8b12-e7225f101ded admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:03.586728 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6753fb-dda5-4fa6-8b12-e7225f101ded admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:03.606850 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6753fb-dda5-4fa6-8b12-e7225f101ded admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:21:03.613822 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-fe6753fb-dda5-4fa6-8b12-e7225f101ded admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:21:03.615326 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 340/683] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:21:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:03.621195 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932baa0-d6e5-4102-a239-7fa320e9ac01 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:03.634214 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932baa0-d6e5-4102-a239-7fa320e9ac01 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:03.646756 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3e3fc-4b47-4f90-8d24-b1ef4e161e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:03.647683 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3e3fc-4b47-4f90-8d24-b1ef4e161e81 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:03.648162 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3e3fc-4b47-4f90-8d24-b1ef4e161e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:03.648631 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3e3fc-4b47-4f90-8d24-b1ef4e161e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:03.649676 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3e3fc-4b47-4f90-8d24-b1ef4e161e81 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:03.650180 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3e3fc-4b47-4f90-8d24-b1ef4e161e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:03.652019 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3e3fc-4b47-4f90-8d24-b1ef4e161e81 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:03.677284 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 344/684] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:21:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:03.679140 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6753fb-dda5-4fa6-8b12-e7225f101ded admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:03.698288 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6753fb-dda5-4fa6-8b12-e7225f101ded admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:03.710437 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86358d9e-7737-4f72-9a24-5e2e5c876e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:03.711226 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86358d9e-7737-4f72-9a24-5e2e5c876e37 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:03.711510 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86358d9e-7737-4f72-9a24-5e2e5c876e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:03.711784 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86358d9e-7737-4f72-9a24-5e2e5c876e37 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:03.734538 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86358d9e-7737-4f72-9a24-5e2e5c876e37 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:03.736428 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86358d9e-7737-4f72-9a24-5e2e5c876e37 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:03.764221 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-86358d9e-7737-4f72-9a24-5e2e5c876e37 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:03.766638 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 341/685] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:03.772243 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3e3fc-4b47-4f90-8d24-b1ef4e161e81 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:03.790914 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3e3fc-4b47-4f90-8d24-b1ef4e161e81 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:03.803327 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28206bf-af19-4ab6-9072-1469aa49ba40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:03.804055 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28206bf-af19-4ab6-9072-1469aa49ba40 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:03.804338 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28206bf-af19-4ab6-9072-1469aa49ba40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:03.804607 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28206bf-af19-4ab6-9072-1469aa49ba40 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:03.805633 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28206bf-af19-4ab6-9072-1469aa49ba40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:03.805938 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28206bf-af19-4ab6-9072-1469aa49ba40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:03.808026 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28206bf-af19-4ab6-9072-1469aa49ba40 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:03.813623 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d908e-ddd5-43f1-af54-fe72b25d5533 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:03.813909 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d908e-ddd5-43f1-af54-fe72b25d5533 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:03.814192 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d908e-ddd5-43f1-af54-fe72b25d5533 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:03.815954 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 342/686] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 05:21:03.825975 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 345/687] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:03.831070 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d908e-ddd5-43f1-af54-fe72b25d5533 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:03.834364 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7180e-baeb-4433-9233-c0bbb86d5d53 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:03.834655 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7180e-baeb-4433-9233-c0bbb86d5d53 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:03.834926 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7180e-baeb-4433-9233-c0bbb86d5d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:03.859541 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d908e-ddd5-43f1-af54-fe72b25d5533 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:03.867448 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e2040-ef77-4ff0-a02a-0a9c68649c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:03.868173 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-eed7180e-baeb-4433-9233-c0bbb86d5d53 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:03.869442 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e2040-ef77-4ff0-a02a-0a9c68649c6a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:03.869720 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e2040-ef77-4ff0-a02a-0a9c68649c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:03.869990 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e2040-ef77-4ff0-a02a-0a9c68649c6a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:03.871987 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-eed7180e-baeb-4433-9233-c0bbb86d5d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:03.887847 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e2040-ef77-4ff0-a02a-0a9c68649c6a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:03.888773 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 346/688] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 16 05:21:03.890694 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e2040-ef77-4ff0-a02a-0a9c68649c6a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:03.904885 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-122e2040-ef77-4ff0-a02a-0a9c68649c6a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 05:21:03.906426 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 343/689] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Feb 16 05:21:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:03.911529 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7180e-baeb-4433-9233-c0bbb86d5d53 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:03.926018 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e2040-ef77-4ff0-a02a-0a9c68649c6a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:03.928524 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7180e-baeb-4433-9233-c0bbb86d5d53 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:03.940680 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e2040-ef77-4ff0-a02a-0a9c68649c6a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:03.945356 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938168f2-b5c0-49e0-8823-2be3c4c6aa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:03.946214 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938168f2-b5c0-49e0-8823-2be3c4c6aa8d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:03.946595 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938168f2-b5c0-49e0-8823-2be3c4c6aa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:03.946973 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938168f2-b5c0-49e0-8823-2be3c4c6aa8d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:03.947945 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825fe2a-c086-4fe3-aa44-690a697a265f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:03.948634 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825fe2a-c086-4fe3-aa44-690a697a265f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:03.948914 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825fe2a-c086-4fe3-aa44-690a697a265f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:03.949226 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825fe2a-c086-4fe3-aa44-690a697a265f admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:03.950188 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825fe2a-c086-4fe3-aa44-690a697a265f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:03.950501 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825fe2a-c086-4fe3-aa44-690a697a265f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:03.952429 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825fe2a-c086-4fe3-aa44-690a697a265f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:03.960450 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938168f2-b5c0-49e0-8823-2be3c4c6aa8d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:03.962516 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938168f2-b5c0-49e0-8823-2be3c4c6aa8d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:03.981323 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-938168f2-b5c0-49e0-8823-2be3c4c6aa8d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:03.982869 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 344/690] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:03.990577 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938168f2-b5c0-49e0-8823-2be3c4c6aa8d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:03.998212 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 347/691] 10.222.0.75 () {56 vars in 1154 bytes} [Wed Feb 16 05:21:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:04.004068 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825fe2a-c086-4fe3-aa44-690a697a265f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:04.005862 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938168f2-b5c0-49e0-8823-2be3c4c6aa8d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.015732 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825fe2a-c086-4fe3-aa44-690a697a265f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.018948 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8ea1b-be82-405a-9463-55dd5955d68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.019793 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8ea1b-be82-405a-9463-55dd5955d68e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.020220 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8ea1b-be82-405a-9463-55dd5955d68e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.020634 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8ea1b-be82-405a-9463-55dd5955d68e admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.021521 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8ea1b-be82-405a-9463-55dd5955d68e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:04.021968 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8ea1b-be82-405a-9463-55dd5955d68e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:04.024116 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb8ea1b-be82-405a-9463-55dd5955d68e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:04.034523 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847a639-0173-4c73-baac-2d83bb0f10b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.035348 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847a639-0173-4c73-baac-2d83bb0f10b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.035774 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847a639-0173-4c73-baac-2d83bb0f10b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.036194 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847a639-0173-4c73-baac-2d83bb0f10b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.048835 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847a639-0173-4c73-baac-2d83bb0f10b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:04.054912 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847a639-0173-4c73-baac-2d83bb0f10b0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:04.060134 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 345/692] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:04.062675 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8ea1b-be82-405a-9463-55dd5955d68e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:04.073900 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 348/693] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:21:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 05:21:04.081305 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8ea1b-be82-405a-9463-55dd5955d68e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.082394 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847a639-0173-4c73-baac-2d83bb0f10b0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:04.094741 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847a639-0173-4c73-baac-2d83bb0f10b0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.096054 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ac86d-9227-4d43-85eb-589d3190ce99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.096886 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ac86d-9227-4d43-85eb-589d3190ce99 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.097359 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ac86d-9227-4d43-85eb-589d3190ce99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.097774 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2ac86d-9227-4d43-85eb-589d3190ce99 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.098638 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ac86d-9227-4d43-85eb-589d3190ce99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:04.100728 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2ac86d-9227-4d43-85eb-589d3190ce99 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:04.112604 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78789e8-9b97-4c91-9d3f-a68ed64cd9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.113737 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78789e8-9b97-4c91-9d3f-a68ed64cd9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.114168 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78789e8-9b97-4c91-9d3f-a68ed64cd9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.114587 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78789e8-9b97-4c91-9d3f-a68ed64cd9e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.132375 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78789e8-9b97-4c91-9d3f-a68ed64cd9e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:04.134712 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78789e8-9b97-4c91-9d3f-a68ed64cd9e5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:04.155050 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-c78789e8-9b97-4c91-9d3f-a68ed64cd9e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:04.156745 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 349/694] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:04.165500 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78789e8-9b97-4c91-9d3f-a68ed64cd9e5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:04.172439 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 346/695] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Feb 16 05:21:04 2022] POST /identity/v3/users => generated 254 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:21:04.182181 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78789e8-9b97-4c91-9d3f-a68ed64cd9e5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.187240 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e03f1-f5e6-411f-917c-9c553c4b3705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.188020 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e03f1-f5e6-411f-917c-9c553c4b3705 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.188303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e03f1-f5e6-411f-917c-9c553c4b3705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.188576 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e03f1-f5e6-411f-917c-9c553c4b3705 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.189382 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e03f1-f5e6-411f-917c-9c553c4b3705 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:04.189699 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e03f1-f5e6-411f-917c-9c553c4b3705 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:04.191349 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e03f1-f5e6-411f-917c-9c553c4b3705 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:04.205130 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 350/696] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:04.210647 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ac86d-9227-4d43-85eb-589d3190ce99 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:04.222006 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2ac86d-9227-4d43-85eb-589d3190ce99 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.226944 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14128354-8f08-476c-a5e2-29da5c8cacb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.227830 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14128354-8f08-476c-a5e2-29da5c8cacb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.228155 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14128354-8f08-476c-a5e2-29da5c8cacb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.228475 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14128354-8f08-476c-a5e2-29da5c8cacb8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.236423 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14128354-8f08-476c-a5e2-29da5c8cacb8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:04.238563 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14128354-8f08-476c-a5e2-29da5c8cacb8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:04.259561 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-14128354-8f08-476c-a5e2-29da5c8cacb8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:21:04.261192 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 347/697] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:04.267415 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e03f1-f5e6-411f-917c-9c553c4b3705 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:04.279317 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e03f1-f5e6-411f-917c-9c553c4b3705 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.288863 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1f312-a92b-4a8f-b5c4-2fd924181247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.289572 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1f312-a92b-4a8f-b5c4-2fd924181247 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.289905 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1f312-a92b-4a8f-b5c4-2fd924181247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.290178 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1f312-a92b-4a8f-b5c4-2fd924181247 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.291015 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1f312-a92b-4a8f-b5c4-2fd924181247 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:04.291334 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1f312-a92b-4a8f-b5c4-2fd924181247 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:04.294055 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1f312-a92b-4a8f-b5c4-2fd924181247 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:04.308500 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 351/698] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:21:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:04.314414 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14128354-8f08-476c-a5e2-29da5c8cacb8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:04.331027 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14128354-8f08-476c-a5e2-29da5c8cacb8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.336506 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93300239-235c-4a62-b4eb-092dc0c2cfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.337217 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93300239-235c-4a62-b4eb-092dc0c2cfec admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.337534 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93300239-235c-4a62-b4eb-092dc0c2cfec admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.337860 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93300239-235c-4a62-b4eb-092dc0c2cfec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.338707 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93300239-235c-4a62-b4eb-092dc0c2cfec admin admin] RBAC: Adding query filter params (role.id=9ba4a5967ed243178927661616f08901, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=6522d231532a48ad8dbc9c9e79a021dd) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:04.339071 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93300239-235c-4a62-b4eb-092dc0c2cfec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:04.341613 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93300239-235c-4a62-b4eb-092dc0c2cfec admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:04.356111 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c22d4-df9a-486b-83bc-97529e04b5fb None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.356394 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c22d4-df9a-486b-83bc-97529e04b5fb None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.356667 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c22d4-df9a-486b-83bc-97529e04b5fb None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.358623 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 352/699] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 05:21:04.359711 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 348/700] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:21:04 2022] GET /identity/v3/role_assignments?user.id=6522d231532a48ad8dbc9c9e79a021dd&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=9ba4a5967ed243178927661616f08901 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:04.364985 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e1d82-db87-496a-902d-15a37e8c7f0c None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.365404 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e1d82-db87-496a-902d-15a37e8c7f0c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.365754 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57e1d82-db87-496a-902d-15a37e8c7f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.385084 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d57e1d82-db87-496a-902d-15a37e8c7f0c None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:04.386454 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d57e1d82-db87-496a-902d-15a37e8c7f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:04.395355 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 353/701] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:21:04.424874 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab98904-235e-4b78-a7c5-c3be8f276fdb None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.425423 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab98904-235e-4b78-a7c5-c3be8f276fdb None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.425871 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab98904-235e-4b78-a7c5-c3be8f276fdb None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.428233 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 349/702] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:04.429881 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e1d82-db87-496a-902d-15a37e8c7f0c None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:04.435254 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4ed84-8e66-41d2-9970-93f2b331b123 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.435618 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4ed84-8e66-41d2-9970-93f2b331b123 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.435960 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4ed84-8e66-41d2-9970-93f2b331b123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.442662 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57e1d82-db87-496a-902d-15a37e8c7f0c None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.448856 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0973f-a366-46a7-9fac-659a8d1805af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.450344 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0973f-a366-46a7-9fac-659a8d1805af admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.450681 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0973f-a366-46a7-9fac-659a8d1805af admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.450955 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0973f-a366-46a7-9fac-659a8d1805af admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.456348 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-87e4ed84-8e66-41d2-9970-93f2b331b123 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:04.457632 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-87e4ed84-8e66-41d2-9970-93f2b331b123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:04.468680 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0973f-a366-46a7-9fac-659a8d1805af admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:21:04.470769 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 350/703] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:21:04.476229 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-5df0973f-a366-46a7-9fac-659a8d1805af admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 05:21:04.483539 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 354/704] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:21:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:04.484901 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4ed84-8e66-41d2-9970-93f2b331b123 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:04.495024 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0973f-a366-46a7-9fac-659a8d1805af admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:04.500126 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4ed84-8e66-41d2-9970-93f2b331b123 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.507365 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0973f-a366-46a7-9fac-659a8d1805af admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.509594 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771751a-51bb-4f2b-b089-0cc20b580027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.510283 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771751a-51bb-4f2b-b089-0cc20b580027 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.510561 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771751a-51bb-4f2b-b089-0cc20b580027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.510834 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771751a-51bb-4f2b-b089-0cc20b580027 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.511836 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771751a-51bb-4f2b-b089-0cc20b580027 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:04.512142 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771751a-51bb-4f2b-b089-0cc20b580027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:04.512769 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53ab12-d9dc-4898-9280-386f20debfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.513714 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53ab12-d9dc-4898-9280-386f20debfc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.513854 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771751a-51bb-4f2b-b089-0cc20b580027 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:04.514151 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53ab12-d9dc-4898-9280-386f20debfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.514427 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53ab12-d9dc-4898-9280-386f20debfc1 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.515188 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53ab12-d9dc-4898-9280-386f20debfc1 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:04.517047 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53ab12-d9dc-4898-9280-386f20debfc1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:04.523811 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 351/705] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Feb 16 05:21:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:04.532275 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771751a-51bb-4f2b-b089-0cc20b580027 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:04.534998 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-4b53ab12-d9dc-4898-9280-386f20debfc1 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 16 05:21:04.536589 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 355/706] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:04 2022] GET /identity/v3/services/network => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:04.543492 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771751a-51bb-4f2b-b089-0cc20b580027 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.543968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53ab12-d9dc-4898-9280-386f20debfc1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:04.548317 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3a126-74be-4d51-96ac-ec560c4aefa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.549492 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3a126-74be-4d51-96ac-ec560c4aefa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.549781 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3a126-74be-4d51-96ac-ec560c4aefa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.550055 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3a126-74be-4d51-96ac-ec560c4aefa8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.554951 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53ab12-d9dc-4898-9280-386f20debfc1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.561530 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba823b7-2af4-4533-abd7-b365b73227cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.562196 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba823b7-2af4-4533-abd7-b365b73227cc admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.562492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba823b7-2af4-4533-abd7-b365b73227cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.562743 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba823b7-2af4-4533-abd7-b365b73227cc admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.563453 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba823b7-2af4-4533-abd7-b365b73227cc admin admin] RBAC: Adding query filter params (name=network) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:04.563756 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba823b7-2af4-4533-abd7-b365b73227cc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:04.564141 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3a126-74be-4d51-96ac-ec560c4aefa8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:04.565406 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba823b7-2af4-4533-abd7-b365b73227cc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:04.566150 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3a126-74be-4d51-96ac-ec560c4aefa8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:04.570489 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 356/707] 10.222.0.75 () {56 vars in 1133 bytes} [Wed Feb 16 05:21:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:04.577401 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba823b7-2af4-4533-abd7-b365b73227cc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:04.586354 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-13e3a126-74be-4d51-96ac-ec560c4aefa8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:04.587851 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 352/708] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:04.587974 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba823b7-2af4-4533-abd7-b365b73227cc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.593468 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3a126-74be-4d51-96ac-ec560c4aefa8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:04.595691 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a2487-d9df-4380-9e9f-ded410622953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.596402 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a2487-d9df-4380-9e9f-ded410622953 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.596683 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a2487-d9df-4380-9e9f-ded410622953 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.596955 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a2487-d9df-4380-9e9f-ded410622953 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.597892 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a2487-d9df-4380-9e9f-ded410622953 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:04.598198 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a2487-d9df-4380-9e9f-ded410622953 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:04.599844 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a2487-d9df-4380-9e9f-ded410622953 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:04.603660 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3a126-74be-4d51-96ac-ec560c4aefa8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.606610 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 357/709] 10.222.0.75 () {56 vars in 1133 bytes} [Wed Feb 16 05:21:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:04.608807 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b1749-30a5-4fbb-aa56-65e21c467fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.609496 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b1749-30a5-4fbb-aa56-65e21c467fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.609775 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b1749-30a5-4fbb-aa56-65e21c467fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.610045 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b1749-30a5-4fbb-aa56-65e21c467fb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.610776 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b1749-30a5-4fbb-aa56-65e21c467fb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:04.611077 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b1749-30a5-4fbb-aa56-65e21c467fb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:04.612730 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b1749-30a5-4fbb-aa56-65e21c467fb6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:04.631470 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 353/710] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:04.636809 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a2487-d9df-4380-9e9f-ded410622953 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:04.647791 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a2487-d9df-4380-9e9f-ded410622953 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.652870 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29cf652-7b29-4d84-b6ac-670961d21715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.654019 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29cf652-7b29-4d84-b6ac-670961d21715 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.654499 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29cf652-7b29-4d84-b6ac-670961d21715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.654949 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29cf652-7b29-4d84-b6ac-670961d21715 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.663602 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29cf652-7b29-4d84-b6ac-670961d21715 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:04.665995 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29cf652-7b29-4d84-b6ac-670961d21715 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:04.682300 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-f29cf652-7b29-4d84-b6ac-670961d21715 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 05:21:04.684467 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 358/711] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:21:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:04.690023 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b1749-30a5-4fbb-aa56-65e21c467fb6 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:04.701037 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b1749-30a5-4fbb-aa56-65e21c467fb6 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.705838 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932fd2e-9fff-4062-8660-04e474198459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.706523 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932fd2e-9fff-4062-8660-04e474198459 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.706809 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932fd2e-9fff-4062-8660-04e474198459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.707088 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932fd2e-9fff-4062-8660-04e474198459 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.707946 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932fd2e-9fff-4062-8660-04e474198459 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:04.708256 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932fd2e-9fff-4062-8660-04e474198459 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:04.710206 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932fd2e-9fff-4062-8660-04e474198459 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:04.731265 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 354/712] 10.222.0.75 () {56 vars in 1156 bytes} [Wed Feb 16 05:21:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:04.738390 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29cf652-7b29-4d84-b6ac-670961d21715 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:04.749304 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29cf652-7b29-4d84-b6ac-670961d21715 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.757584 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e9619-6a0e-4e70-a13e-aa0d4bfe7732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.758252 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e9619-6a0e-4e70-a13e-aa0d4bfe7732 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.758541 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e9619-6a0e-4e70-a13e-aa0d4bfe7732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.758813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e9619-6a0e-4e70-a13e-aa0d4bfe7732 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.774089 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e9619-6a0e-4e70-a13e-aa0d4bfe7732 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:04.775836 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e9619-6a0e-4e70-a13e-aa0d4bfe7732 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:04.785929 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 359/713] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:21:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:21:04.791532 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932fd2e-9fff-4062-8660-04e474198459 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:04.802409 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932fd2e-9fff-4062-8660-04e474198459 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.813313 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3218b77-df89-431a-a552-dba360b878e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.814132 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3218b77-df89-431a-a552-dba360b878e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.814411 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3218b77-df89-431a-a552-dba360b878e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.814679 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3218b77-df89-431a-a552-dba360b878e7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.826061 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3218b77-df89-431a-a552-dba360b878e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:04.827941 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3218b77-df89-431a-a552-dba360b878e7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:04.846807 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-a3218b77-df89-431a-a552-dba360b878e7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:04.848307 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 355/714] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:04.853495 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e9619-6a0e-4e70-a13e-aa0d4bfe7732 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:04.863159 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e9619-6a0e-4e70-a13e-aa0d4bfe7732 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.872535 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68f84c-1a3b-42f8-99d2-0330ba38c08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.873198 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68f84c-1a3b-42f8-99d2-0330ba38c08b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.873560 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68f84c-1a3b-42f8-99d2-0330ba38c08b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.873833 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68f84c-1a3b-42f8-99d2-0330ba38c08b admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.874563 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68f84c-1a3b-42f8-99d2-0330ba38c08b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:04.874867 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68f84c-1a3b-42f8-99d2-0330ba38c08b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:04.876477 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68f84c-1a3b-42f8-99d2-0330ba38c08b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:04.889185 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 360/715] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:04.894572 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3218b77-df89-431a-a552-dba360b878e7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:04.905184 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3218b77-df89-431a-a552-dba360b878e7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.910575 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b98ba9-a243-4cf2-8d35-65059e15727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.911351 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b98ba9-a243-4cf2-8d35-65059e15727b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.911634 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b98ba9-a243-4cf2-8d35-65059e15727b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.911909 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b98ba9-a243-4cf2-8d35-65059e15727b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.919901 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b98ba9-a243-4cf2-8d35-65059e15727b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:04.921939 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b98ba9-a243-4cf2-8d35-65059e15727b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:04.935881 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-23b98ba9-a243-4cf2-8d35-65059e15727b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:21:04.937084 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 356/716] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:04.942695 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68f84c-1a3b-42f8-99d2-0330ba38c08b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:04.952606 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68f84c-1a3b-42f8-99d2-0330ba38c08b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.957129 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3987d6-7da5-42d0-9c56-c03fa7c335c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.957807 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3987d6-7da5-42d0-9c56-c03fa7c335c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.958089 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3987d6-7da5-42d0-9c56-c03fa7c335c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.958363 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3987d6-7da5-42d0-9c56-c03fa7c335c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:04.959145 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3987d6-7da5-42d0-9c56-c03fa7c335c3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:04.959450 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3987d6-7da5-42d0-9c56-c03fa7c335c3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:04.961325 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3987d6-7da5-42d0-9c56-c03fa7c335c3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:04.974710 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 361/717] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:21:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:04.981055 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b98ba9-a243-4cf2-8d35-65059e15727b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:04.992933 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b98ba9-a243-4cf2-8d35-65059e15727b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:04.998074 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c2e74-ea2f-4f75-bc16-80a15401fe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:04.998708 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c2e74-ea2f-4f75-bc16-80a15401fe50 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:04.998985 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c2e74-ea2f-4f75-bc16-80a15401fe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:04.999254 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c2e74-ea2f-4f75-bc16-80a15401fe50 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:05.000088 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c2e74-ea2f-4f75-bc16-80a15401fe50 admin admin] RBAC: Adding query filter params (role.id=0660c2b0286b42c78d66c437b4713a2f, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=92eb49cac0c94e73a70361831dd789b2) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:05.000392 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c2e74-ea2f-4f75-bc16-80a15401fe50 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:05.002309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c2e74-ea2f-4f75-bc16-80a15401fe50 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:05.008519 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 357/718] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:21:04 2022] GET /identity/v3/role_assignments?user.id=92eb49cac0c94e73a70361831dd789b2&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=0660c2b0286b42c78d66c437b4713a2f => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:05.732564 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589c451-bf1a-419f-ba21-f13bdbe50a5f None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:05.733249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589c451-bf1a-419f-ba21-f13bdbe50a5f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:05.733249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589c451-bf1a-419f-ba21-f13bdbe50a5f None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:05.735135 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 362/719] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:05.740222 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce63d69-fdb3-4b58-ab78-4459ea6ca829 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:05.740761 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce63d69-fdb3-4b58-ab78-4459ea6ca829 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:05.740761 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce63d69-fdb3-4b58-ab78-4459ea6ca829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:05.776202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-8ce63d69-fdb3-4b58-ab78-4459ea6ca829 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:05.777498 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8ce63d69-fdb3-4b58-ab78-4459ea6ca829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:05.790412 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 358/720] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 16 05:21:05.826010 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589c451-bf1a-419f-ba21-f13bdbe50a5f None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:05.845904 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589c451-bf1a-419f-ba21-f13bdbe50a5f None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:05.850397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd43b37-35a3-4f8e-b72a-c22de11513ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:05.851046 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd43b37-35a3-4f8e-b72a-c22de11513ee admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:05.851322 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd43b37-35a3-4f8e-b72a-c22de11513ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:05.851593 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd43b37-35a3-4f8e-b72a-c22de11513ee admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:05.852323 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd43b37-35a3-4f8e-b72a-c22de11513ee admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:05.853356 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-4bd43b37-35a3-4f8e-b72a-c22de11513ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:21:05.853356 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Feb 16 05:21:05.853356 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: Feb 16 05:21:05.854248 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd43b37-35a3-4f8e-b72a-c22de11513ee admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:05.895127 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 363/721] 10.222.0.75 () {60 vars in 1162 bytes} [Wed Feb 16 05:21:05 2022] POST /identity/v3/services => generated 251 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:21:07.040297 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9ae2e-3388-440f-a190-0f04a8c7d23b None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.040297 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9ae2e-3388-440f-a190-0f04a8c7d23b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.040297 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9ae2e-3388-440f-a190-0f04a8c7d23b None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.041568 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 359/722] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:07.047532 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf930a-e3dd-45e9-9181-3d3f4e230ef0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.048359 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf930a-e3dd-45e9-9181-3d3f4e230ef0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.048847 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf930a-e3dd-45e9-9181-3d3f4e230ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.068108 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-6bdf930a-e3dd-45e9-9181-3d3f4e230ef0 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:07.069620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6bdf930a-e3dd-45e9-9181-3d3f4e230ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:07.098760 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 364/723] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:07 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:07.143322 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9ae2e-3388-440f-a190-0f04a8c7d23b None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:07.158925 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9ae2e-3388-440f-a190-0f04a8c7d23b None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:07.167174 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088aaf76-d43e-47d6-9060-56d41c66871e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:07.168205 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088aaf76-d43e-47d6-9060-56d41c66871e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.168719 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088aaf76-d43e-47d6-9060-56d41c66871e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.169193 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088aaf76-d43e-47d6-9060-56d41c66871e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.183451 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088aaf76-d43e-47d6-9060-56d41c66871e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:21:07.194745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-088aaf76-d43e-47d6-9060-56d41c66871e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:21:07.196199 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 360/724] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:21:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:07.202877 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf930a-e3dd-45e9-9181-3d3f4e230ef0 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:07.212274 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf930a-e3dd-45e9-9181-3d3f4e230ef0 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:07.221319 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eaf493-f194-413c-b0d9-6473480c066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:07.222213 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaf493-f194-413c-b0d9-6473480c066e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.222696 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaf493-f194-413c-b0d9-6473480c066e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.223188 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eaf493-f194-413c-b0d9-6473480c066e admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.224129 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eaf493-f194-413c-b0d9-6473480c066e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:07.224652 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eaf493-f194-413c-b0d9-6473480c066e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:07.226491 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eaf493-f194-413c-b0d9-6473480c066e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:07.235919 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 365/725] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:21:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:07.241706 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088aaf76-d43e-47d6-9060-56d41c66871e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:07.248967 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa57fb-12c1-436c-a69d-12f1470d1e0f None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.251170 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa57fb-12c1-436c-a69d-12f1470d1e0f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.252679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa57fb-12c1-436c-a69d-12f1470d1e0f None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.254857 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 366/726] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:07 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:07.257100 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088aaf76-d43e-47d6-9060-56d41c66871e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:07.260363 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58fdea-feed-472a-8e02-9cdf39440458 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.261444 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58fdea-feed-472a-8e02-9cdf39440458 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.262892 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58fdea-feed-472a-8e02-9cdf39440458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.266908 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290761b2-4186-41b4-92e8-832cb8cd6c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:07.267917 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290761b2-4186-41b4-92e8-832cb8cd6c27 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.268409 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290761b2-4186-41b4-92e8-832cb8cd6c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.269945 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290761b2-4186-41b4-92e8-832cb8cd6c27 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.290451 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290761b2-4186-41b4-92e8-832cb8cd6c27 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:07.292754 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290761b2-4186-41b4-92e8-832cb8cd6c27 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:07.294486 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-5e58fdea-feed-472a-8e02-9cdf39440458 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:07.295705 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5e58fdea-feed-472a-8e02-9cdf39440458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:07.311516 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-290761b2-4186-41b4-92e8-832cb8cd6c27 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:07.316979 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 367/727] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:07 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:07.318571 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 361/728] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:07.324695 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58fdea-feed-472a-8e02-9cdf39440458 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:07.334380 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58fdea-feed-472a-8e02-9cdf39440458 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:07.339224 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97419a2d-e1d2-4006-9573-09e9a042531a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:07.340193 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97419a2d-e1d2-4006-9573-09e9a042531a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.340707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97419a2d-e1d2-4006-9573-09e9a042531a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.341215 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97419a2d-e1d2-4006-9573-09e9a042531a admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.342235 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97419a2d-e1d2-4006-9573-09e9a042531a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:07.342804 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97419a2d-e1d2-4006-9573-09e9a042531a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:07.344654 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97419a2d-e1d2-4006-9573-09e9a042531a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:07.348864 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290761b2-4186-41b4-92e8-832cb8cd6c27 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:07.357657 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 368/729] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:07.363159 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97419a2d-e1d2-4006-9573-09e9a042531a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:07.366920 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290761b2-4186-41b4-92e8-832cb8cd6c27 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:07.373955 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97419a2d-e1d2-4006-9573-09e9a042531a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:07.378871 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e45f0-7a0f-4b87-8c19-0fc39da0c273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:07.379916 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e45f0-7a0f-4b87-8c19-0fc39da0c273 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.380452 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e45f0-7a0f-4b87-8c19-0fc39da0c273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.380940 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e45f0-7a0f-4b87-8c19-0fc39da0c273 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.382496 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebba9b-c214-4d74-ba9c-e158ae73e226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:07.383285 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebba9b-c214-4d74-ba9c-e158ae73e226 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.383609 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebba9b-c214-4d74-ba9c-e158ae73e226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.383809 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebba9b-c214-4d74-ba9c-e158ae73e226 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.390893 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e45f0-7a0f-4b87-8c19-0fc39da0c273 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:07.393196 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e45f0-7a0f-4b87-8c19-0fc39da0c273 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:07.406826 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebba9b-c214-4d74-ba9c-e158ae73e226 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:21:07.407931 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-4d3e45f0-7a0f-4b87-8c19-0fc39da0c273 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 05:21:07.409633 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 369/730] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Feb 16 05:21:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:07.418538 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-d6ebba9b-c214-4d74-ba9c-e158ae73e226 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 05:21:07.419142 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e45f0-7a0f-4b87-8c19-0fc39da0c273 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:07.420050 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 362/731] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:21:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:07.425117 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebba9b-c214-4d74-ba9c-e158ae73e226 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:07.436986 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e45f0-7a0f-4b87-8c19-0fc39da0c273 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:07.441292 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebba9b-c214-4d74-ba9c-e158ae73e226 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:07.447473 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe0dd1-40f2-4c1a-b355-eec992e2ee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:07.448616 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe0dd1-40f2-4c1a-b355-eec992e2ee26 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.448916 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe0dd1-40f2-4c1a-b355-eec992e2ee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.449580 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe0dd1-40f2-4c1a-b355-eec992e2ee26 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.451261 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a2643-f4ae-4e0f-85fc-e5ba6d8a3704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:07.452195 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe0dd1-40f2-4c1a-b355-eec992e2ee26 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:07.452502 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe0dd1-40f2-4c1a-b355-eec992e2ee26 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:07.453037 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a2643-f4ae-4e0f-85fc-e5ba6d8a3704 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.453342 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a2643-f4ae-4e0f-85fc-e5ba6d8a3704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.453612 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a2643-f4ae-4e0f-85fc-e5ba6d8a3704 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.455769 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a2643-f4ae-4e0f-85fc-e5ba6d8a3704 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:07.456078 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a2643-f4ae-4e0f-85fc-e5ba6d8a3704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:07.457179 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe0dd1-40f2-4c1a-b355-eec992e2ee26 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:07.459448 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a2643-f4ae-4e0f-85fc-e5ba6d8a3704 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:07.479571 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 363/732] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Feb 16 05:21:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:07.482755 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 370/733] 10.222.0.75 () {56 vars in 1154 bytes} [Wed Feb 16 05:21:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:07.485030 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a2643-f4ae-4e0f-85fc-e5ba6d8a3704 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:07.494255 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe0dd1-40f2-4c1a-b355-eec992e2ee26 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:07.495636 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a2643-f4ae-4e0f-85fc-e5ba6d8a3704 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:07.501393 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2231cf-c0d1-4370-91ae-e5dd244e08e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:07.501393 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2231cf-c0d1-4370-91ae-e5dd244e08e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.501687 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2231cf-c0d1-4370-91ae-e5dd244e08e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.501942 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2231cf-c0d1-4370-91ae-e5dd244e08e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.510774 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe0dd1-40f2-4c1a-b355-eec992e2ee26 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:07.514072 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2231cf-c0d1-4370-91ae-e5dd244e08e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:07.515813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b44c85-4356-466c-8667-776de7a1bcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:07.516056 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2231cf-c0d1-4370-91ae-e5dd244e08e6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:07.516606 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b44c85-4356-466c-8667-776de7a1bcfd admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.516887 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b44c85-4356-466c-8667-776de7a1bcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.517163 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b44c85-4356-466c-8667-776de7a1bcfd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.534168 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b44c85-4356-466c-8667-776de7a1bcfd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:07.536346 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b44c85-4356-466c-8667-776de7a1bcfd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:07.536478 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-8d2231cf-c0d1-4370-91ae-e5dd244e08e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:07.542458 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 364/734] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:07.544293 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b501a-4f8c-4c26-a4b0-04913f1c4789 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.544584 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b501a-4f8c-4c26-a4b0-04913f1c4789 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.544861 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b501a-4f8c-4c26-a4b0-04913f1c4789 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.546588 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 365/735] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:07.547285 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b501a-4f8c-4c26-a4b0-04913f1c4789 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:07.555786 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-04b44c85-4356-466c-8667-776de7a1bcfd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:07.557636 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 371/736] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:07.559162 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273e62b-d772-4a77-90a6-b7b46123c2f2 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.560067 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273e62b-d772-4a77-90a6-b7b46123c2f2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.560349 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5273e62b-d772-4a77-90a6-b7b46123c2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.564354 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b501a-4f8c-4c26-a4b0-04913f1c4789 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:07.568991 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fa932-49bf-41c3-9824-5d252f6ca5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:07.569746 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fa932-49bf-41c3-9824-5d252f6ca5ec admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.570094 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fa932-49bf-41c3-9824-5d252f6ca5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.570439 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fa932-49bf-41c3-9824-5d252f6ca5ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.571230 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fa932-49bf-41c3-9824-5d252f6ca5ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:07.571606 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fa932-49bf-41c3-9824-5d252f6ca5ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:07.573319 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7fa932-49bf-41c3-9824-5d252f6ca5ec admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:07.580533 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-5273e62b-d772-4a77-90a6-b7b46123c2f2 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:07.582256 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5273e62b-d772-4a77-90a6-b7b46123c2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:07.592086 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 366/737] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:07.592987 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fa932-49bf-41c3-9824-5d252f6ca5ec admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:07.593386 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 372/738] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:07 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:07.594185 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273e62b-d772-4a77-90a6-b7b46123c2f2 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:07.604572 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5273e62b-d772-4a77-90a6-b7b46123c2f2 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:07.611717 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913045c6-2217-45d3-8b98-880438344e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:07.612538 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913045c6-2217-45d3-8b98-880438344e2f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.612863 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913045c6-2217-45d3-8b98-880438344e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.613140 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913045c6-2217-45d3-8b98-880438344e2f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.613331 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fa932-49bf-41c3-9824-5d252f6ca5ec admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:07.618744 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e31d37-e4a1-4274-b2d5-c86b63b94a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:07.619415 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e31d37-e4a1-4274-b2d5-c86b63b94a8a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.619693 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e31d37-e4a1-4274-b2d5-c86b63b94a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.619961 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e31d37-e4a1-4274-b2d5-c86b63b94a8a admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.621663 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e31d37-e4a1-4274-b2d5-c86b63b94a8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:07.621978 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e31d37-e4a1-4274-b2d5-c86b63b94a8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:07.622236 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913045c6-2217-45d3-8b98-880438344e2f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:07.623619 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e31d37-e4a1-4274-b2d5-c86b63b94a8a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:07.624363 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913045c6-2217-45d3-8b98-880438344e2f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:07.637438 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 367/739] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:07.638262 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e31d37-e4a1-4274-b2d5-c86b63b94a8a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:07.643434 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-913045c6-2217-45d3-8b98-880438344e2f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 05:21:07.645328 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 373/740] 10.222.0.75 () {56 vars in 1138 bytes} [Wed Feb 16 05:21:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:07.646347 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913045c6-2217-45d3-8b98-880438344e2f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:07.654136 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e31d37-e4a1-4274-b2d5-c86b63b94a8a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:07.657083 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913045c6-2217-45d3-8b98-880438344e2f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:07.659091 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368065a-6999-41c8-ae0f-a006e8f4bb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:07.659845 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368065a-6999-41c8-ae0f-a006e8f4bb88 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.660217 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368065a-6999-41c8-ae0f-a006e8f4bb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.660496 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7368065a-6999-41c8-ae0f-a006e8f4bb88 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.661232 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368065a-6999-41c8-ae0f-a006e8f4bb88 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:07.662088 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd405ac-8fe0-4e88-a4bf-4f0ffcb04d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:07.662395 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-7368065a-6999-41c8-ae0f-a006e8f4bb88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:21:07.662395 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Feb 16 05:21:07.662395 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: Feb 16 05:21:07.663118 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd405ac-8fe0-4e88-a4bf-4f0ffcb04d7e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.663256 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7368065a-6999-41c8-ae0f-a006e8f4bb88 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:07.663561 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd405ac-8fe0-4e88-a4bf-4f0ffcb04d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.663895 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd405ac-8fe0-4e88-a4bf-4f0ffcb04d7e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.676503 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd405ac-8fe0-4e88-a4bf-4f0ffcb04d7e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:07.678796 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd405ac-8fe0-4e88-a4bf-4f0ffcb04d7e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:07.684669 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 368/741] 10.222.0.75 () {60 vars in 1162 bytes} [Wed Feb 16 05:21:07 2022] POST /identity/v3/services => generated 240 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:21:07.685792 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368065a-6999-41c8-ae0f-a006e8f4bb88 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:07.693780 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-7fd405ac-8fe0-4e88-a4bf-4f0ffcb04d7e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:21:07.695437 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 374/742] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:07.705630 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd405ac-8fe0-4e88-a4bf-4f0ffcb04d7e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:07.715616 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7368065a-6999-41c8-ae0f-a006e8f4bb88 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:07.717923 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef390d2-3dc1-4d33-960f-5c163ed54790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:07.718729 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef390d2-3dc1-4d33-960f-5c163ed54790 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.719084 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef390d2-3dc1-4d33-960f-5c163ed54790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.719472 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef390d2-3dc1-4d33-960f-5c163ed54790 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.720427 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef390d2-3dc1-4d33-960f-5c163ed54790 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:07.720859 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef390d2-3dc1-4d33-960f-5c163ed54790 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:07.723908 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef390d2-3dc1-4d33-960f-5c163ed54790 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:07.733748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd405ac-8fe0-4e88-a4bf-4f0ffcb04d7e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:07.747542 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 369/743] 10.222.0.75 () {56 vars in 1170 bytes} [Wed Feb 16 05:21:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:07.752729 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdda75d-72a9-421b-a892-00590dd5675a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:07.753268 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef390d2-3dc1-4d33-960f-5c163ed54790 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:07.753468 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdda75d-72a9-421b-a892-00590dd5675a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.753727 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdda75d-72a9-421b-a892-00590dd5675a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.754003 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdda75d-72a9-421b-a892-00590dd5675a admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.754820 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdda75d-72a9-421b-a892-00590dd5675a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:07.755128 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdda75d-72a9-421b-a892-00590dd5675a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:07.757023 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdda75d-72a9-421b-a892-00590dd5675a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:07.764464 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef390d2-3dc1-4d33-960f-5c163ed54790 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:07.769517 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15857b-f8e6-4a80-af3d-199844b90722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:07.770240 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15857b-f8e6-4a80-af3d-199844b90722 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.771145 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15857b-f8e6-4a80-af3d-199844b90722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.771429 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15857b-f8e6-4a80-af3d-199844b90722 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.781429 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15857b-f8e6-4a80-af3d-199844b90722 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:07.783895 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15857b-f8e6-4a80-af3d-199844b90722 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:07.791940 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 375/744] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:21:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:07.795493 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 370/745] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:21:07 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:21:07.798319 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdda75d-72a9-421b-a892-00590dd5675a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:07.800882 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15857b-f8e6-4a80-af3d-199844b90722 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:07.811488 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15857b-f8e6-4a80-af3d-199844b90722 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:07.817143 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412aeec-5c71-4fb9-9a60-2cb9c9f28348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:07.818034 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412aeec-5c71-4fb9-9a60-2cb9c9f28348 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.818367 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412aeec-5c71-4fb9-9a60-2cb9c9f28348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.818642 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412aeec-5c71-4fb9-9a60-2cb9c9f28348 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.823925 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdda75d-72a9-421b-a892-00590dd5675a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:07.831090 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412aeec-5c71-4fb9-9a60-2cb9c9f28348 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:07.833113 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412aeec-5c71-4fb9-9a60-2cb9c9f28348 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:07.846015 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b5efa-7fd0-42a7-b2e2-a5fe1868dbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:07.846922 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b5efa-7fd0-42a7-b2e2-a5fe1868dbda admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.847205 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b5efa-7fd0-42a7-b2e2-a5fe1868dbda admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.847480 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b5efa-7fd0-42a7-b2e2-a5fe1868dbda admin admin] PATH_INFO: `/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/6522d231532a48ad8dbc9c9e79a021dd/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.852657 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-a412aeec-5c71-4fb9-9a60-2cb9c9f28348 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:07.854103 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 371/746] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:07.855567 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b5efa-7fd0-42a7-b2e2-a5fe1868dbda admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4d0b5a3f7d4542a47a26e623500b4f, user_id=6522d231532a48ad8dbc9c9e79a021dd, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:07.858357 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b5efa-7fd0-42a7-b2e2-a5fe1868dbda admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:07.860180 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412aeec-5c71-4fb9-9a60-2cb9c9f28348 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:07.872463 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412aeec-5c71-4fb9-9a60-2cb9c9f28348 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:07.877777 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12389187-4807-4a53-b737-77f0aca3c02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:07.878486 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12389187-4807-4a53-b737-77f0aca3c02f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.878766 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12389187-4807-4a53-b737-77f0aca3c02f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.879042 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12389187-4807-4a53-b737-77f0aca3c02f admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.879905 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12389187-4807-4a53-b737-77f0aca3c02f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:07.880227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12389187-4807-4a53-b737-77f0aca3c02f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:07.881912 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12389187-4807-4a53-b737-77f0aca3c02f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:07.894086 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 372/747] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:07.899334 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12389187-4807-4a53-b737-77f0aca3c02f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:07.899553 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 376/748] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:21:07 2022] PUT /identity/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/6522d231532a48ad8dbc9c9e79a021dd/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:21:07.910081 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12389187-4807-4a53-b737-77f0aca3c02f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:07.978992 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a3d90-6aae-46c3-9e82-97c3170edd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:07.979874 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a3d90-6aae-46c3-9e82-97c3170edd1e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:07.980188 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a3d90-6aae-46c3-9e82-97c3170edd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:07.980518 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a3d90-6aae-46c3-9e82-97c3170edd1e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:07.988639 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a3d90-6aae-46c3-9e82-97c3170edd1e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:07.990837 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a3d90-6aae-46c3-9e82-97c3170edd1e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:08.007138 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-6f0a3d90-6aae-46c3-9e82-97c3170edd1e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:21:08.008468 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 373/749] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:08.015087 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b5efa-7fd0-42a7-b2e2-a5fe1868dbda admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:08.025858 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b5efa-7fd0-42a7-b2e2-a5fe1868dbda admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:08.031341 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d43c2-2062-4e51-9aa4-36fa463fcb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:08.032148 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d43c2-2062-4e51-9aa4-36fa463fcb61 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:08.032431 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d43c2-2062-4e51-9aa4-36fa463fcb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:08.032703 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d43c2-2062-4e51-9aa4-36fa463fcb61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:08.033588 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d43c2-2062-4e51-9aa4-36fa463fcb61 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:08.033896 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d43c2-2062-4e51-9aa4-36fa463fcb61 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:08.035853 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748d43c2-2062-4e51-9aa4-36fa463fcb61 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:08.051508 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 377/750] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:21:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:08.057978 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a3d90-6aae-46c3-9e82-97c3170edd1e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:08.073245 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a3d90-6aae-46c3-9e82-97c3170edd1e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:08.081922 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40664d90-920f-4a7e-b77f-2e5a0448d0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:08.082580 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40664d90-920f-4a7e-b77f-2e5a0448d0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:08.082914 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40664d90-920f-4a7e-b77f-2e5a0448d0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:08.083189 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40664d90-920f-4a7e-b77f-2e5a0448d0d4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:08.084092 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40664d90-920f-4a7e-b77f-2e5a0448d0d4 admin admin] RBAC: Adding query filter params (role.id=0660c2b0286b42c78d66c437b4713a2f, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=4d22345d2e2646cc99c74a2f9692b648) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:08.084409 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40664d90-920f-4a7e-b77f-2e5a0448d0d4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:08.086394 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40664d90-920f-4a7e-b77f-2e5a0448d0d4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:08.094887 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 374/751] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:21:08 2022] GET /identity/v3/role_assignments?user.id=4d22345d2e2646cc99c74a2f9692b648&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=0660c2b0286b42c78d66c437b4713a2f => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:08.435780 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e27cd-922c-4b39-a70d-acb77345758d None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:08.436115 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e27cd-922c-4b39-a70d-acb77345758d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:08.436284 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e27cd-922c-4b39-a70d-acb77345758d None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:08.438290 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 378/752] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:08.443248 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a0c77-1f76-4a2a-a1c4-7732454c4158 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:08.443540 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a0c77-1f76-4a2a-a1c4-7732454c4158 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:08.443821 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a0c77-1f76-4a2a-a1c4-7732454c4158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:08.466253 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-230a0c77-1f76-4a2a-a1c4-7732454c4158 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:08.467455 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-230a0c77-1f76-4a2a-a1c4-7732454c4158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:08.475573 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 375/753] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:08 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:08.518744 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e27cd-922c-4b39-a70d-acb77345758d None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:08.535496 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e27cd-922c-4b39-a70d-acb77345758d None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:08.540896 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05146d04-d238-4329-8e28-6eb8d3a59b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:08.541751 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05146d04-d238-4329-8e28-6eb8d3a59b93 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:08.542036 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05146d04-d238-4329-8e28-6eb8d3a59b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:08.542305 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05146d04-d238-4329-8e28-6eb8d3a59b93 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:08.561093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05146d04-d238-4329-8e28-6eb8d3a59b93 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:21:08.568208 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-05146d04-d238-4329-8e28-6eb8d3a59b93 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:21:08.569516 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 379/754] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:21:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:08.576047 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a0c77-1f76-4a2a-a1c4-7732454c4158 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:08.588357 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a0c77-1f76-4a2a-a1c4-7732454c4158 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:08.601109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ee8e1-5586-4bde-9b42-db4891ac4539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:08.601109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ee8e1-5586-4bde-9b42-db4891ac4539 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:08.601109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ee8e1-5586-4bde-9b42-db4891ac4539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:08.601109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ee8e1-5586-4bde-9b42-db4891ac4539 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:08.601885 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ee8e1-5586-4bde-9b42-db4891ac4539 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:08.601885 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ee8e1-5586-4bde-9b42-db4891ac4539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:08.601885 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ee8e1-5586-4bde-9b42-db4891ac4539 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:08.613739 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 376/755] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:21:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:08.619525 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05146d04-d238-4329-8e28-6eb8d3a59b93 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:08.634440 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05146d04-d238-4329-8e28-6eb8d3a59b93 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:08.641695 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9544b-db28-4bd4-9de3-f11f6ec6159b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:08.642474 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9544b-db28-4bd4-9de3-f11f6ec6159b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:08.642809 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9544b-db28-4bd4-9de3-f11f6ec6159b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:08.643084 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9544b-db28-4bd4-9de3-f11f6ec6159b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:08.658042 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9544b-db28-4bd4-9de3-f11f6ec6159b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:08.659968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9544b-db28-4bd4-9de3-f11f6ec6159b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:08.682150 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-beb9544b-db28-4bd4-9de3-f11f6ec6159b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:08.684112 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 380/756] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:08.689730 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ee8e1-5586-4bde-9b42-db4891ac4539 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:08.706350 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ee8e1-5586-4bde-9b42-db4891ac4539 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:08.719050 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182aa39-45a3-41e4-9a53-0e5c7d6670aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:08.719730 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182aa39-45a3-41e4-9a53-0e5c7d6670aa admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:08.720019 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182aa39-45a3-41e4-9a53-0e5c7d6670aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:08.720296 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182aa39-45a3-41e4-9a53-0e5c7d6670aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:08.721032 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182aa39-45a3-41e4-9a53-0e5c7d6670aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:08.721369 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182aa39-45a3-41e4-9a53-0e5c7d6670aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:08.722989 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182aa39-45a3-41e4-9a53-0e5c7d6670aa admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:08.747247 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 377/757] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:08.752526 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9544b-db28-4bd4-9de3-f11f6ec6159b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:08.766697 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9544b-db28-4bd4-9de3-f11f6ec6159b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:08.776696 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed526f88-b223-44c8-93ee-5191eb26ffdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:08.777582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed526f88-b223-44c8-93ee-5191eb26ffdd admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:08.777870 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed526f88-b223-44c8-93ee-5191eb26ffdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:08.778143 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed526f88-b223-44c8-93ee-5191eb26ffdd admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:08.790523 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed526f88-b223-44c8-93ee-5191eb26ffdd admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:08.792678 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed526f88-b223-44c8-93ee-5191eb26ffdd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:08.811926 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-ed526f88-b223-44c8-93ee-5191eb26ffdd admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 05:21:08.813471 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 381/758] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:21:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:08.818684 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182aa39-45a3-41e4-9a53-0e5c7d6670aa admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:08.834303 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182aa39-45a3-41e4-9a53-0e5c7d6670aa admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:08.842374 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1e41c-a939-4d3b-acbc-73f6ae15efe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:08.843028 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1e41c-a939-4d3b-acbc-73f6ae15efe2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:08.843309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1e41c-a939-4d3b-acbc-73f6ae15efe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:08.843581 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1e41c-a939-4d3b-acbc-73f6ae15efe2 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:08.844415 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1e41c-a939-4d3b-acbc-73f6ae15efe2 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:08.844719 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1e41c-a939-4d3b-acbc-73f6ae15efe2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:08.846623 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1e41c-a939-4d3b-acbc-73f6ae15efe2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:08.873528 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 378/759] 10.222.0.75 () {56 vars in 1156 bytes} [Wed Feb 16 05:21:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:08.879088 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed526f88-b223-44c8-93ee-5191eb26ffdd admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:08.899498 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed526f88-b223-44c8-93ee-5191eb26ffdd admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:08.908390 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3faa5bd-315f-4842-82e1-d12c3e75511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:08.909087 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3faa5bd-315f-4842-82e1-d12c3e75511d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:08.909443 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3faa5bd-315f-4842-82e1-d12c3e75511d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:08.909769 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3faa5bd-315f-4842-82e1-d12c3e75511d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:08.922126 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3faa5bd-315f-4842-82e1-d12c3e75511d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:08.923938 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3faa5bd-315f-4842-82e1-d12c3e75511d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:08.938482 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 382/760] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:21:08 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:21:08.943733 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1e41c-a939-4d3b-acbc-73f6ae15efe2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:08.962231 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1e41c-a939-4d3b-acbc-73f6ae15efe2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:08.970898 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170097b-efcf-488f-894a-eae7ab3e5ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:08.971699 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170097b-efcf-488f-894a-eae7ab3e5ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:08.971980 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170097b-efcf-488f-894a-eae7ab3e5ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:08.972255 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170097b-efcf-488f-894a-eae7ab3e5ca0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:08.974742 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa08a90-cc69-4333-afcc-7ac657cb2e3f None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:08.975029 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa08a90-cc69-4333-afcc-7ac657cb2e3f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:08.975304 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa08a90-cc69-4333-afcc-7ac657cb2e3f None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:08.977513 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 383/761] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:08.982713 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfed853-5e16-42bc-a1ea-185d3b0dfd97 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:08.983248 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfed853-5e16-42bc-a1ea-185d3b0dfd97 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:08.983717 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfed853-5e16-42bc-a1ea-185d3b0dfd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:08.992953 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170097b-efcf-488f-894a-eae7ab3e5ca0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:08.994889 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7170097b-efcf-488f-894a-eae7ab3e5ca0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:09.004506 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0cfed853-5e16-42bc-a1ea-185d3b0dfd97 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:09.006066 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0cfed853-5e16-42bc-a1ea-185d3b0dfd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:09.021374 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 384/762] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:08 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:21:09.023496 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-7170097b-efcf-488f-894a-eae7ab3e5ca0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:09.024943 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 379/763] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:09.030094 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfed853-5e16-42bc-a1ea-185d3b0dfd97 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:09.043388 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfed853-5e16-42bc-a1ea-185d3b0dfd97 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:09.049449 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab68711-d86c-4bfe-ae61-808485576f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:09.050373 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab68711-d86c-4bfe-ae61-808485576f02 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:09.050854 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab68711-d86c-4bfe-ae61-808485576f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:09.051391 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab68711-d86c-4bfe-ae61-808485576f02 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:09.052413 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab68711-d86c-4bfe-ae61-808485576f02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:09.053357 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab68711-d86c-4bfe-ae61-808485576f02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:09.055255 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab68711-d86c-4bfe-ae61-808485576f02 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:09.073147 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170097b-efcf-488f-894a-eae7ab3e5ca0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:09.075692 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 385/764] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:09.080551 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab68711-d86c-4bfe-ae61-808485576f02 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:09.090213 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab68711-d86c-4bfe-ae61-808485576f02 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:09.096262 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6582b-2932-4241-b370-c678e5a85ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:09.097037 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6582b-2932-4241-b370-c678e5a85ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:09.097378 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6582b-2932-4241-b370-c678e5a85ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:09.097657 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6582b-2932-4241-b370-c678e5a85ef6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:09.098449 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170097b-efcf-488f-894a-eae7ab3e5ca0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:09.105646 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6582b-2932-4241-b370-c678e5a85ef6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:09.107743 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6582b-2932-4241-b370-c678e5a85ef6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:09.121933 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45851f85-f897-4ecd-98aa-1f9b11ae4883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:09.122746 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45851f85-f897-4ecd-98aa-1f9b11ae4883 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:09.123028 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45851f85-f897-4ecd-98aa-1f9b11ae4883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:09.123300 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45851f85-f897-4ecd-98aa-1f9b11ae4883 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:09.123399 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-1bf6582b-2932-4241-b370-c678e5a85ef6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:21:09.123966 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45851f85-f897-4ecd-98aa-1f9b11ae4883 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:09.124934 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 386/765] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:09.125039 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-45851f85-f897-4ecd-98aa-1f9b11ae4883 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:21:09.125039 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Feb 16 05:21:09.125039 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: Feb 16 05:21:09.125895 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45851f85-f897-4ecd-98aa-1f9b11ae4883 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:09.130339 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6582b-2932-4241-b370-c678e5a85ef6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:09.141384 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6582b-2932-4241-b370-c678e5a85ef6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:09.146943 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-45851f85-f897-4ecd-98aa-1f9b11ae4883 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 16 05:21:09.148554 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 380/766] 10.222.0.75 () {56 vars in 1150 bytes} [Wed Feb 16 05:21:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:09.155490 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45851f85-f897-4ecd-98aa-1f9b11ae4883 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:09.162774 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1049a-71d6-44d6-ba87-af59bb7eb88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:09.163444 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1049a-71d6-44d6-ba87-af59bb7eb88a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:09.163722 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1049a-71d6-44d6-ba87-af59bb7eb88a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:09.163988 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1049a-71d6-44d6-ba87-af59bb7eb88a admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:09.164785 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1049a-71d6-44d6-ba87-af59bb7eb88a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:09.165091 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1049a-71d6-44d6-ba87-af59bb7eb88a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:09.166976 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f1049a-71d6-44d6-ba87-af59bb7eb88a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:09.175219 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45851f85-f897-4ecd-98aa-1f9b11ae4883 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:09.191623 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 387/767] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:21:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:09.192643 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c252716-1850-40f5-8bd3-57d4cab04b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:09.193339 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c252716-1850-40f5-8bd3-57d4cab04b7c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:09.193624 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c252716-1850-40f5-8bd3-57d4cab04b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:09.193957 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c252716-1850-40f5-8bd3-57d4cab04b7c admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:09.194626 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c252716-1850-40f5-8bd3-57d4cab04b7c admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:09.194932 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c252716-1850-40f5-8bd3-57d4cab04b7c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:09.196550 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c252716-1850-40f5-8bd3-57d4cab04b7c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:09.200782 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1049a-71d6-44d6-ba87-af59bb7eb88a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:09.203514 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 381/768] 10.222.0.75 () {56 vars in 1145 bytes} [Wed Feb 16 05:21:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:09.209245 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c252716-1850-40f5-8bd3-57d4cab04b7c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:09.219001 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1049a-71d6-44d6-ba87-af59bb7eb88a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:09.222934 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c252716-1850-40f5-8bd3-57d4cab04b7c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:09.229925 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e201b5d-50e5-4260-9be7-1ba03ab51052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:09.231109 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e201b5d-50e5-4260-9be7-1ba03ab51052 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:09.231389 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e201b5d-50e5-4260-9be7-1ba03ab51052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:09.231661 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e201b5d-50e5-4260-9be7-1ba03ab51052 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:09.232495 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e201b5d-50e5-4260-9be7-1ba03ab51052 admin admin] RBAC: Adding query filter params (role.id=9ba4a5967ed243178927661616f08901, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=92eb49cac0c94e73a70361831dd789b2) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:09.232799 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e201b5d-50e5-4260-9be7-1ba03ab51052 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:09.235235 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e201b5d-50e5-4260-9be7-1ba03ab51052 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:09.237644 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89e0a0-b029-4290-87fe-6fea41402918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:09.238295 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89e0a0-b029-4290-87fe-6fea41402918 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:09.238573 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89e0a0-b029-4290-87fe-6fea41402918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:09.238848 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89e0a0-b029-4290-87fe-6fea41402918 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:09.239558 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89e0a0-b029-4290-87fe-6fea41402918 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:09.239862 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89e0a0-b029-4290-87fe-6fea41402918 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:09.241489 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89e0a0-b029-4290-87fe-6fea41402918 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:09.249904 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 388/769] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:21:09 2022] GET /identity/v3/role_assignments?user.id=92eb49cac0c94e73a70361831dd789b2&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=9ba4a5967ed243178927661616f08901 => generated 259 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:09.252200 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 382/770] 10.222.0.75 () {56 vars in 1145 bytes} [Wed Feb 16 05:21:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:09.261118 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e201b5d-50e5-4260-9be7-1ba03ab51052 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:09.274660 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e201b5d-50e5-4260-9be7-1ba03ab51052 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:09.284080 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d278d-8b0b-43f6-9243-cdcbb970af81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:09.284861 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d278d-8b0b-43f6-9243-cdcbb970af81 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:09.285215 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d278d-8b0b-43f6-9243-cdcbb970af81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:09.285591 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d278d-8b0b-43f6-9243-cdcbb970af81 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:09.286476 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d278d-8b0b-43f6-9243-cdcbb970af81 admin admin] RBAC: Adding query filter params (interface=public, service_id=805207c7310d43ef86c477941ad53523, region_id=RegionOne) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:09.286866 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d278d-8b0b-43f6-9243-cdcbb970af81 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:09.287961 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-581d278d-8b0b-43f6-9243-cdcbb970af81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:21:09.287961 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Feb 16 05:21:09.287961 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: Feb 16 05:21:09.289065 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d278d-8b0b-43f6-9243-cdcbb970af81 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:09.297725 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 389/771] 10.222.0.75 () {56 vars in 1272 bytes} [Wed Feb 16 05:21:09 2022] GET /identity/v3/endpoints?service_id=805207c7310d43ef86c477941ad53523&interface=public®ion_id=RegionOne => generated 194 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:09.306912 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89e0a0-b029-4290-87fe-6fea41402918 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:09.318613 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89e0a0-b029-4290-87fe-6fea41402918 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:09.329958 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe57914-0fff-4246-afbb-292ceb6ef8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:09.330822 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe57914-0fff-4246-afbb-292ceb6ef8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:09.331180 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe57914-0fff-4246-afbb-292ceb6ef8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:09.331528 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe57914-0fff-4246-afbb-292ceb6ef8e9 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:09.332368 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe57914-0fff-4246-afbb-292ceb6ef8e9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:09.334139 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe57914-0fff-4246-afbb-292ceb6ef8e9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:09.341022 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 383/772] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Feb 16 05:21:09 2022] GET /identity/v3/services => generated 772 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:10.427678 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f738994-119d-4a1a-bff8-b3d750488edd None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:10.428264 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f738994-119d-4a1a-bff8-b3d750488edd None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:10.428264 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f738994-119d-4a1a-bff8-b3d750488edd None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:10.430248 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 390/773] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:10.436407 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c6f99-555d-492c-9802-feb00390971e None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:10.436792 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c6f99-555d-492c-9802-feb00390971e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:10.436957 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c6f99-555d-492c-9802-feb00390971e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:10.462253 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f68c6f99-555d-492c-9802-feb00390971e None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:10.463482 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f68c6f99-555d-492c-9802-feb00390971e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:10.478919 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 384/774] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:10 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:10.514615 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f738994-119d-4a1a-bff8-b3d750488edd None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:10.529445 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f738994-119d-4a1a-bff8-b3d750488edd None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:10.534021 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699faf6-35da-404b-bbcc-1d324f6f4e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:10.535180 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699faf6-35da-404b-bbcc-1d324f6f4e63 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:10.535654 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699faf6-35da-404b-bbcc-1d324f6f4e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:10.536114 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699faf6-35da-404b-bbcc-1d324f6f4e63 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:10.536966 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699faf6-35da-404b-bbcc-1d324f6f4e63 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:10.538772 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699faf6-35da-404b-bbcc-1d324f6f4e63 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:10.554754 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-1699faf6-35da-404b-bbcc-1d324f6f4e63 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 16 05:21:10.561375 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 391/775] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:10 2022] GET /identity/v3/services/network => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:10.563315 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c6f99-555d-492c-9802-feb00390971e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:10.578912 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c6f99-555d-492c-9802-feb00390971e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:10.584558 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3336ad-b6c7-4c00-a2e3-8ded7c0b5a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:10.585213 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3336ad-b6c7-4c00-a2e3-8ded7c0b5a1b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:10.585524 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3336ad-b6c7-4c00-a2e3-8ded7c0b5a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:10.585793 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3336ad-b6c7-4c00-a2e3-8ded7c0b5a1b admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:10.586502 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3336ad-b6c7-4c00-a2e3-8ded7c0b5a1b admin admin] RBAC: Adding query filter params (name=network) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:10.586805 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3336ad-b6c7-4c00-a2e3-8ded7c0b5a1b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:10.588422 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3336ad-b6c7-4c00-a2e3-8ded7c0b5a1b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:10.601655 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 385/776] 10.222.0.75 () {56 vars in 1133 bytes} [Wed Feb 16 05:21:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:10.607170 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699faf6-35da-404b-bbcc-1d324f6f4e63 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:10.617927 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699faf6-35da-404b-bbcc-1d324f6f4e63 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:10.626845 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e3468-b473-40f8-b626-5ea11dea03cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:10.627502 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e3468-b473-40f8-b626-5ea11dea03cc admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:10.627780 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e3468-b473-40f8-b626-5ea11dea03cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:10.628048 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e3468-b473-40f8-b626-5ea11dea03cc admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:10.628755 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e3468-b473-40f8-b626-5ea11dea03cc admin admin] RBAC: Adding query filter params (type=network) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:10.629053 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e3468-b473-40f8-b626-5ea11dea03cc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:10.630691 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e3468-b473-40f8-b626-5ea11dea03cc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:10.636850 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 392/777] 10.222.0.75 () {56 vars in 1133 bytes} [Wed Feb 16 05:21:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:10.642475 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3336ad-b6c7-4c00-a2e3-8ded7c0b5a1b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:10.652806 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3336ad-b6c7-4c00-a2e3-8ded7c0b5a1b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:10.657383 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796f609-0281-43c7-90c5-f56353d3b5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:10.658029 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796f609-0281-43c7-90c5-f56353d3b5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:10.658309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796f609-0281-43c7-90c5-f56353d3b5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:10.658578 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796f609-0281-43c7-90c5-f56353d3b5f0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:10.659368 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796f609-0281-43c7-90c5-f56353d3b5f0 admin admin] RBAC: Adding query filter params (interface=public, service_id=20104c3a92aa42779f07fcf49b5b5bf4, region_id=RegionOne) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:10.659675 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796f609-0281-43c7-90c5-f56353d3b5f0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:10.660698 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-6796f609-0281-43c7-90c5-f56353d3b5f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:21:10.660698 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Feb 16 05:21:10.660698 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: Feb 16 05:21:10.661603 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796f609-0281-43c7-90c5-f56353d3b5f0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:10.671888 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 386/778] 10.222.0.75 () {56 vars in 1272 bytes} [Wed Feb 16 05:21:10 2022] GET /identity/v3/endpoints?service_id=20104c3a92aa42779f07fcf49b5b5bf4&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:10.677305 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e3468-b473-40f8-b626-5ea11dea03cc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:10.687503 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e3468-b473-40f8-b626-5ea11dea03cc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:10.691952 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4e1e4-a8a9-4c49-b905-d7ef1c22183d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:10.692601 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4e1e4-a8a9-4c49-b905-d7ef1c22183d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:10.692880 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4e1e4-a8a9-4c49-b905-d7ef1c22183d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:10.693152 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4e1e4-a8a9-4c49-b905-d7ef1c22183d admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:10.693863 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4e1e4-a8a9-4c49-b905-d7ef1c22183d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:10.695456 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4e1e4-a8a9-4c49-b905-d7ef1c22183d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:10.701615 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 393/779] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Feb 16 05:21:10 2022] GET /identity/v3/services => generated 772 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:10.922798 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033e74c-42ee-4b9a-86e5-3a1c188d1104 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:10.923072 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033e74c-42ee-4b9a-86e5-3a1c188d1104 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:10.923340 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033e74c-42ee-4b9a-86e5-3a1c188d1104 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:10.925389 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 387/780] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:10.930709 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e794169-4ca4-442c-9c1c-f9ed343857e6 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:10.931253 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e794169-4ca4-442c-9c1c-f9ed343857e6 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:10.931529 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e794169-4ca4-442c-9c1c-f9ed343857e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:10.951502 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-8e794169-4ca4-442c-9c1c-f9ed343857e6 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:10.952620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8e794169-4ca4-442c-9c1c-f9ed343857e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:10.960582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 394/781] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:10 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:10.985046 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033e74c-42ee-4b9a-86e5-3a1c188d1104 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:10.998752 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033e74c-42ee-4b9a-86e5-3a1c188d1104 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:11.003168 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58576ef-9502-46cd-a0cb-2fc704ad32a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:11.003934 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58576ef-9502-46cd-a0cb-2fc704ad32a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:11.004211 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58576ef-9502-46cd-a0cb-2fc704ad32a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:11.004479 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58576ef-9502-46cd-a0cb-2fc704ad32a2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:11.016827 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58576ef-9502-46cd-a0cb-2fc704ad32a2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:21:11.023589 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-a58576ef-9502-46cd-a0cb-2fc704ad32a2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:21:11.025073 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 388/782] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:21:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:11.031733 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e794169-4ca4-442c-9c1c-f9ed343857e6 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:11.043985 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e794169-4ca4-442c-9c1c-f9ed343857e6 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:11.048852 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4832aeb-054e-4d87-bbd5-fb55814d591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:11.049738 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4832aeb-054e-4d87-bbd5-fb55814d591b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:11.050231 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4832aeb-054e-4d87-bbd5-fb55814d591b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:11.050694 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4832aeb-054e-4d87-bbd5-fb55814d591b admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:11.051634 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4832aeb-054e-4d87-bbd5-fb55814d591b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:11.052128 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4832aeb-054e-4d87-bbd5-fb55814d591b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:11.055090 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4832aeb-054e-4d87-bbd5-fb55814d591b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:11.068224 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 395/783] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:21:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:11.070536 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58576ef-9502-46cd-a0cb-2fc704ad32a2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:11.081212 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58576ef-9502-46cd-a0cb-2fc704ad32a2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:11.086600 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b071aaf-5a8d-4380-801a-bffcca0994ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:11.087803 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b071aaf-5a8d-4380-801a-bffcca0994ae admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:11.088317 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b071aaf-5a8d-4380-801a-bffcca0994ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:11.088780 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b071aaf-5a8d-4380-801a-bffcca0994ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:11.100775 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b071aaf-5a8d-4380-801a-bffcca0994ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:11.102960 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b071aaf-5a8d-4380-801a-bffcca0994ae admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:11.121735 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-9b071aaf-5a8d-4380-801a-bffcca0994ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:11.127876 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 389/784] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:11.129488 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4832aeb-054e-4d87-bbd5-fb55814d591b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:11.140124 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4832aeb-054e-4d87-bbd5-fb55814d591b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:11.144807 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d984cf-aff3-4d55-9518-e79b5954a2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:11.145771 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d984cf-aff3-4d55-9518-e79b5954a2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:11.146268 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d984cf-aff3-4d55-9518-e79b5954a2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:11.146779 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d984cf-aff3-4d55-9518-e79b5954a2f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:11.147851 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d984cf-aff3-4d55-9518-e79b5954a2f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:11.148346 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d984cf-aff3-4d55-9518-e79b5954a2f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:11.150219 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d984cf-aff3-4d55-9518-e79b5954a2f1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:11.166862 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 396/785] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:11.172746 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b071aaf-5a8d-4380-801a-bffcca0994ae admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:11.184371 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b071aaf-5a8d-4380-801a-bffcca0994ae admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:11.192952 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a969e0-eb57-4e15-9be7-fcee58481c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:11.194028 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a969e0-eb57-4e15-9be7-fcee58481c82 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:11.194521 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a969e0-eb57-4e15-9be7-fcee58481c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:11.195001 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a969e0-eb57-4e15-9be7-fcee58481c82 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:11.206103 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a969e0-eb57-4e15-9be7-fcee58481c82 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:11.208417 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a969e0-eb57-4e15-9be7-fcee58481c82 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:11.223280 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-22a969e0-eb57-4e15-9be7-fcee58481c82 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 05:21:11.224824 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 390/786] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Feb 16 05:21:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:11.230767 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d984cf-aff3-4d55-9518-e79b5954a2f1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:11.241015 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d984cf-aff3-4d55-9518-e79b5954a2f1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:11.246282 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bc09b-f6b5-4678-a429-6fa2e7ee5cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:11.247198 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bc09b-f6b5-4678-a429-6fa2e7ee5cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:11.247837 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bc09b-f6b5-4678-a429-6fa2e7ee5cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:11.248355 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bc09b-f6b5-4678-a429-6fa2e7ee5cb7 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:11.249419 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bc09b-f6b5-4678-a429-6fa2e7ee5cb7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:11.249916 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bc09b-f6b5-4678-a429-6fa2e7ee5cb7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:11.251992 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bc09b-f6b5-4678-a429-6fa2e7ee5cb7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:11.273997 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 397/787] 10.222.0.75 () {56 vars in 1154 bytes} [Wed Feb 16 05:21:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:11.279908 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a969e0-eb57-4e15-9be7-fcee58481c82 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:11.290004 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a969e0-eb57-4e15-9be7-fcee58481c82 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:11.294790 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7047c42-ec2a-40d5-926f-bc43b8d4b2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:11.295716 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7047c42-ec2a-40d5-926f-bc43b8d4b2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:11.296208 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7047c42-ec2a-40d5-926f-bc43b8d4b2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:11.296719 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7047c42-ec2a-40d5-926f-bc43b8d4b2e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:11.305366 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7047c42-ec2a-40d5-926f-bc43b8d4b2e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:11.307681 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7047c42-ec2a-40d5-926f-bc43b8d4b2e2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:11.321369 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 391/788] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:21:11 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:21:11.324676 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bc09b-f6b5-4678-a429-6fa2e7ee5cb7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:11.334933 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bc09b-f6b5-4678-a429-6fa2e7ee5cb7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:11.339683 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6a911-d92f-43ea-8dfb-e9e4e0a3f5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:11.340770 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6a911-d92f-43ea-8dfb-e9e4e0a3f5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:11.341239 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6a911-d92f-43ea-8dfb-e9e4e0a3f5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:11.341789 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6a911-d92f-43ea-8dfb-e9e4e0a3f5e8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:11.347007 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77960f30-9ead-42cc-b10f-699338ac2dc8 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:11.347513 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77960f30-9ead-42cc-b10f-699338ac2dc8 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:11.348159 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77960f30-9ead-42cc-b10f-699338ac2dc8 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:11.350234 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 392/789] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 05:21:11.355901 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c2be2-f2b8-42b7-bbe0-e9058ebfb33b None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:11.356394 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c2be2-f2b8-42b7-bbe0-e9058ebfb33b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:11.356873 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c2be2-f2b8-42b7-bbe0-e9058ebfb33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:11.372436 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6a911-d92f-43ea-8dfb-e9e4e0a3f5e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:11.374613 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6a911-d92f-43ea-8dfb-e9e4e0a3f5e8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:11.387087 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ff1c2be2-f2b8-42b7-bbe0-e9058ebfb33b None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:11.388496 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ff1c2be2-f2b8-42b7-bbe0-e9058ebfb33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:11.401685 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-d9d6a911-d92f-43ea-8dfb-e9e4e0a3f5e8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:11.407759 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 398/790] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:11.409122 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6a911-d92f-43ea-8dfb-e9e4e0a3f5e8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:11.415535 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 393/791] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:11 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:21:11.420252 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6a911-d92f-43ea-8dfb-e9e4e0a3f5e8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:11.425177 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751fa7b-45c5-4582-a78a-8e5cd6a7c473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:11.426092 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751fa7b-45c5-4582-a78a-8e5cd6a7c473 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:11.426560 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751fa7b-45c5-4582-a78a-8e5cd6a7c473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:11.427128 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751fa7b-45c5-4582-a78a-8e5cd6a7c473 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:11.428085 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751fa7b-45c5-4582-a78a-8e5cd6a7c473 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:11.429056 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751fa7b-45c5-4582-a78a-8e5cd6a7c473 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:11.430891 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751fa7b-45c5-4582-a78a-8e5cd6a7c473 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:11.447836 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c2be2-f2b8-42b7-bbe0-e9058ebfb33b None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:11.448641 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 399/792] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:11.455290 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751fa7b-45c5-4582-a78a-8e5cd6a7c473 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:11.461811 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c2be2-f2b8-42b7-bbe0-e9058ebfb33b None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:11.472841 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07155c9e-14e4-4a2e-8159-16610843810c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:11.476459 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07155c9e-14e4-4a2e-8159-16610843810c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:11.476870 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751fa7b-45c5-4582-a78a-8e5cd6a7c473 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:11.477601 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07155c9e-14e4-4a2e-8159-16610843810c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:11.479393 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07155c9e-14e4-4a2e-8159-16610843810c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:11.489361 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40730a-70f8-412c-a785-100168ccb53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:11.490496 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40730a-70f8-412c-a785-100168ccb53b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:11.491574 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40730a-70f8-412c-a785-100168ccb53b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:11.492040 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40730a-70f8-412c-a785-100168ccb53b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:11.507354 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07155c9e-14e4-4a2e-8159-16610843810c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:21:11.514830 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40730a-70f8-412c-a785-100168ccb53b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:11.517765 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40730a-70f8-412c-a785-100168ccb53b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:11.524810 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-07155c9e-14e4-4a2e-8159-16610843810c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 05:21:11.527474 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 394/793] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:21:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:11.534284 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07155c9e-14e4-4a2e-8159-16610843810c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:11.541309 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-ca40730a-70f8-412c-a785-100168ccb53b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:21:11.541309 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 400/794] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:11.545882 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07155c9e-14e4-4a2e-8159-16610843810c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:11.547485 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40730a-70f8-412c-a785-100168ccb53b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:11.558593 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40730a-70f8-412c-a785-100168ccb53b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:11.561941 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8091c-ccf3-4a6f-90be-5f5746a25754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:11.562603 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8091c-ccf3-4a6f-90be-5f5746a25754 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:11.562884 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8091c-ccf3-4a6f-90be-5f5746a25754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:11.563161 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8091c-ccf3-4a6f-90be-5f5746a25754 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:11.563916 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8091c-ccf3-4a6f-90be-5f5746a25754 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:11.564220 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8091c-ccf3-4a6f-90be-5f5746a25754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:11.565869 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8091c-ccf3-4a6f-90be-5f5746a25754 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:11.574733 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab6643-c630-4805-a419-dd049a089583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:11.575419 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab6643-c630-4805-a419-dd049a089583 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:11.575698 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab6643-c630-4805-a419-dd049a089583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:11.575972 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab6643-c630-4805-a419-dd049a089583 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:11.576756 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab6643-c630-4805-a419-dd049a089583 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:11.577055 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab6643-c630-4805-a419-dd049a089583 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:11.578937 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab6643-c630-4805-a419-dd049a089583 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:11.593514 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 395/795] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Feb 16 05:21:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:11.594462 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8091c-ccf3-4a6f-90be-5f5746a25754 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:11.606925 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 401/796] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:21:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:11.609212 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8091c-ccf3-4a6f-90be-5f5746a25754 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:11.611285 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab6643-c630-4805-a419-dd049a089583 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:11.623879 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab6643-c630-4805-a419-dd049a089583 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:11.625104 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6550b-4997-4622-8173-509dc3f1b21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:11.625930 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6550b-4997-4622-8173-509dc3f1b21a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:11.626203 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6550b-4997-4622-8173-509dc3f1b21a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:11.626472 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6550b-4997-4622-8173-509dc3f1b21a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:11.639125 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04c29b-e603-49fd-b0d7-936398b003cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:11.639778 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04c29b-e603-49fd-b0d7-936398b003cb admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:11.640059 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04c29b-e603-49fd-b0d7-936398b003cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:11.640333 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04c29b-e603-49fd-b0d7-936398b003cb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:11.641166 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04c29b-e603-49fd-b0d7-936398b003cb admin admin] RBAC: Adding query filter params (role.id=9ba4a5967ed243178927661616f08901, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=6522d231532a48ad8dbc9c9e79a021dd) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:11.641500 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04c29b-e603-49fd-b0d7-936398b003cb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:11.643372 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04c29b-e603-49fd-b0d7-936398b003cb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:11.646184 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6550b-4997-4622-8173-509dc3f1b21a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:11.648023 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6550b-4997-4622-8173-509dc3f1b21a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:11.653089 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 402/797] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:21:11 2022] GET /identity/v3/role_assignments?user.id=6522d231532a48ad8dbc9c9e79a021dd&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=9ba4a5967ed243178927661616f08901 => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:11.682444 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-b1a6550b-4997-4622-8173-509dc3f1b21a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:11.684488 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 396/798] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:11.690013 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04c29b-e603-49fd-b0d7-936398b003cb admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:11.712144 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04c29b-e603-49fd-b0d7-936398b003cb admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:11.721783 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70486d-9344-400e-a7f2-36d0da323aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:11.722474 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70486d-9344-400e-a7f2-36d0da323aaf admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:11.722752 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70486d-9344-400e-a7f2-36d0da323aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:11.723025 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70486d-9344-400e-a7f2-36d0da323aaf admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:11.723764 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70486d-9344-400e-a7f2-36d0da323aaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:11.724066 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70486d-9344-400e-a7f2-36d0da323aaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:11.729949 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70486d-9344-400e-a7f2-36d0da323aaf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:11.743155 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 403/799] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:11.750098 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6550b-4997-4622-8173-509dc3f1b21a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:11.760043 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6550b-4997-4622-8173-509dc3f1b21a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:11.765504 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e526f44-cdb1-4be7-99f3-4ed8e4b3347a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:11.766295 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e526f44-cdb1-4be7-99f3-4ed8e4b3347a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:11.766591 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e526f44-cdb1-4be7-99f3-4ed8e4b3347a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:11.766830 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e526f44-cdb1-4be7-99f3-4ed8e4b3347a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:11.774983 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e526f44-cdb1-4be7-99f3-4ed8e4b3347a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:11.777740 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e526f44-cdb1-4be7-99f3-4ed8e4b3347a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:11.793779 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-2e526f44-cdb1-4be7-99f3-4ed8e4b3347a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 05:21:11.795346 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 397/800] 10.222.0.75 () {56 vars in 1138 bytes} [Wed Feb 16 05:21:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:11.800917 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70486d-9344-400e-a7f2-36d0da323aaf admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:11.811153 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70486d-9344-400e-a7f2-36d0da323aaf admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:11.815759 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b03f9c-7fc9-442e-9d15-cf9c7317b99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:11.816427 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b03f9c-7fc9-442e-9d15-cf9c7317b99d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:11.816755 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b03f9c-7fc9-442e-9d15-cf9c7317b99d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:11.817026 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b03f9c-7fc9-442e-9d15-cf9c7317b99d admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:11.817957 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b03f9c-7fc9-442e-9d15-cf9c7317b99d admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:11.818256 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b03f9c-7fc9-442e-9d15-cf9c7317b99d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:11.820241 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b03f9c-7fc9-442e-9d15-cf9c7317b99d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:11.844063 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 404/801] 10.222.0.75 () {56 vars in 1170 bytes} [Wed Feb 16 05:21:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:11.849057 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e526f44-cdb1-4be7-99f3-4ed8e4b3347a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:11.866548 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e526f44-cdb1-4be7-99f3-4ed8e4b3347a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:11.871656 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94b1ca-354c-4a4e-a7c0-3562fe8812cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:11.872435 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94b1ca-354c-4a4e-a7c0-3562fe8812cd admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:11.872706 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94b1ca-354c-4a4e-a7c0-3562fe8812cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:11.872971 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94b1ca-354c-4a4e-a7c0-3562fe8812cd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:11.893031 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94b1ca-354c-4a4e-a7c0-3562fe8812cd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:11.894997 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94b1ca-354c-4a4e-a7c0-3562fe8812cd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:11.918986 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-4b94b1ca-354c-4a4e-a7c0-3562fe8812cd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:11.920532 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 398/802] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:11.926162 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b03f9c-7fc9-442e-9d15-cf9c7317b99d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:11.942920 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b03f9c-7fc9-442e-9d15-cf9c7317b99d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:11.958785 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3d863-70fa-41f6-9378-05efc4c1716c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:11.959469 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3d863-70fa-41f6-9378-05efc4c1716c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:11.959749 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3d863-70fa-41f6-9378-05efc4c1716c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:11.960023 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3d863-70fa-41f6-9378-05efc4c1716c admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:11.960763 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3d863-70fa-41f6-9378-05efc4c1716c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:11.961070 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3d863-70fa-41f6-9378-05efc4c1716c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:11.962792 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3d863-70fa-41f6-9378-05efc4c1716c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:11.984483 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 405/803] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:11.990118 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94b1ca-354c-4a4e-a7c0-3562fe8812cd admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:12.002681 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94b1ca-354c-4a4e-a7c0-3562fe8812cd admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:12.008704 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4d731-4342-469c-8597-0fb60b165b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:12.009550 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4d731-4342-469c-8597-0fb60b165b09 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:12.009821 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4d731-4342-469c-8597-0fb60b165b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:12.010086 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4d731-4342-469c-8597-0fb60b165b09 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:12.019005 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4d731-4342-469c-8597-0fb60b165b09 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:12.020983 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4d731-4342-469c-8597-0fb60b165b09 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:12.035335 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-d4a4d731-4342-469c-8597-0fb60b165b09 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:21:12.036862 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 399/804] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:12.042469 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3d863-70fa-41f6-9378-05efc4c1716c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:12.053605 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3d863-70fa-41f6-9378-05efc4c1716c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:12.059147 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d81a14-9b7a-4e21-b4a1-ac21c23981a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:12.059816 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d81a14-9b7a-4e21-b4a1-ac21c23981a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:12.060094 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d81a14-9b7a-4e21-b4a1-ac21c23981a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:12.060373 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d81a14-9b7a-4e21-b4a1-ac21c23981a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:12.061174 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d81a14-9b7a-4e21-b4a1-ac21c23981a3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:12.061512 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d81a14-9b7a-4e21-b4a1-ac21c23981a3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:12.063410 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d81a14-9b7a-4e21-b4a1-ac21c23981a3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:12.079540 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 406/805] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:21:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:12.085521 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4d731-4342-469c-8597-0fb60b165b09 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:12.099098 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4d731-4342-469c-8597-0fb60b165b09 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:12.103798 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee64a6d-9fd1-435a-a8ed-ae74f4ddad2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:12.104666 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee64a6d-9fd1-435a-a8ed-ae74f4ddad2e admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:12.105637 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee64a6d-9fd1-435a-a8ed-ae74f4ddad2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:12.105918 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee64a6d-9fd1-435a-a8ed-ae74f4ddad2e admin admin] PATH_INFO: `/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/4d22345d2e2646cc99c74a2f9692b648/roles/0660c2b0286b42c78d66c437b4713a2f` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:12.120610 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fa547-e07f-4119-97f0-ecb2b127c313 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:12.121583 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fa547-e07f-4119-97f0-ecb2b127c313 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:12.121845 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fa547-e07f-4119-97f0-ecb2b127c313 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:12.123754 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 407/806] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 05:21:12.131655 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee64a6d-9fd1-435a-a8ed-ae74f4ddad2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4d0b5a3f7d4542a47a26e623500b4f, user_id=4d22345d2e2646cc99c74a2f9692b648, role_id=0660c2b0286b42c78d66c437b4713a2f)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:12.131823 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f338b3a-a6ce-4104-b3ed-bb063d3483e6 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:12.131823 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f338b3a-a6ce-4104-b3ed-bb063d3483e6 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:12.131823 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f338b3a-a6ce-4104-b3ed-bb063d3483e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:12.132071 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee64a6d-9fd1-435a-a8ed-ae74f4ddad2e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:12.146351 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 400/807] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:21:12 2022] PUT /identity/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/4d22345d2e2646cc99c74a2f9692b648/roles/0660c2b0286b42c78d66c437b4713a2f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:21:12.149537 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-6f338b3a-a6ce-4104-b3ed-bb063d3483e6 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:12.151051 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6f338b3a-a6ce-4104-b3ed-bb063d3483e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:12.224485 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 408/808] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:12 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:21:12.264485 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee64a6d-9fd1-435a-a8ed-ae74f4ddad2e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:12.275812 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee64a6d-9fd1-435a-a8ed-ae74f4ddad2e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:12.285960 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb902d2-bce9-40cf-93d2-c0b0b1a9495c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:12.287118 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb902d2-bce9-40cf-93d2-c0b0b1a9495c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:12.287667 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb902d2-bce9-40cf-93d2-c0b0b1a9495c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:12.288092 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb902d2-bce9-40cf-93d2-c0b0b1a9495c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:12.305814 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb902d2-bce9-40cf-93d2-c0b0b1a9495c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:21:12.313124 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-3eb902d2-bce9-40cf-93d2-c0b0b1a9495c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:21:12.318910 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 401/809] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:21:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:12.320271 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f338b3a-a6ce-4104-b3ed-bb063d3483e6 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:12.335615 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f338b3a-a6ce-4104-b3ed-bb063d3483e6 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:12.344601 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0fda0-79d2-4ee9-8903-619e34fbec3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:12.345692 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0fda0-79d2-4ee9-8903-619e34fbec3e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:12.346179 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0fda0-79d2-4ee9-8903-619e34fbec3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:12.346652 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0fda0-79d2-4ee9-8903-619e34fbec3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:12.347674 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0fda0-79d2-4ee9-8903-619e34fbec3e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:12.348173 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0fda0-79d2-4ee9-8903-619e34fbec3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:12.350068 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0fda0-79d2-4ee9-8903-619e34fbec3e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:12.364948 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 409/810] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:21:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:12.371496 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb902d2-bce9-40cf-93d2-c0b0b1a9495c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:12.391686 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb902d2-bce9-40cf-93d2-c0b0b1a9495c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:12.399366 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30f3c9-c00a-4a6c-9201-63fc5117dee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:12.400204 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30f3c9-c00a-4a6c-9201-63fc5117dee5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:12.400484 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30f3c9-c00a-4a6c-9201-63fc5117dee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:12.400755 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30f3c9-c00a-4a6c-9201-63fc5117dee5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:12.412254 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30f3c9-c00a-4a6c-9201-63fc5117dee5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:12.414201 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30f3c9-c00a-4a6c-9201-63fc5117dee5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:12.431708 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-9f30f3c9-c00a-4a6c-9201-63fc5117dee5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:12.437391 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 402/811] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:12.439399 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0fda0-79d2-4ee9-8903-619e34fbec3e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:12.449965 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0fda0-79d2-4ee9-8903-619e34fbec3e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:12.454715 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadb39e-420a-4b83-b932-6c87fee3711b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:12.455361 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadb39e-420a-4b83-b932-6c87fee3711b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:12.455635 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadb39e-420a-4b83-b932-6c87fee3711b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:12.455956 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadb39e-420a-4b83-b932-6c87fee3711b admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:12.456669 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadb39e-420a-4b83-b932-6c87fee3711b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:12.457022 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadb39e-420a-4b83-b932-6c87fee3711b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:12.458780 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadb39e-420a-4b83-b932-6c87fee3711b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:12.473860 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 410/812] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:12.479309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30f3c9-c00a-4a6c-9201-63fc5117dee5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:12.489403 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30f3c9-c00a-4a6c-9201-63fc5117dee5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:12.494006 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65f860-bcbc-4b19-8a7f-4451f0cdf06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:12.494829 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65f860-bcbc-4b19-8a7f-4451f0cdf06d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:12.495104 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65f860-bcbc-4b19-8a7f-4451f0cdf06d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:12.495369 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65f860-bcbc-4b19-8a7f-4451f0cdf06d admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:12.504381 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65f860-bcbc-4b19-8a7f-4451f0cdf06d admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:12.506508 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65f860-bcbc-4b19-8a7f-4451f0cdf06d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:12.508760 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf992b2-21fb-419d-bc6d-2cd29003329d None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:12.509038 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf992b2-21fb-419d-bc6d-2cd29003329d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:12.509326 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf992b2-21fb-419d-bc6d-2cd29003329d None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:12.518044 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 411/813] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:12.530072 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-df65f860-bcbc-4b19-8a7f-4451f0cdf06d admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 05:21:12.531435 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 403/814] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:21:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:12.533092 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d7aba-6077-4a6a-b515-0feb19be0428 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:12.533423 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d7aba-6077-4a6a-b515-0feb19be0428 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:12.533700 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d7aba-6077-4a6a-b515-0feb19be0428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:12.540920 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65f860-bcbc-4b19-8a7f-4451f0cdf06d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:12.564111 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65f860-bcbc-4b19-8a7f-4451f0cdf06d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:12.576996 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b91787-f230-4e23-8da1-b52a642cb654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:12.577697 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b91787-f230-4e23-8da1-b52a642cb654 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:12.577979 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b91787-f230-4e23-8da1-b52a642cb654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:12.578251 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b91787-f230-4e23-8da1-b52a642cb654 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:12.579099 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b91787-f230-4e23-8da1-b52a642cb654 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:12.579402 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b91787-f230-4e23-8da1-b52a642cb654 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:12.581282 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b91787-f230-4e23-8da1-b52a642cb654 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:12.617405 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 404/815] 10.222.0.75 () {56 vars in 1156 bytes} [Wed Feb 16 05:21:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:12.623905 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b91787-f230-4e23-8da1-b52a642cb654 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:12.634588 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b91787-f230-4e23-8da1-b52a642cb654 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:12.640080 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87066476-03b3-4051-a53c-2dc7b7ca5d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:12.640886 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87066476-03b3-4051-a53c-2dc7b7ca5d82 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:12.641211 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87066476-03b3-4051-a53c-2dc7b7ca5d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:12.641525 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87066476-03b3-4051-a53c-2dc7b7ca5d82 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:12.653899 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87066476-03b3-4051-a53c-2dc7b7ca5d82 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:12.655748 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87066476-03b3-4051-a53c-2dc7b7ca5d82 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:12.677292 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-87066476-03b3-4051-a53c-2dc7b7ca5d82 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:12.677292 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 405/816] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:12.681878 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87066476-03b3-4051-a53c-2dc7b7ca5d82 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:12.707075 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87066476-03b3-4051-a53c-2dc7b7ca5d82 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:12.716799 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2c768-c14b-4096-8e4a-f9d9196bf431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:12.717525 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c768-c14b-4096-8e4a-f9d9196bf431 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:12.717795 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c768-c14b-4096-8e4a-f9d9196bf431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:12.718061 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2c768-c14b-4096-8e4a-f9d9196bf431 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:12.718835 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2c768-c14b-4096-8e4a-f9d9196bf431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:12.719135 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2c768-c14b-4096-8e4a-f9d9196bf431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:12.725285 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2c768-c14b-4096-8e4a-f9d9196bf431 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:12.744902 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-9b2d7aba-6077-4a6a-b515-0feb19be0428 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:12.746773 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9b2d7aba-6077-4a6a-b515-0feb19be0428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:12.748300 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 406/817] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:12.754188 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2c768-c14b-4096-8e4a-f9d9196bf431 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:12.759389 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 412/818] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:12 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:12.767625 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2c768-c14b-4096-8e4a-f9d9196bf431 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:12.772227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9bebe-d29e-4f99-a347-1b3fd76ed3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:12.773050 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9bebe-d29e-4f99-a347-1b3fd76ed3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:12.773355 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9bebe-d29e-4f99-a347-1b3fd76ed3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:12.773623 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9bebe-d29e-4f99-a347-1b3fd76ed3f1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:12.781489 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9bebe-d29e-4f99-a347-1b3fd76ed3f1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:12.783509 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9bebe-d29e-4f99-a347-1b3fd76ed3f1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:12.797820 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-9cb9bebe-d29e-4f99-a347-1b3fd76ed3f1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:21:12.799229 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 407/819] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:12.804531 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d7aba-6077-4a6a-b515-0feb19be0428 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:12.811921 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9bebe-d29e-4f99-a347-1b3fd76ed3f1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:12.814750 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d7aba-6077-4a6a-b515-0feb19be0428 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:12.823431 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1aa0f3-212d-427e-8e8c-cdbc9c72ec63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:12.824803 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1aa0f3-212d-427e-8e8c-cdbc9c72ec63 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:12.825078 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1aa0f3-212d-427e-8e8c-cdbc9c72ec63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:12.827508 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1aa0f3-212d-427e-8e8c-cdbc9c72ec63 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:12.828824 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1aa0f3-212d-427e-8e8c-cdbc9c72ec63 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:12.832444 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1aa0f3-212d-427e-8e8c-cdbc9c72ec63 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:12.833072 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9bebe-d29e-4f99-a347-1b3fd76ed3f1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:12.844456 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4d58d-18d1-46ea-96e2-d81a148d9cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:12.845134 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4d58d-18d1-46ea-96e2-d81a148d9cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:12.845435 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4d58d-18d1-46ea-96e2-d81a148d9cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:12.845700 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4d58d-18d1-46ea-96e2-d81a148d9cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:12.849388 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4d58d-18d1-46ea-96e2-d81a148d9cf1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:12.849703 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4d58d-18d1-46ea-96e2-d81a148d9cf1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:12.851657 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4d58d-18d1-46ea-96e2-d81a148d9cf1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:12.855186 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-7f1aa0f3-212d-427e-8e8c-cdbc9c72ec63 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 16 05:21:12.856375 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 413/820] 10.222.0.75 () {56 vars in 1150 bytes} [Wed Feb 16 05:21:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:12.862797 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1aa0f3-212d-427e-8e8c-cdbc9c72ec63 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:12.877328 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 408/821] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:21:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:12.878938 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4d58d-18d1-46ea-96e2-d81a148d9cf1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:12.879770 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1aa0f3-212d-427e-8e8c-cdbc9c72ec63 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:12.889514 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4d58d-18d1-46ea-96e2-d81a148d9cf1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:12.894231 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7733b-e29f-43a4-a6c8-f5ee062a4b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:12.894787 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fae89c-f87a-481b-b0ad-46a405239c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:12.895185 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7733b-e29f-43a4-a6c8-f5ee062a4b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:12.895444 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fae89c-f87a-481b-b0ad-46a405239c1e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:12.895553 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7733b-e29f-43a4-a6c8-f5ee062a4b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:12.895715 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c7733b-e29f-43a4-a6c8-f5ee062a4b00 admin admin] PATH_INFO: `/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/92eb49cac0c94e73a70361831dd789b2/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:12.895806 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fae89c-f87a-481b-b0ad-46a405239c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:12.895979 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fae89c-f87a-481b-b0ad-46a405239c1e admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:12.896685 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fae89c-f87a-481b-b0ad-46a405239c1e admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:12.896986 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fae89c-f87a-481b-b0ad-46a405239c1e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:12.897735 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7733b-e29f-43a4-a6c8-f5ee062a4b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4d0b5a3f7d4542a47a26e623500b4f, user_id=92eb49cac0c94e73a70361831dd789b2, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:12.898605 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fae89c-f87a-481b-b0ad-46a405239c1e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:12.900592 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c7733b-e29f-43a4-a6c8-f5ee062a4b00 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:12.911897 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 414/822] 10.222.0.75 () {56 vars in 1145 bytes} [Wed Feb 16 05:21:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:12.917179 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fae89c-f87a-481b-b0ad-46a405239c1e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:12.919781 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 409/823] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:21:12 2022] PUT /identity/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/92eb49cac0c94e73a70361831dd789b2/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:21:12.931422 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fae89c-f87a-481b-b0ad-46a405239c1e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:13.027548 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a566f-4671-4b85-827c-772721db2fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:13.028529 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a566f-4671-4b85-827c-772721db2fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:13.029029 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a566f-4671-4b85-827c-772721db2fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:13.029473 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a566f-4671-4b85-827c-772721db2fe9 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:13.030353 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a566f-4671-4b85-827c-772721db2fe9 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:13.030821 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a566f-4671-4b85-827c-772721db2fe9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:13.032607 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a566f-4671-4b85-827c-772721db2fe9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:13.041916 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 415/824] 10.222.0.75 () {56 vars in 1145 bytes} [Wed Feb 16 05:21:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:13.047836 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7733b-e29f-43a4-a6c8-f5ee062a4b00 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:13.059183 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c7733b-e29f-43a4-a6c8-f5ee062a4b00 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:13.069741 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa697f-b692-4e76-bffa-ecbb27b7a974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:13.070405 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa697f-b692-4e76-bffa-ecbb27b7a974 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:13.070779 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa697f-b692-4e76-bffa-ecbb27b7a974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:13.071049 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa697f-b692-4e76-bffa-ecbb27b7a974 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:13.071800 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa697f-b692-4e76-bffa-ecbb27b7a974 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:13.072868 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-a8fa697f-b692-4e76-bffa-ecbb27b7a974 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:21:13.072868 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Feb 16 05:21:13.072868 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: Feb 16 05:21:13.074405 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa697f-b692-4e76-bffa-ecbb27b7a974 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:13.130332 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 410/825] 10.222.0.75 () {60 vars in 1165 bytes} [Wed Feb 16 05:21:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:21:13.610958 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e05e7b-34c4-4c8a-86aa-b25fb62652de None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:13.611477 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e05e7b-34c4-4c8a-86aa-b25fb62652de None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:13.611477 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e05e7b-34c4-4c8a-86aa-b25fb62652de None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:13.613783 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 416/826] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:13.619385 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aec42b-cd7e-4133-8de6-2b82a627adff None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:13.619912 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aec42b-cd7e-4133-8de6-2b82a627adff None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:13.619912 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aec42b-cd7e-4133-8de6-2b82a627adff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:13.644424 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-81aec42b-cd7e-4133-8de6-2b82a627adff None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:13.645684 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-81aec42b-cd7e-4133-8de6-2b82a627adff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:13.668227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 411/827] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:13 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:13.710812 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e05e7b-34c4-4c8a-86aa-b25fb62652de None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:13.730562 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e05e7b-34c4-4c8a-86aa-b25fb62652de None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:13.741975 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85860a56-1a55-4ce4-8d5e-b9f7b2ef43ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:13.742759 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85860a56-1a55-4ce4-8d5e-b9f7b2ef43ef admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:13.743035 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85860a56-1a55-4ce4-8d5e-b9f7b2ef43ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:13.743302 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85860a56-1a55-4ce4-8d5e-b9f7b2ef43ef admin admin] PATH_INFO: `/v3/services/network` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:13.744003 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85860a56-1a55-4ce4-8d5e-b9f7b2ef43ef admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:13.746295 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85860a56-1a55-4ce4-8d5e-b9f7b2ef43ef admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:13.757514 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-85860a56-1a55-4ce4-8d5e-b9f7b2ef43ef admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 16 05:21:13.758953 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 417/828] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:13 2022] GET /identity/v3/services/network => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:13.765207 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aec42b-cd7e-4133-8de6-2b82a627adff None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:13.774398 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aec42b-cd7e-4133-8de6-2b82a627adff None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:13.782143 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c321caa-1fb7-47cd-b48a-e70c18a20365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:13.782795 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c321caa-1fb7-47cd-b48a-e70c18a20365 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:13.783058 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c321caa-1fb7-47cd-b48a-e70c18a20365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:13.783327 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c321caa-1fb7-47cd-b48a-e70c18a20365 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:13.784013 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c321caa-1fb7-47cd-b48a-e70c18a20365 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:13.784313 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c321caa-1fb7-47cd-b48a-e70c18a20365 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:13.785965 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c321caa-1fb7-47cd-b48a-e70c18a20365 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:13.791059 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 412/829] 10.222.0.75 () {56 vars in 1133 bytes} [Wed Feb 16 05:21:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:13.796631 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85860a56-1a55-4ce4-8d5e-b9f7b2ef43ef admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:13.806663 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85860a56-1a55-4ce4-8d5e-b9f7b2ef43ef admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:13.817051 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c97b4c-303b-48ed-8b31-2144c6636dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:13.817767 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c97b4c-303b-48ed-8b31-2144c6636dbc admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:13.818039 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c97b4c-303b-48ed-8b31-2144c6636dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:13.818303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c97b4c-303b-48ed-8b31-2144c6636dbc admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:13.819059 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c97b4c-303b-48ed-8b31-2144c6636dbc admin admin] RBAC: Adding query filter params (type=network) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:13.819358 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c97b4c-303b-48ed-8b31-2144c6636dbc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:13.820997 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c97b4c-303b-48ed-8b31-2144c6636dbc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:13.828167 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 418/830] 10.222.0.75 () {56 vars in 1133 bytes} [Wed Feb 16 05:21:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:13.833667 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c321caa-1fb7-47cd-b48a-e70c18a20365 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:13.854369 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c321caa-1fb7-47cd-b48a-e70c18a20365 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:13.865528 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b23b7e-ce90-4ba0-8f71-79514d5f47d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:13.866123 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b23b7e-ce90-4ba0-8f71-79514d5f47d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:13.866402 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b23b7e-ce90-4ba0-8f71-79514d5f47d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:13.866676 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b23b7e-ce90-4ba0-8f71-79514d5f47d1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:13.867429 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b23b7e-ce90-4ba0-8f71-79514d5f47d1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:13.869051 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b23b7e-ce90-4ba0-8f71-79514d5f47d1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:13.915187 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 413/831] 10.222.0.75 () {60 vars in 1165 bytes} [Wed Feb 16 05:21:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:21:14.678698 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f846f-b936-4304-9655-e9c9e75c2c6b None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:14.679228 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f846f-b936-4304-9655-e9c9e75c2c6b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:14.679228 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f846f-b936-4304-9655-e9c9e75c2c6b None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:14.681591 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 419/832] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:14.687022 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276236cb-3f18-481e-b3ae-119891f8aedb None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:14.687544 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276236cb-3f18-481e-b3ae-119891f8aedb None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:14.687544 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276236cb-3f18-481e-b3ae-119891f8aedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:14.706282 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-276236cb-3f18-481e-b3ae-119891f8aedb None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:14.707474 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-276236cb-3f18-481e-b3ae-119891f8aedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:14.733367 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 414/833] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:14 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:21:14.751477 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f846f-b936-4304-9655-e9c9e75c2c6b None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:14.764840 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f846f-b936-4304-9655-e9c9e75c2c6b None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:14.769359 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4e44f-d986-40ed-aef4-367868cba745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:14.770169 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4e44f-d986-40ed-aef4-367868cba745 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:14.770451 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4e44f-d986-40ed-aef4-367868cba745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:14.770725 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4e44f-d986-40ed-aef4-367868cba745 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:14.771377 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4e44f-d986-40ed-aef4-367868cba745 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:14.772987 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4e44f-d986-40ed-aef4-367868cba745 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:14.785408 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-66e4e44f-d986-40ed-aef4-367868cba745 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 16 05:21:14.786911 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 420/834] 10.222.0.75 () {56 vars in 1153 bytes} [Wed Feb 16 05:21:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:14.793035 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276236cb-3f18-481e-b3ae-119891f8aedb None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:14.802117 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276236cb-3f18-481e-b3ae-119891f8aedb None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:14.806934 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf8708-05c5-47b6-889e-cf980c97d78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:14.807581 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf8708-05c5-47b6-889e-cf980c97d78e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:14.807862 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf8708-05c5-47b6-889e-cf980c97d78e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:14.808662 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf8708-05c5-47b6-889e-cf980c97d78e admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:14.809411 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf8708-05c5-47b6-889e-cf980c97d78e admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:14.809719 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf8708-05c5-47b6-889e-cf980c97d78e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:14.811336 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf8708-05c5-47b6-889e-cf980c97d78e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:14.820488 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 415/835] 10.222.0.75 () {56 vars in 1147 bytes} [Wed Feb 16 05:21:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:14.821822 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4e44f-d986-40ed-aef4-367868cba745 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:14.832824 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4e44f-d986-40ed-aef4-367868cba745 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:14.838041 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37547a8d-b6f1-4c64-b8ed-96301dd09e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:14.838684 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37547a8d-b6f1-4c64-b8ed-96301dd09e61 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:14.838957 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37547a8d-b6f1-4c64-b8ed-96301dd09e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:14.839795 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37547a8d-b6f1-4c64-b8ed-96301dd09e61 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:14.840496 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37547a8d-b6f1-4c64-b8ed-96301dd09e61 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:14.840791 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37547a8d-b6f1-4c64-b8ed-96301dd09e61 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:14.842397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37547a8d-b6f1-4c64-b8ed-96301dd09e61 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:14.847463 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 421/836] 10.222.0.75 () {56 vars in 1147 bytes} [Wed Feb 16 05:21:14 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:14.945881 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1261382-657a-44ad-87ec-749c5df37e31 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:14.946266 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1261382-657a-44ad-87ec-749c5df37e31 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:14.946648 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1261382-657a-44ad-87ec-749c5df37e31 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:14.949411 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 416/837] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:14.958046 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cef2b-85cb-47ac-9319-1bff49c729ec None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:14.958457 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cef2b-85cb-47ac-9319-1bff49c729ec None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:14.958822 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cef2b-85cb-47ac-9319-1bff49c729ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:14.977977 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-539cef2b-85cb-47ac-9319-1bff49c729ec None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:14.979183 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-539cef2b-85cb-47ac-9319-1bff49c729ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:14.988213 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 422/838] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:14 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:15.012257 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1261382-657a-44ad-87ec-749c5df37e31 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:15.024748 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1261382-657a-44ad-87ec-749c5df37e31 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:15.029849 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94d5e4-89b9-4bef-9848-7aaf97a67c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:15.030620 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94d5e4-89b9-4bef-9848-7aaf97a67c83 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:15.030892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94d5e4-89b9-4bef-9848-7aaf97a67c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:15.031162 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94d5e4-89b9-4bef-9848-7aaf97a67c83 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:15.042992 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94d5e4-89b9-4bef-9848-7aaf97a67c83 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:21:15.049931 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-3e94d5e4-89b9-4bef-9848-7aaf97a67c83 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 05:21:15.051501 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 417/839] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:21:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:15.057679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cef2b-85cb-47ac-9319-1bff49c729ec None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:15.067281 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cef2b-85cb-47ac-9319-1bff49c729ec None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:15.071870 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edfa7a-26fc-4911-8099-0d54c83ec5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:15.072517 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edfa7a-26fc-4911-8099-0d54c83ec5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:15.072799 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edfa7a-26fc-4911-8099-0d54c83ec5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:15.073066 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edfa7a-26fc-4911-8099-0d54c83ec5a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:15.074456 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edfa7a-26fc-4911-8099-0d54c83ec5a4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:15.074753 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edfa7a-26fc-4911-8099-0d54c83ec5a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:15.076335 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edfa7a-26fc-4911-8099-0d54c83ec5a4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:15.084953 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 423/840] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Feb 16 05:21:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:15.090439 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94d5e4-89b9-4bef-9848-7aaf97a67c83 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:15.100838 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94d5e4-89b9-4bef-9848-7aaf97a67c83 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:15.106096 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51e876-2dd0-4c44-995d-87524f64fd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:15.106963 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51e876-2dd0-4c44-995d-87524f64fd19 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:15.107235 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51e876-2dd0-4c44-995d-87524f64fd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:15.107498 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51e876-2dd0-4c44-995d-87524f64fd19 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:15.118296 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51e876-2dd0-4c44-995d-87524f64fd19 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:15.120192 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51e876-2dd0-4c44-995d-87524f64fd19 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:15.137734 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-cc51e876-2dd0-4c44-995d-87524f64fd19 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:15.138916 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 418/841] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:15.144620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edfa7a-26fc-4911-8099-0d54c83ec5a4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:15.154541 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edfa7a-26fc-4911-8099-0d54c83ec5a4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:15.163463 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199e1ad-84ce-4870-8ee4-45a17495952a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:15.164167 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199e1ad-84ce-4870-8ee4-45a17495952a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:15.164455 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199e1ad-84ce-4870-8ee4-45a17495952a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:15.164729 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199e1ad-84ce-4870-8ee4-45a17495952a admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:15.165517 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199e1ad-84ce-4870-8ee4-45a17495952a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:15.165823 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199e1ad-84ce-4870-8ee4-45a17495952a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:15.168042 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199e1ad-84ce-4870-8ee4-45a17495952a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:15.185386 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 424/842] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:15.187378 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51e876-2dd0-4c44-995d-87524f64fd19 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:15.199177 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51e876-2dd0-4c44-995d-87524f64fd19 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:15.204146 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2021904-654d-4006-a25e-c558d5ee48a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:15.205190 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2021904-654d-4006-a25e-c558d5ee48a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:15.205693 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2021904-654d-4006-a25e-c558d5ee48a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:15.206145 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2021904-654d-4006-a25e-c558d5ee48a9 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:15.214105 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2021904-654d-4006-a25e-c558d5ee48a9 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:15.216446 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2021904-654d-4006-a25e-c558d5ee48a9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:15.231838 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-e2021904-654d-4006-a25e-c558d5ee48a9 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 05:21:15.237412 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 419/843] 10.222.0.75 () {56 vars in 1138 bytes} [Wed Feb 16 05:21:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:15.239585 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199e1ad-84ce-4870-8ee4-45a17495952a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:15.250803 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199e1ad-84ce-4870-8ee4-45a17495952a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:15.256137 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414225e-d05f-4c75-8eb3-198e7f94e4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:15.257201 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414225e-d05f-4c75-8eb3-198e7f94e4de admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:15.257767 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414225e-d05f-4c75-8eb3-198e7f94e4de admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:15.258223 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414225e-d05f-4c75-8eb3-198e7f94e4de admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:15.259338 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414225e-d05f-4c75-8eb3-198e7f94e4de admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:15.259903 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414225e-d05f-4c75-8eb3-198e7f94e4de admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:15.262759 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414225e-d05f-4c75-8eb3-198e7f94e4de admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:15.287909 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 425/844] 10.222.0.75 () {56 vars in 1170 bytes} [Wed Feb 16 05:21:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:15.289561 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2021904-654d-4006-a25e-c558d5ee48a9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:15.300484 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2021904-654d-4006-a25e-c558d5ee48a9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:15.305455 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe12db-1212-4fec-9763-2d517a1cde71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:15.306771 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe12db-1212-4fec-9763-2d517a1cde71 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:15.307253 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe12db-1212-4fec-9763-2d517a1cde71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:15.307745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe12db-1212-4fec-9763-2d517a1cde71 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:15.317060 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe12db-1212-4fec-9763-2d517a1cde71 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:15.319166 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe12db-1212-4fec-9763-2d517a1cde71 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:15.333105 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 420/845] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:21:15 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:21:15.334656 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414225e-d05f-4c75-8eb3-198e7f94e4de admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:15.344829 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414225e-d05f-4c75-8eb3-198e7f94e4de admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:15.349644 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9e71e-0e0c-4621-a749-a0adcd855335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:15.350684 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9e71e-0e0c-4621-a749-a0adcd855335 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:15.351186 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9e71e-0e0c-4621-a749-a0adcd855335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:15.351663 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9e71e-0e0c-4621-a749-a0adcd855335 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:15.363172 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9e71e-0e0c-4621-a749-a0adcd855335 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:15.365309 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9e71e-0e0c-4621-a749-a0adcd855335 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:15.383164 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-05d9e71e-0e0c-4621-a749-a0adcd855335 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:15.389367 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 426/846] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:15.391271 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe12db-1212-4fec-9763-2d517a1cde71 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:15.400482 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe12db-1212-4fec-9763-2d517a1cde71 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:15.405987 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ebf80-e7d5-4347-8126-dd44e75ac3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:15.406851 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ebf80-e7d5-4347-8126-dd44e75ac3aa admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:15.407356 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ebf80-e7d5-4347-8126-dd44e75ac3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:15.407833 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ebf80-e7d5-4347-8126-dd44e75ac3aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:15.408741 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ebf80-e7d5-4347-8126-dd44e75ac3aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:15.409246 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ebf80-e7d5-4347-8126-dd44e75ac3aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:15.411089 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ebf80-e7d5-4347-8126-dd44e75ac3aa admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:15.427364 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 421/847] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:15.428989 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9e71e-0e0c-4621-a749-a0adcd855335 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:15.439342 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9e71e-0e0c-4621-a749-a0adcd855335 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:15.444214 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57440840-0df3-4ae5-a081-96bdaeeb274f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:15.445246 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57440840-0df3-4ae5-a081-96bdaeeb274f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:15.445821 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57440840-0df3-4ae5-a081-96bdaeeb274f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:15.446293 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57440840-0df3-4ae5-a081-96bdaeeb274f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:15.454194 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57440840-0df3-4ae5-a081-96bdaeeb274f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:15.456447 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57440840-0df3-4ae5-a081-96bdaeeb274f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:15.470655 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-57440840-0df3-4ae5-a081-96bdaeeb274f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:21:15.476803 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 427/848] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:15.478398 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ebf80-e7d5-4347-8126-dd44e75ac3aa admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:15.490683 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ebf80-e7d5-4347-8126-dd44e75ac3aa admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:15.495294 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839195fc-f1f9-41ca-b13a-238dad18d761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:15.496505 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839195fc-f1f9-41ca-b13a-238dad18d761 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:15.496782 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839195fc-f1f9-41ca-b13a-238dad18d761 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:15.497081 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839195fc-f1f9-41ca-b13a-238dad18d761 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:15.497892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839195fc-f1f9-41ca-b13a-238dad18d761 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:15.498196 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839195fc-f1f9-41ca-b13a-238dad18d761 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:15.500165 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839195fc-f1f9-41ca-b13a-238dad18d761 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:15.513696 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 422/849] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:21:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:15.519504 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57440840-0df3-4ae5-a081-96bdaeeb274f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:15.532148 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57440840-0df3-4ae5-a081-96bdaeeb274f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:15.537288 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160c707-d34d-4ec5-8cfa-480ab93b231e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:15.538203 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160c707-d34d-4ec5-8cfa-480ab93b231e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:15.538726 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160c707-d34d-4ec5-8cfa-480ab93b231e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:15.539215 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160c707-d34d-4ec5-8cfa-480ab93b231e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:15.540282 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160c707-d34d-4ec5-8cfa-480ab93b231e admin admin] RBAC: Adding query filter params (role.id=0660c2b0286b42c78d66c437b4713a2f, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=4d22345d2e2646cc99c74a2f9692b648) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:15.540859 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160c707-d34d-4ec5-8cfa-480ab93b231e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:15.543018 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160c707-d34d-4ec5-8cfa-480ab93b231e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:15.553381 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 428/850] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:21:15 2022] GET /identity/v3/role_assignments?user.id=4d22345d2e2646cc99c74a2f9692b648&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=0660c2b0286b42c78d66c437b4713a2f => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:15.625425 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8916b-d01c-4642-85f9-9d46a289c3fb None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:15.626055 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8916b-d01c-4642-85f9-9d46a289c3fb None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:15.626558 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8916b-d01c-4642-85f9-9d46a289c3fb None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:15.629140 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 423/851] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:15.636925 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8f422-74ab-43c0-9f7c-6a7631770b95 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:15.636925 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8f422-74ab-43c0-9f7c-6a7631770b95 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:15.636925 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8f422-74ab-43c0-9f7c-6a7631770b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:15.656122 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-90a8f422-74ab-43c0-9f7c-6a7631770b95 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:15.657412 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-90a8f422-74ab-43c0-9f7c-6a7631770b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:15.667021 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 429/852] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:15 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:15.690962 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8916b-d01c-4642-85f9-9d46a289c3fb None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:15.705168 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8916b-d01c-4642-85f9-9d46a289c3fb None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:15.709819 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c505c3-8f0c-4be6-af82-aca4aa4ad344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:15.710665 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c505c3-8f0c-4be6-af82-aca4aa4ad344 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:15.710941 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c505c3-8f0c-4be6-af82-aca4aa4ad344 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:15.711259 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c505c3-8f0c-4be6-af82-aca4aa4ad344 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:15.723878 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c505c3-8f0c-4be6-af82-aca4aa4ad344 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:21:15.731594 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-f5c505c3-8f0c-4be6-af82-aca4aa4ad344 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:21:15.733153 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 424/853] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:21:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:15.739418 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8f422-74ab-43c0-9f7c-6a7631770b95 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:15.750191 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8f422-74ab-43c0-9f7c-6a7631770b95 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:15.754715 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215994d-cbf8-41db-968a-4f361aa2102d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:15.755427 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215994d-cbf8-41db-968a-4f361aa2102d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:15.755757 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215994d-cbf8-41db-968a-4f361aa2102d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:15.756034 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215994d-cbf8-41db-968a-4f361aa2102d admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:15.756834 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215994d-cbf8-41db-968a-4f361aa2102d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:15.757141 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215994d-cbf8-41db-968a-4f361aa2102d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:15.758846 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215994d-cbf8-41db-968a-4f361aa2102d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:15.768153 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 430/854] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:21:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:15.773680 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c505c3-8f0c-4be6-af82-aca4aa4ad344 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:15.784688 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c505c3-8f0c-4be6-af82-aca4aa4ad344 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:15.789244 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b27aa-95c1-4d9d-8b62-7370229a4479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:15.790064 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b27aa-95c1-4d9d-8b62-7370229a4479 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:15.790386 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b27aa-95c1-4d9d-8b62-7370229a4479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:15.790710 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b27aa-95c1-4d9d-8b62-7370229a4479 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:15.803445 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b27aa-95c1-4d9d-8b62-7370229a4479 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:15.805713 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b27aa-95c1-4d9d-8b62-7370229a4479 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:15.824546 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-d11b27aa-95c1-4d9d-8b62-7370229a4479 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:15.826474 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 425/855] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:15.832122 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215994d-cbf8-41db-968a-4f361aa2102d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:15.848259 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215994d-cbf8-41db-968a-4f361aa2102d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:15.852983 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb4582-b23b-4d95-b196-81e43a971d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:15.854051 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb4582-b23b-4d95-b196-81e43a971d31 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:15.854051 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb4582-b23b-4d95-b196-81e43a971d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:15.854257 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb4582-b23b-4d95-b196-81e43a971d31 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:15.855457 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb4582-b23b-4d95-b196-81e43a971d31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:15.855782 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb4582-b23b-4d95-b196-81e43a971d31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:15.859050 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb4582-b23b-4d95-b196-81e43a971d31 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:15.871809 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 431/856] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:15.877127 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b27aa-95c1-4d9d-8b62-7370229a4479 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:15.887226 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b27aa-95c1-4d9d-8b62-7370229a4479 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:15.891738 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f392b1d-bc3c-436f-9747-d6c25b336779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:15.892507 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f392b1d-bc3c-436f-9747-d6c25b336779 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:15.892778 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f392b1d-bc3c-436f-9747-d6c25b336779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:15.893045 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f392b1d-bc3c-436f-9747-d6c25b336779 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:15.902136 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f392b1d-bc3c-436f-9747-d6c25b336779 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:15.904175 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f392b1d-bc3c-436f-9747-d6c25b336779 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:15.918190 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-4f392b1d-bc3c-436f-9747-d6c25b336779 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 16 05:21:15.919662 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 426/857] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:21:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:15.925132 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb4582-b23b-4d95-b196-81e43a971d31 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:15.935745 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb4582-b23b-4d95-b196-81e43a971d31 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:15.940277 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff684e4b-1e2a-41a0-a56a-499bc64b81d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:15.940923 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff684e4b-1e2a-41a0-a56a-499bc64b81d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:15.941192 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff684e4b-1e2a-41a0-a56a-499bc64b81d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:15.941501 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff684e4b-1e2a-41a0-a56a-499bc64b81d7 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:15.942361 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff684e4b-1e2a-41a0-a56a-499bc64b81d7 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:15.942630 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff684e4b-1e2a-41a0-a56a-499bc64b81d7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:15.944467 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff684e4b-1e2a-41a0-a56a-499bc64b81d7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:15.963182 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 432/858] 10.222.0.75 () {56 vars in 1156 bytes} [Wed Feb 16 05:21:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:15.969246 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f392b1d-bc3c-436f-9747-d6c25b336779 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:15.979495 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f392b1d-bc3c-436f-9747-d6c25b336779 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:15.985572 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6b704-ce6c-44ac-802f-8065a05e659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:15.986517 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6b704-ce6c-44ac-802f-8065a05e659b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:15.987013 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6b704-ce6c-44ac-802f-8065a05e659b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:15.987542 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6b704-ce6c-44ac-802f-8065a05e659b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:15.996283 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6b704-ce6c-44ac-802f-8065a05e659b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:15.998378 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6b704-ce6c-44ac-802f-8065a05e659b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:16.007974 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 427/859] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:21:15 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:21:16.013760 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff684e4b-1e2a-41a0-a56a-499bc64b81d7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:16.019393 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418abc9-e6b2-4802-8399-a6de4151b471 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:16.019728 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418abc9-e6b2-4802-8399-a6de4151b471 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:16.020004 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7418abc9-e6b2-4802-8399-a6de4151b471 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:16.022890 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 428/860] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 05:21:16.025354 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff684e4b-1e2a-41a0-a56a-499bc64b81d7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:16.028708 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bda43-6f9b-4afb-8942-4b50f830bc6a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:16.028984 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bda43-6f9b-4afb-8942-4b50f830bc6a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:16.029279 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235bda43-6f9b-4afb-8942-4b50f830bc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:16.032517 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf709f-f856-4673-90ab-bf892916000d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:16.033587 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf709f-f856-4673-90ab-bf892916000d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:16.034128 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf709f-f856-4673-90ab-bf892916000d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:16.034597 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf709f-f856-4673-90ab-bf892916000d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:16.046311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf709f-f856-4673-90ab-bf892916000d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:16.048674 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf709f-f856-4673-90ab-bf892916000d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:16.049124 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-235bda43-6f9b-4afb-8942-4b50f830bc6a None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:16.050385 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-235bda43-6f9b-4afb-8942-4b50f830bc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:16.064656 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 429/861] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:16 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:21:16.069893 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-b9cf709f-f856-4673-90ab-bf892916000d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:16.071359 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 433/862] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:16.077423 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bda43-6f9b-4afb-8942-4b50f830bc6a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:16.084131 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf709f-f856-4673-90ab-bf892916000d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:16.091944 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235bda43-6f9b-4afb-8942-4b50f830bc6a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:16.095439 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf709f-f856-4673-90ab-bf892916000d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:16.096720 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a23429-1020-4c32-a9ec-500f695344fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:16.097588 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a23429-1020-4c32-a9ec-500f695344fd admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:16.097963 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a23429-1020-4c32-a9ec-500f695344fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:16.098334 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a23429-1020-4c32-a9ec-500f695344fd admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:16.099152 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a23429-1020-4c32-a9ec-500f695344fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:16.099554 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a23429-1020-4c32-a9ec-500f695344fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:16.101364 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd12785-0141-4750-9d7d-c0b6ffca3602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:16.101590 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a23429-1020-4c32-a9ec-500f695344fd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:16.102477 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd12785-0141-4750-9d7d-c0b6ffca3602 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:16.102939 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd12785-0141-4750-9d7d-c0b6ffca3602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:16.103365 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd12785-0141-4750-9d7d-c0b6ffca3602 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:16.104199 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd12785-0141-4750-9d7d-c0b6ffca3602 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:16.106072 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd12785-0141-4750-9d7d-c0b6ffca3602 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:16.114125 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 430/863] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:16.117884 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-1fd12785-0141-4750-9d7d-c0b6ffca3602 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 16 05:21:16.119413 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 434/864] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Feb 16 05:21:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:16.126768 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a23429-1020-4c32-a9ec-500f695344fd admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:16.126958 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd12785-0141-4750-9d7d-c0b6ffca3602 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:16.137369 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd12785-0141-4750-9d7d-c0b6ffca3602 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:16.138391 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a23429-1020-4c32-a9ec-500f695344fd admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:16.142747 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38218f16-c734-4a81-98a6-bc384ae459d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:16.143311 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6c706-4664-40b1-ab86-8b5307d4f297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:16.143914 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38218f16-c734-4a81-98a6-bc384ae459d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:16.144435 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6c706-4664-40b1-ab86-8b5307d4f297 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:16.144798 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6c706-4664-40b1-ab86-8b5307d4f297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:16.145054 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38218f16-c734-4a81-98a6-bc384ae459d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:16.145195 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6c706-4664-40b1-ab86-8b5307d4f297 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:16.145671 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38218f16-c734-4a81-98a6-bc384ae459d9 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:16.146843 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38218f16-c734-4a81-98a6-bc384ae459d9 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:16.147350 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38218f16-c734-4a81-98a6-bc384ae459d9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:16.149503 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38218f16-c734-4a81-98a6-bc384ae459d9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:16.153868 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6c706-4664-40b1-ab86-8b5307d4f297 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:16.155567 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 435/865] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Feb 16 05:21:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:16.157493 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6c706-4664-40b1-ab86-8b5307d4f297 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:16.161144 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38218f16-c734-4a81-98a6-bc384ae459d9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:16.171421 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38218f16-c734-4a81-98a6-bc384ae459d9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:16.175451 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-e5a6c706-4664-40b1-ab86-8b5307d4f297 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:21:16.176113 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb7143-7234-4073-8ca9-95c3d835f741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:16.176797 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb7143-7234-4073-8ca9-95c3d835f741 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:16.177235 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb7143-7234-4073-8ca9-95c3d835f741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:16.177616 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb7143-7234-4073-8ca9-95c3d835f741 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:16.181319 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb7143-7234-4073-8ca9-95c3d835f741 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:16.181319 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb7143-7234-4073-8ca9-95c3d835f741 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:16.181319 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb7143-7234-4073-8ca9-95c3d835f741 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:16.181642 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 431/866] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:16.184490 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6c706-4664-40b1-ab86-8b5307d4f297 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:16.186369 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 436/867] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Feb 16 05:21:16 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:16.198892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6c706-4664-40b1-ab86-8b5307d4f297 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:16.203764 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1afd7e8-d261-44dd-8801-0ee8be80ff4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:16.204571 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afd7e8-d261-44dd-8801-0ee8be80ff4c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:16.204946 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afd7e8-d261-44dd-8801-0ee8be80ff4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:16.205385 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1afd7e8-d261-44dd-8801-0ee8be80ff4c admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:16.206290 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afd7e8-d261-44dd-8801-0ee8be80ff4c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:16.206705 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afd7e8-d261-44dd-8801-0ee8be80ff4c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:16.208796 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1afd7e8-d261-44dd-8801-0ee8be80ff4c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:16.223244 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 432/868] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:21:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:16.229226 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb7143-7234-4073-8ca9-95c3d835f741 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:16.240480 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb7143-7234-4073-8ca9-95c3d835f741 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:16.245590 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cc3db-8547-4bd6-b382-0d210b009959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:16.246563 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cc3db-8547-4bd6-b382-0d210b009959 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:16.246997 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cc3db-8547-4bd6-b382-0d210b009959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:16.247440 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cc3db-8547-4bd6-b382-0d210b009959 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:16.248424 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6cc3db-8547-4bd6-b382-0d210b009959 admin admin] RBAC: Adding query filter params (role.id=9ba4a5967ed243178927661616f08901, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=92eb49cac0c94e73a70361831dd789b2) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:16.248916 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6cc3db-8547-4bd6-b382-0d210b009959 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:16.251035 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6cc3db-8547-4bd6-b382-0d210b009959 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:16.258397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 437/869] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:21:16 2022] GET /identity/v3/role_assignments?user.id=92eb49cac0c94e73a70361831dd789b2&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=9ba4a5967ed243178927661616f08901 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:17.243739 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34efcc-ba08-4d18-ac03-f802c440dd2c None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:17.244261 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34efcc-ba08-4d18-ac03-f802c440dd2c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:17.244569 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34efcc-ba08-4d18-ac03-f802c440dd2c None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:17.247275 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 433/870] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:17.252549 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c4916-0e8f-41e8-b041-7096e52ed0fe None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:17.252954 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c4916-0e8f-41e8-b041-7096e52ed0fe None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:17.253129 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c4916-0e8f-41e8-b041-7096e52ed0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:17.271743 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-232c4916-0e8f-41e8-b041-7096e52ed0fe None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:17.272919 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-232c4916-0e8f-41e8-b041-7096e52ed0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:17.281515 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 438/871] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:17 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:21:17.305648 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34efcc-ba08-4d18-ac03-f802c440dd2c None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:17.319099 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34efcc-ba08-4d18-ac03-f802c440dd2c None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:17.324383 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad1720-829e-49b7-925c-41f3a1b1631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:17.325321 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad1720-829e-49b7-925c-41f3a1b1631e admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:17.325809 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad1720-829e-49b7-925c-41f3a1b1631e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:17.326282 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad1720-829e-49b7-925c-41f3a1b1631e admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:17.327199 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad1720-829e-49b7-925c-41f3a1b1631e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:17.329002 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad1720-829e-49b7-925c-41f3a1b1631e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:17.344405 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 434/872] 10.222.0.75 () {60 vars in 1162 bytes} [Wed Feb 16 05:21:17 2022] POST /identity/v3/services => generated 269 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:21:18.061244 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69f970-fe85-4d82-84aa-b295b6062c14 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:18.061633 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69f970-fe85-4d82-84aa-b295b6062c14 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:18.061831 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69f970-fe85-4d82-84aa-b295b6062c14 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:18.063882 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 439/873] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:18.069143 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8ad70-2d43-45ec-ab99-3278bbb7c4cf None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:18.069461 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8ad70-2d43-45ec-ab99-3278bbb7c4cf None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:18.069738 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8ad70-2d43-45ec-ab99-3278bbb7c4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:18.088312 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-89b8ad70-2d43-45ec-ab99-3278bbb7c4cf None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:18.090094 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-89b8ad70-2d43-45ec-ab99-3278bbb7c4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:18.106426 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 435/874] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:18 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:18.129743 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69f970-fe85-4d82-84aa-b295b6062c14 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:18.142852 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69f970-fe85-4d82-84aa-b295b6062c14 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:18.147341 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7b616-4c59-437f-9e8f-2ea53d986bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:18.148135 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7b616-4c59-437f-9e8f-2ea53d986bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:18.148411 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7b616-4c59-437f-9e8f-2ea53d986bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:18.148678 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7b616-4c59-437f-9e8f-2ea53d986bf8 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:18.160017 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7b616-4c59-437f-9e8f-2ea53d986bf8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:21:18.167324 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-f9d7b616-4c59-437f-9e8f-2ea53d986bf8 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 05:21:18.168831 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 440/875] 10.222.0.75 () {56 vars in 1141 bytes} [Wed Feb 16 05:21:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:18.174617 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8ad70-2d43-45ec-ab99-3278bbb7c4cf None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:18.183932 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8ad70-2d43-45ec-ab99-3278bbb7c4cf None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:18.188526 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817b058-244e-4fd5-b5ad-a39f18bba819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:18.189178 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817b058-244e-4fd5-b5ad-a39f18bba819 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:18.189493 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817b058-244e-4fd5-b5ad-a39f18bba819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:18.189764 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b817b058-244e-4fd5-b5ad-a39f18bba819 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:18.190511 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817b058-244e-4fd5-b5ad-a39f18bba819 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:18.190815 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817b058-244e-4fd5-b5ad-a39f18bba819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:18.192438 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b817b058-244e-4fd5-b5ad-a39f18bba819 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:18.201794 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 436/876] 10.222.0.75 () {56 vars in 1136 bytes} [Wed Feb 16 05:21:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:18.207247 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7b616-4c59-437f-9e8f-2ea53d986bf8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:18.218217 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7b616-4c59-437f-9e8f-2ea53d986bf8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:18.223127 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01d41d-9549-4a4f-9217-2124f23836c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:18.223946 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01d41d-9549-4a4f-9217-2124f23836c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:18.224221 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01d41d-9549-4a4f-9217-2124f23836c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:18.224491 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01d41d-9549-4a4f-9217-2124f23836c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:18.237530 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01d41d-9549-4a4f-9217-2124f23836c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:18.239426 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01d41d-9549-4a4f-9217-2124f23836c7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:18.257743 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-ed01d41d-9549-4a4f-9217-2124f23836c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:18.259264 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 441/877] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:18.265301 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817b058-244e-4fd5-b5ad-a39f18bba819 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:18.275238 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b817b058-244e-4fd5-b5ad-a39f18bba819 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:18.280489 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbb510-7bd2-4786-b1d6-2d0dcaebafeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:18.281160 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbb510-7bd2-4786-b1d6-2d0dcaebafeb admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:18.281480 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbb510-7bd2-4786-b1d6-2d0dcaebafeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:18.281749 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbb510-7bd2-4786-b1d6-2d0dcaebafeb admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:18.282491 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbb510-7bd2-4786-b1d6-2d0dcaebafeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:18.282793 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbb510-7bd2-4786-b1d6-2d0dcaebafeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:18.284456 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbb510-7bd2-4786-b1d6-2d0dcaebafeb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:18.298354 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 437/878] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:18.304106 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01d41d-9549-4a4f-9217-2124f23836c7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:18.314706 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01d41d-9549-4a4f-9217-2124f23836c7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:18.319213 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898e364-44f1-4308-a483-35bb505f3b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:18.320007 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898e364-44f1-4308-a483-35bb505f3b96 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:18.320283 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898e364-44f1-4308-a483-35bb505f3b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:18.320549 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898e364-44f1-4308-a483-35bb505f3b96 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:18.329513 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898e364-44f1-4308-a483-35bb505f3b96 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:18.331548 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898e364-44f1-4308-a483-35bb505f3b96 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:18.346481 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-b898e364-44f1-4308-a483-35bb505f3b96 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 05:21:18.348035 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 442/879] 10.222.0.75 () {56 vars in 1138 bytes} [Wed Feb 16 05:21:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:18.353596 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbb510-7bd2-4786-b1d6-2d0dcaebafeb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:18.364030 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbb510-7bd2-4786-b1d6-2d0dcaebafeb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:18.368522 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a7de4-6406-4086-81b2-eb6df018d870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:18.369166 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a7de4-6406-4086-81b2-eb6df018d870 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:18.369476 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a7de4-6406-4086-81b2-eb6df018d870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:18.369751 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a7de4-6406-4086-81b2-eb6df018d870 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:18.371134 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a7de4-6406-4086-81b2-eb6df018d870 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:18.371438 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a7de4-6406-4086-81b2-eb6df018d870 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:18.373288 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a7de4-6406-4086-81b2-eb6df018d870 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:18.390422 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 438/880] 10.222.0.75 () {56 vars in 1170 bytes} [Wed Feb 16 05:21:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:18.395795 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898e364-44f1-4308-a483-35bb505f3b96 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:18.405978 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898e364-44f1-4308-a483-35bb505f3b96 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:18.410610 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743600f6-28c8-4dfd-b570-113224c790eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:18.411242 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743600f6-28c8-4dfd-b570-113224c790eb admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:18.411580 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743600f6-28c8-4dfd-b570-113224c790eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:18.411858 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743600f6-28c8-4dfd-b570-113224c790eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:18.420904 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743600f6-28c8-4dfd-b570-113224c790eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:18.422700 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743600f6-28c8-4dfd-b570-113224c790eb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:18.432771 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 443/881] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:21:18 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:21:18.442669 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a7de4-6406-4086-81b2-eb6df018d870 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:18.453238 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a7de4-6406-4086-81b2-eb6df018d870 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:18.457949 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc13cb-17b2-4be2-b610-f88d4ea331ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:18.458784 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc13cb-17b2-4be2-b610-f88d4ea331ec admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:18.459063 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc13cb-17b2-4be2-b610-f88d4ea331ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:18.459388 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc13cb-17b2-4be2-b610-f88d4ea331ec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:18.470528 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc13cb-17b2-4be2-b610-f88d4ea331ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:18.472436 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc13cb-17b2-4be2-b610-f88d4ea331ec admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:18.489248 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-71dc13cb-17b2-4be2-b610-f88d4ea331ec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:18.490750 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 439/882] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:18.496843 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743600f6-28c8-4dfd-b570-113224c790eb admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:18.506082 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743600f6-28c8-4dfd-b570-113224c790eb admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:18.510791 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d17637-f57e-4a93-b558-4012bea7ce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:18.511995 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d17637-f57e-4a93-b558-4012bea7ce1a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:18.512269 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d17637-f57e-4a93-b558-4012bea7ce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:18.512536 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d17637-f57e-4a93-b558-4012bea7ce1a admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:18.513407 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d17637-f57e-4a93-b558-4012bea7ce1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:18.513710 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d17637-f57e-4a93-b558-4012bea7ce1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:18.515316 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d17637-f57e-4a93-b558-4012bea7ce1a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:18.528079 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 444/883] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:18.533513 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc13cb-17b2-4be2-b610-f88d4ea331ec admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:18.543600 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc13cb-17b2-4be2-b610-f88d4ea331ec admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:18.548381 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e91c2-8885-4991-867b-3e6dd8d2a135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:18.549162 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e91c2-8885-4991-867b-3e6dd8d2a135 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:18.549516 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e91c2-8885-4991-867b-3e6dd8d2a135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:18.549790 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e91c2-8885-4991-867b-3e6dd8d2a135 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:18.557511 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e91c2-8885-4991-867b-3e6dd8d2a135 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:18.560084 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e91c2-8885-4991-867b-3e6dd8d2a135 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:18.573311 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-b01e91c2-8885-4991-867b-3e6dd8d2a135 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:21:18.575389 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 440/884] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:18.581043 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d17637-f57e-4a93-b558-4012bea7ce1a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:18.586978 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773ad5e-68d7-4475-a569-036d93f8e467 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:18.587306 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773ad5e-68d7-4475-a569-036d93f8e467 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:18.587583 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773ad5e-68d7-4475-a569-036d93f8e467 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:18.590240 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 441/885] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:18.591727 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d17637-f57e-4a93-b558-4012bea7ce1a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:18.595950 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4b17f-a5c4-4a64-945b-8525ca59a470 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:18.596227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4b17f-a5c4-4a64-945b-8525ca59a470 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:18.596489 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58a4c9-71e0-4253-8bd1-44c99f56c817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:18.596700 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4b17f-a5c4-4a64-945b-8525ca59a470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:18.597149 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58a4c9-71e0-4253-8bd1-44c99f56c817 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:18.597478 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58a4c9-71e0-4253-8bd1-44c99f56c817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:18.597751 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58a4c9-71e0-4253-8bd1-44c99f56c817 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:18.598549 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58a4c9-71e0-4253-8bd1-44c99f56c817 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:18.598856 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58a4c9-71e0-4253-8bd1-44c99f56c817 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:18.600748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58a4c9-71e0-4253-8bd1-44c99f56c817 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:18.614806 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 445/886] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:21:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:18.616973 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c7d4b17f-a5c4-4a64-945b-8525ca59a470 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:18.618252 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c7d4b17f-a5c4-4a64-945b-8525ca59a470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:18.621078 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58a4c9-71e0-4253-8bd1-44c99f56c817 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:18.627719 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 442/887] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:18 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:21:18.630889 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58a4c9-71e0-4253-8bd1-44c99f56c817 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:18.635482 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2e45c-9d9c-4851-b49d-94ca92c70668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:18.636663 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2e45c-9d9c-4851-b49d-94ca92c70668 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:18.636940 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2e45c-9d9c-4851-b49d-94ca92c70668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:18.637210 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2e45c-9d9c-4851-b49d-94ca92c70668 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:18.638084 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2e45c-9d9c-4851-b49d-94ca92c70668 admin admin] RBAC: Adding query filter params (role.id=b8f12ed3613649e2bd643eca3c00d034, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=4d22345d2e2646cc99c74a2f9692b648) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:18.638391 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2e45c-9d9c-4851-b49d-94ca92c70668 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:18.640235 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2e45c-9d9c-4851-b49d-94ca92c70668 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:18.646246 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 446/888] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:21:18 2022] GET /identity/v3/role_assignments?user.id=4d22345d2e2646cc99c74a2f9692b648&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=b8f12ed3613649e2bd643eca3c00d034 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:18.652596 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4b17f-a5c4-4a64-945b-8525ca59a470 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:18.660666 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2db8-bbb2-4c89-aaf2-a6dbcc99ba90 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:18.660971 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2db8-bbb2-4c89-aaf2-a6dbcc99ba90 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:18.661239 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd2db8-bbb2-4c89-aaf2-a6dbcc99ba90 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:18.662440 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4b17f-a5c4-4a64-945b-8525ca59a470 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:18.663288 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 447/889] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:18.667168 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248af85-2c12-4648-8b9c-28a116ce9886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:18.667898 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248af85-2c12-4648-8b9c-28a116ce9886 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:18.668173 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248af85-2c12-4648-8b9c-28a116ce9886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:18.668438 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248af85-2c12-4648-8b9c-28a116ce9886 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:18.669171 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248af85-2c12-4648-8b9c-28a116ce9886 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:18.671252 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248af85-2c12-4648-8b9c-28a116ce9886 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:18.673019 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182abaf9-f47e-4a9a-a1c4-db9033b58972 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:18.673556 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182abaf9-f47e-4a9a-a1c4-db9033b58972 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:18.674031 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182abaf9-f47e-4a9a-a1c4-db9033b58972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:18.689516 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 443/890] 10.222.0.75 () {60 vars in 1162 bytes} [Wed Feb 16 05:21:18 2022] POST /identity/v3/services => generated 251 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:21:18.696301 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-182abaf9-f47e-4a9a-a1c4-db9033b58972 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:18.697871 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-182abaf9-f47e-4a9a-a1c4-db9033b58972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:18.718585 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 448/891] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:18 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:18.741566 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248af85-2c12-4648-8b9c-28a116ce9886 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:18.753522 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248af85-2c12-4648-8b9c-28a116ce9886 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:18.758418 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df9c5a-96e6-4365-b2bf-fad4c11541f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:18.759411 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df9c5a-96e6-4365-b2bf-fad4c11541f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:18.759821 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df9c5a-96e6-4365-b2bf-fad4c11541f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:18.760197 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df9c5a-96e6-4365-b2bf-fad4c11541f8 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:18.761098 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df9c5a-96e6-4365-b2bf-fad4c11541f8 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:18.763780 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df9c5a-96e6-4365-b2bf-fad4c11541f8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:18.777655 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-c9df9c5a-96e6-4365-b2bf-fad4c11541f8 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 16 05:21:18.779510 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 444/892] 10.222.0.75 () {56 vars in 1147 bytes} [Wed Feb 16 05:21:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:18.785669 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182abaf9-f47e-4a9a-a1c4-db9033b58972 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:18.796386 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182abaf9-f47e-4a9a-a1c4-db9033b58972 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:18.801664 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e1346-ede5-4652-9fcb-ab30cd969fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:18.802762 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e1346-ede5-4652-9fcb-ab30cd969fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:18.803249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e1346-ede5-4652-9fcb-ab30cd969fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:18.803743 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e1346-ede5-4652-9fcb-ab30cd969fe5 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:18.804762 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e1346-ede5-4652-9fcb-ab30cd969fe5 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:18.805318 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e1346-ede5-4652-9fcb-ab30cd969fe5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:18.807502 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e1346-ede5-4652-9fcb-ab30cd969fe5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:18.813820 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 449/893] 10.222.0.75 () {56 vars in 1143 bytes} [Wed Feb 16 05:21:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:18.825452 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df9c5a-96e6-4365-b2bf-fad4c11541f8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:18.831224 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df9c5a-96e6-4365-b2bf-fad4c11541f8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:18.836088 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af873a3f-a616-4cd6-86d3-2f0ede63f96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:18.836843 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af873a3f-a616-4cd6-86d3-2f0ede63f96c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:18.837122 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af873a3f-a616-4cd6-86d3-2f0ede63f96c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:18.837427 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af873a3f-a616-4cd6-86d3-2f0ede63f96c admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:18.838198 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af873a3f-a616-4cd6-86d3-2f0ede63f96c admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:18.838511 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af873a3f-a616-4cd6-86d3-2f0ede63f96c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:18.840786 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af873a3f-a616-4cd6-86d3-2f0ede63f96c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:18.852209 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 445/894] 10.222.0.75 () {56 vars in 1143 bytes} [Wed Feb 16 05:21:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:19.857639 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d91227-1201-45ff-9351-a15ae03cda22 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:19.858650 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d91227-1201-45ff-9351-a15ae03cda22 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:19.859134 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d91227-1201-45ff-9351-a15ae03cda22 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:19.861408 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 450/895] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:19.866715 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6b1d9-3139-4074-85fc-f78baede9d3f None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:19.867530 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6b1d9-3139-4074-85fc-f78baede9d3f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:19.868009 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6b1d9-3139-4074-85fc-f78baede9d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:19.887201 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-82e6b1d9-3139-4074-85fc-f78baede9d3f None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:19.888799 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-82e6b1d9-3139-4074-85fc-f78baede9d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:19.901389 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 446/896] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:19 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:19.922633 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d91227-1201-45ff-9351-a15ae03cda22 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:19.936858 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d91227-1201-45ff-9351-a15ae03cda22 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:19.941503 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8cf7f-1adc-45f5-9392-2ba6513991e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:19.942518 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8cf7f-1adc-45f5-9392-2ba6513991e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:19.943034 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8cf7f-1adc-45f5-9392-2ba6513991e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:19.943504 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8cf7f-1adc-45f5-9392-2ba6513991e4 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:19.944357 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8cf7f-1adc-45f5-9392-2ba6513991e4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:19.946165 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8cf7f-1adc-45f5-9392-2ba6513991e4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:19.958410 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-34a8cf7f-1adc-45f5-9392-2ba6513991e4 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 16 05:21:19.960211 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 451/897] 10.222.0.75 () {56 vars in 1153 bytes} [Wed Feb 16 05:21:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:19.966787 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6b1d9-3139-4074-85fc-f78baede9d3f None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:19.975976 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6b1d9-3139-4074-85fc-f78baede9d3f None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:19.980782 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3875dc-978e-4929-906c-c9c29fadd32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:19.981689 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3875dc-978e-4929-906c-c9c29fadd32d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:19.982191 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3875dc-978e-4929-906c-c9c29fadd32d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:19.982700 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3875dc-978e-4929-906c-c9c29fadd32d admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:19.983610 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3875dc-978e-4929-906c-c9c29fadd32d admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:19.984130 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3875dc-978e-4929-906c-c9c29fadd32d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:19.986013 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3875dc-978e-4929-906c-c9c29fadd32d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:19.991342 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 447/898] 10.222.0.75 () {56 vars in 1147 bytes} [Wed Feb 16 05:21:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:19.997474 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8cf7f-1adc-45f5-9392-2ba6513991e4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:20.007361 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8cf7f-1adc-45f5-9392-2ba6513991e4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:20.012685 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797d641-b11b-41d6-811b-0a39940615ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:20.013582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797d641-b11b-41d6-811b-0a39940615ed admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:20.014085 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797d641-b11b-41d6-811b-0a39940615ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:20.014558 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797d641-b11b-41d6-811b-0a39940615ed admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:20.015470 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797d641-b11b-41d6-811b-0a39940615ed admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:20.015968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797d641-b11b-41d6-811b-0a39940615ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:20.017794 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797d641-b11b-41d6-811b-0a39940615ed admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:20.023412 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 452/899] 10.222.0.75 () {56 vars in 1147 bytes} [Wed Feb 16 05:21:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:20.030258 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3875dc-978e-4929-906c-c9c29fadd32d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:20.040746 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3875dc-978e-4929-906c-c9c29fadd32d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:20.046570 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1daf6-e38f-415e-a22d-7d9f16d3f333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:20.047444 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1daf6-e38f-415e-a22d-7d9f16d3f333 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:20.048039 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1daf6-e38f-415e-a22d-7d9f16d3f333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:20.048509 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1daf6-e38f-415e-a22d-7d9f16d3f333 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:20.049535 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1daf6-e38f-415e-a22d-7d9f16d3f333 admin admin] RBAC: Adding query filter params (interface=public, service_id=9da91a92e79b41b08307ad738820b6c8, region_id=RegionOne) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:20.050044 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1daf6-e38f-415e-a22d-7d9f16d3f333 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:20.051906 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1daf6-e38f-415e-a22d-7d9f16d3f333 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:20.058211 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 448/900] 10.222.0.75 () {56 vars in 1272 bytes} [Wed Feb 16 05:21:20 2022] GET /identity/v3/endpoints?service_id=9da91a92e79b41b08307ad738820b6c8&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:20.063760 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797d641-b11b-41d6-811b-0a39940615ed admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:20.073862 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797d641-b11b-41d6-811b-0a39940615ed admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:20.078615 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1f73d-6202-41bd-9277-bb4386496690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:20.079492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1f73d-6202-41bd-9277-bb4386496690 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:20.079989 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1f73d-6202-41bd-9277-bb4386496690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:20.080457 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1f73d-6202-41bd-9277-bb4386496690 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:20.081358 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1f73d-6202-41bd-9277-bb4386496690 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:20.083204 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1f73d-6202-41bd-9277-bb4386496690 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:20.089773 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 453/901] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Feb 16 05:21:20 2022] GET /identity/v3/services => generated 1268 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:21:21.028549 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbb6cf-c596-48d4-9920-5e32f3ea9f57 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.029034 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbb6cf-c596-48d4-9920-5e32f3ea9f57 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.029034 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbb6cf-c596-48d4-9920-5e32f3ea9f57 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.031024 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 449/902] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:21.036166 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305f0b7-2077-427f-973d-6e0d0fe4af5b None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.036551 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305f0b7-2077-427f-973d-6e0d0fe4af5b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.036714 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305f0b7-2077-427f-973d-6e0d0fe4af5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.055177 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2305f0b7-2077-427f-973d-6e0d0fe4af5b None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:21.056623 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2305f0b7-2077-427f-973d-6e0d0fe4af5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:21.064674 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 454/903] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:21 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:21.085860 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f6e96-f73a-48f6-8f03-cbdb096b270e None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.086149 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f6e96-f73a-48f6-8f03-cbdb096b270e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.086415 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f6e96-f73a-48f6-8f03-cbdb096b270e None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.087937 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305f0b7-2077-427f-973d-6e0d0fe4af5b None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:21.088688 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 450/904] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:21.094299 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e7f10-a45b-4590-a6bc-22a94ae0da9f None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.094581 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e7f10-a45b-4590-a6bc-22a94ae0da9f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.094861 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e7f10-a45b-4590-a6bc-22a94ae0da9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.098463 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305f0b7-2077-427f-973d-6e0d0fe4af5b None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:21.103973 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2756ea-130e-4a9b-ab1e-6c13780f0332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:21.104820 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2756ea-130e-4a9b-ab1e-6c13780f0332 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.105096 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2756ea-130e-4a9b-ab1e-6c13780f0332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.105409 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2756ea-130e-4a9b-ab1e-6c13780f0332 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.112391 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-199e7f10-a45b-4590-a6bc-22a94ae0da9f None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:21.113716 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-199e7f10-a45b-4590-a6bc-22a94ae0da9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:21.117093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2756ea-130e-4a9b-ab1e-6c13780f0332 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:21:21.121902 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 451/905] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:21 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:21:21.124813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-fa2756ea-130e-4a9b-ab1e-6c13780f0332 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 05:21:21.126244 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 455/906] 10.222.0.75 () {56 vars in 1141 bytes} [Wed Feb 16 05:21:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:21.131806 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e7f10-a45b-4590-a6bc-22a94ae0da9f None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:21.142037 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e7f10-a45b-4590-a6bc-22a94ae0da9f None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:21.146246 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2756ea-130e-4a9b-ab1e-6c13780f0332 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:21.146552 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba3c08-fc7c-428b-9706-90e59bfdc53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:21.147346 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba3c08-fc7c-428b-9706-90e59bfdc53e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.147621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba3c08-fc7c-428b-9706-90e59bfdc53e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.147888 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba3c08-fc7c-428b-9706-90e59bfdc53e admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.148636 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba3c08-fc7c-428b-9706-90e59bfdc53e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:21.148935 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba3c08-fc7c-428b-9706-90e59bfdc53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:21.150622 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba3c08-fc7c-428b-9706-90e59bfdc53e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:21.157625 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2756ea-130e-4a9b-ab1e-6c13780f0332 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:21.160800 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 452/907] 10.222.0.75 () {56 vars in 1136 bytes} [Wed Feb 16 05:21:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:21.163242 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a35291-d73b-4dff-b49a-a9b7d1f89b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:21.164021 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a35291-d73b-4dff-b49a-a9b7d1f89b0a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.164293 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a35291-d73b-4dff-b49a-a9b7d1f89b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.164560 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a35291-d73b-4dff-b49a-a9b7d1f89b0a admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.169279 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a35291-d73b-4dff-b49a-a9b7d1f89b0a admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:21.169474 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba3c08-fc7c-428b-9706-90e59bfdc53e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:21.169633 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a35291-d73b-4dff-b49a-a9b7d1f89b0a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:21.175388 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba3c08-fc7c-428b-9706-90e59bfdc53e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:21.179946 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ca31a-1d00-4a8b-9385-34335c94c585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:21.180377 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-b7a35291-d73b-4dff-b49a-a9b7d1f89b0a admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 16 05:21:21.180705 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ca31a-1d00-4a8b-9385-34335c94c585 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.181252 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ca31a-1d00-4a8b-9385-34335c94c585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.181558 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ca31a-1d00-4a8b-9385-34335c94c585 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.182140 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 456/908] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Feb 16 05:21:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:21.188259 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a35291-d73b-4dff-b49a-a9b7d1f89b0a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:21.197201 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ca31a-1d00-4a8b-9385-34335c94c585 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:21.199746 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ca31a-1d00-4a8b-9385-34335c94c585 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:21.201108 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a35291-d73b-4dff-b49a-a9b7d1f89b0a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:21.206513 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e13311-7d22-46da-9ba9-e5d1db4c93b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:21.207804 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e13311-7d22-46da-9ba9-e5d1db4c93b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.208657 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e13311-7d22-46da-9ba9-e5d1db4c93b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.209148 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e13311-7d22-46da-9ba9-e5d1db4c93b9 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.210370 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e13311-7d22-46da-9ba9-e5d1db4c93b9 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:21.210899 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e13311-7d22-46da-9ba9-e5d1db4c93b9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:21.212685 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e13311-7d22-46da-9ba9-e5d1db4c93b9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:21.217361 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-745ca31a-1d00-4a8b-9385-34335c94c585 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:21.223249 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 453/909] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:21.223368 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 457/910] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Feb 16 05:21:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:21.227720 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ca31a-1d00-4a8b-9385-34335c94c585 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:21.229127 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e13311-7d22-46da-9ba9-e5d1db4c93b9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:21.235044 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ca31a-1d00-4a8b-9385-34335c94c585 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:21.240171 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f342f-b640-4910-b635-573fd4c166db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:21.240976 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f342f-b640-4910-b635-573fd4c166db admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.241271 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f342f-b640-4910-b635-573fd4c166db admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.241569 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f342f-b640-4910-b635-573fd4c166db admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.242304 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f342f-b640-4910-b635-573fd4c166db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:21.242598 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f342f-b640-4910-b635-573fd4c166db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:21.243475 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e13311-7d22-46da-9ba9-e5d1db4c93b9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:21.244250 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f342f-b640-4910-b635-573fd4c166db admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:21.249093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bb783-1411-4b9c-a260-9bcf335a6186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:21.249790 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bb783-1411-4b9c-a260-9bcf335a6186 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.250070 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bb783-1411-4b9c-a260-9bcf335a6186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.250344 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bb783-1411-4b9c-a260-9bcf335a6186 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.251054 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bb783-1411-4b9c-a260-9bcf335a6186 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:21.251359 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bb783-1411-4b9c-a260-9bcf335a6186 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:21.252974 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bb783-1411-4b9c-a260-9bcf335a6186 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:21.258230 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 454/911] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:21.258352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 458/912] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Feb 16 05:21:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:21.262387 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfed2e-c2d8-4375-854b-802ae66ee3fd None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.262387 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfed2e-c2d8-4375-854b-802ae66ee3fd None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.262387 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcfed2e-c2d8-4375-854b-802ae66ee3fd None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.262639 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 455/913] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:21.264420 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bb783-1411-4b9c-a260-9bcf335a6186 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:21.266914 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfed2e-c2d8-4375-854b-802ae66ee3fd None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:21.274301 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bb783-1411-4b9c-a260-9bcf335a6186 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:21.279510 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf04506-f48b-40fb-9695-9888d7e7d38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:21.279889 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcfed2e-c2d8-4375-854b-802ae66ee3fd None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:21.280078 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf04506-f48b-40fb-9695-9888d7e7d38c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.280366 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf04506-f48b-40fb-9695-9888d7e7d38c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.280657 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf04506-f48b-40fb-9695-9888d7e7d38c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.281449 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf04506-f48b-40fb-9695-9888d7e7d38c admin admin] RBAC: Adding query filter params (interface=public, service_id=dd5c2a3b54354a34aedbab8673fe5aba, region_id=RegionOne) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:21.281771 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf04506-f48b-40fb-9695-9888d7e7d38c admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:21.283335 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf04506-f48b-40fb-9695-9888d7e7d38c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:21.284737 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50651a-f2a8-4d72-b190-e6e45d4f8382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:21.285396 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50651a-f2a8-4d72-b190-e6e45d4f8382 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.285672 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50651a-f2a8-4d72-b190-e6e45d4f8382 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.285937 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50651a-f2a8-4d72-b190-e6e45d4f8382 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.293915 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 459/914] 10.222.0.75 () {56 vars in 1272 bytes} [Wed Feb 16 05:21:21 2022] GET /identity/v3/endpoints?service_id=dd5c2a3b54354a34aedbab8673fe5aba&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:21.293915 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61b87d-be67-4688-a725-5960b1396983 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.293915 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61b87d-be67-4688-a725-5960b1396983 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.293915 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61b87d-be67-4688-a725-5960b1396983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.298395 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50651a-f2a8-4d72-b190-e6e45d4f8382 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:21.300433 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50651a-f2a8-4d72-b190-e6e45d4f8382 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:21.310107 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-8a61b87d-be67-4688-a725-5960b1396983 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:21.311294 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8a61b87d-be67-4688-a725-5960b1396983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:21.316049 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-ba50651a-f2a8-4d72-b190-e6e45d4f8382 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 05:21:21.322022 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 456/915] 10.222.0.75 () {56 vars in 1138 bytes} [Wed Feb 16 05:21:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:21.322022 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50651a-f2a8-4d72-b190-e6e45d4f8382 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:21.323221 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 460/916] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:21 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:21.326077 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61b87d-be67-4688-a725-5960b1396983 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:21.331110 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50651a-f2a8-4d72-b190-e6e45d4f8382 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:21.336053 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aada258-0b48-4717-a3ae-86b2d341ed4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:21.336781 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aada258-0b48-4717-a3ae-86b2d341ed4c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.337153 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aada258-0b48-4717-a3ae-86b2d341ed4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.337515 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61b87d-be67-4688-a725-5960b1396983 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:21.337647 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aada258-0b48-4717-a3ae-86b2d341ed4c admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.338403 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aada258-0b48-4717-a3ae-86b2d341ed4c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:21.340070 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aada258-0b48-4717-a3ae-86b2d341ed4c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:21.342830 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8fb1c-ea23-42ac-8099-d10226bc1e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:21.343706 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8fb1c-ea23-42ac-8099-d10226bc1e87 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.344142 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8fb1c-ea23-42ac-8099-d10226bc1e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.344607 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8fb1c-ea23-42ac-8099-d10226bc1e87 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.345691 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8fb1c-ea23-42ac-8099-d10226bc1e87 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:21.346057 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8fb1c-ea23-42ac-8099-d10226bc1e87 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:21.346573 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 457/917] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Feb 16 05:21:21 2022] GET /identity/v3/services => generated 1268 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:21:21.347323 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aada258-0b48-4717-a3ae-86b2d341ed4c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:21.348152 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8fb1c-ea23-42ac-8099-d10226bc1e87 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:21.357451 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aada258-0b48-4717-a3ae-86b2d341ed4c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:21.363569 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ab83a-3693-4dc7-983c-e5a5dc4f9fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:21.364301 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ab83a-3693-4dc7-983c-e5a5dc4f9fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.364575 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ab83a-3693-4dc7-983c-e5a5dc4f9fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.364841 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ab83a-3693-4dc7-983c-e5a5dc4f9fd1 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.365660 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ab83a-3693-4dc7-983c-e5a5dc4f9fd1 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:21.367364 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ab83a-3693-4dc7-983c-e5a5dc4f9fd1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:21.373496 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 461/918] 10.222.0.75 () {56 vars in 1170 bytes} [Wed Feb 16 05:21:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:21.378887 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8fb1c-ea23-42ac-8099-d10226bc1e87 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:21.385586 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 458/919] 10.222.0.75 () {60 vars in 1162 bytes} [Wed Feb 16 05:21:21 2022] POST /identity/v3/services => generated 241 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:21:21.389914 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8fb1c-ea23-42ac-8099-d10226bc1e87 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:21.412798 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ade9dc-cef5-46f6-b1c8-c576d602e76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:21.413894 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ade9dc-cef5-46f6-b1c8-c576d602e76c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.414351 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ade9dc-cef5-46f6-b1c8-c576d602e76c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.414768 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ade9dc-cef5-46f6-b1c8-c576d602e76c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.428141 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ade9dc-cef5-46f6-b1c8-c576d602e76c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:21.430583 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ade9dc-cef5-46f6-b1c8-c576d602e76c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:21.450555 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-d5ade9dc-cef5-46f6-b1c8-c576d602e76c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:21.452412 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 462/920] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:21.458202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ab83a-3693-4dc7-983c-e5a5dc4f9fd1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:21.470310 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ab83a-3693-4dc7-983c-e5a5dc4f9fd1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:21.475333 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46ca4f-1584-4ee4-858f-89490ba05c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:21.476017 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46ca4f-1584-4ee4-858f-89490ba05c63 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.476296 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46ca4f-1584-4ee4-858f-89490ba05c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.476621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46ca4f-1584-4ee4-858f-89490ba05c63 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.477406 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46ca4f-1584-4ee4-858f-89490ba05c63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:21.477715 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46ca4f-1584-4ee4-858f-89490ba05c63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:21.479460 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46ca4f-1584-4ee4-858f-89490ba05c63 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:21.493838 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 459/921] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:21.499802 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ade9dc-cef5-46f6-b1c8-c576d602e76c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:21.510692 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ade9dc-cef5-46f6-b1c8-c576d602e76c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:21.515645 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2b4d4-fb34-43d1-bc3b-3503cc8fe82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:21.516463 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2b4d4-fb34-43d1-bc3b-3503cc8fe82e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.516746 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2b4d4-fb34-43d1-bc3b-3503cc8fe82e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.517074 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2b4d4-fb34-43d1-bc3b-3503cc8fe82e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.525512 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2b4d4-fb34-43d1-bc3b-3503cc8fe82e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:21.528161 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2b4d4-fb34-43d1-bc3b-3503cc8fe82e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:21.543818 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-e2b2b4d4-fb34-43d1-bc3b-3503cc8fe82e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:21:21.549545 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 463/922] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:21.551405 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46ca4f-1584-4ee4-858f-89490ba05c63 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:21.562261 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46ca4f-1584-4ee4-858f-89490ba05c63 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:21.570033 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98653e21-78d0-4ced-99ff-b414b8670d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:21.570910 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98653e21-78d0-4ced-99ff-b414b8670d12 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.571310 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98653e21-78d0-4ced-99ff-b414b8670d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.571674 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98653e21-78d0-4ced-99ff-b414b8670d12 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.572584 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98653e21-78d0-4ced-99ff-b414b8670d12 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:21.572985 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98653e21-78d0-4ced-99ff-b414b8670d12 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:21.575383 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98653e21-78d0-4ced-99ff-b414b8670d12 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:21.589624 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 460/923] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:21:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:21.595465 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2b4d4-fb34-43d1-bc3b-3503cc8fe82e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:21.607235 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2b4d4-fb34-43d1-bc3b-3503cc8fe82e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:21.612436 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496c00b-56f9-4bb6-b0c5-8fc8bee67693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:21.613491 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496c00b-56f9-4bb6-b0c5-8fc8bee67693 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:21.613837 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496c00b-56f9-4bb6-b0c5-8fc8bee67693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:21.614199 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496c00b-56f9-4bb6-b0c5-8fc8bee67693 admin admin] PATH_INFO: `/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/4d22345d2e2646cc99c74a2f9692b648/roles/b8f12ed3613649e2bd643eca3c00d034` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:21.616506 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6496c00b-56f9-4bb6-b0c5-8fc8bee67693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4d0b5a3f7d4542a47a26e623500b4f, user_id=4d22345d2e2646cc99c74a2f9692b648, role_id=b8f12ed3613649e2bd643eca3c00d034)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:21.619258 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6496c00b-56f9-4bb6-b0c5-8fc8bee67693 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:21.634392 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 464/924] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:21:21 2022] PUT /identity/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/4d22345d2e2646cc99c74a2f9692b648/roles/b8f12ed3613649e2bd643eca3c00d034 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:21:22.444644 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c4580-09d7-4d93-ac97-ccf573599e1e None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:22.445187 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c4580-09d7-4d93-ac97-ccf573599e1e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:22.445516 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c4580-09d7-4d93-ac97-ccf573599e1e None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:22.447651 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 461/925] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:22.453054 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32277b5-028e-4513-bf72-e8c14ff632b8 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:22.453606 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32277b5-028e-4513-bf72-e8c14ff632b8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:22.453606 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32277b5-028e-4513-bf72-e8c14ff632b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:22.473134 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d32277b5-028e-4513-bf72-e8c14ff632b8 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:22.474373 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d32277b5-028e-4513-bf72-e8c14ff632b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:22.536424 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 465/926] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:22 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:21:22.559923 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c4580-09d7-4d93-ac97-ccf573599e1e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:22.572778 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c4580-09d7-4d93-ac97-ccf573599e1e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:22.578041 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3fe29-4045-4b03-b3cc-f3135c367ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:22.578860 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3fe29-4045-4b03-b3cc-f3135c367ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:22.579135 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3fe29-4045-4b03-b3cc-f3135c367ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:22.579402 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3fe29-4045-4b03-b3cc-f3135c367ab7 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:22.580067 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3fe29-4045-4b03-b3cc-f3135c367ab7 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:22.581773 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3fe29-4045-4b03-b3cc-f3135c367ab7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:22.593806 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-c5f3fe29-4045-4b03-b3cc-f3135c367ab7 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 16 05:21:22.595451 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 462/927] 10.222.0.75 () {56 vars in 1153 bytes} [Wed Feb 16 05:21:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:22.601243 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32277b5-028e-4513-bf72-e8c14ff632b8 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:22.611086 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32277b5-028e-4513-bf72-e8c14ff632b8 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:22.616318 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720844a0-a868-41fa-9394-ffe2013ba572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:22.616998 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720844a0-a868-41fa-9394-ffe2013ba572 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:22.617301 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720844a0-a868-41fa-9394-ffe2013ba572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:22.617642 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720844a0-a868-41fa-9394-ffe2013ba572 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:22.618368 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720844a0-a868-41fa-9394-ffe2013ba572 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:22.618725 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720844a0-a868-41fa-9394-ffe2013ba572 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:22.620998 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720844a0-a868-41fa-9394-ffe2013ba572 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:22.626740 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 466/928] 10.222.0.75 () {56 vars in 1147 bytes} [Wed Feb 16 05:21:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:22.632300 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3fe29-4045-4b03-b3cc-f3135c367ab7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:22.642378 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3fe29-4045-4b03-b3cc-f3135c367ab7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:22.647532 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a278d03-191e-47df-8420-82f12d170fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:22.648291 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a278d03-191e-47df-8420-82f12d170fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:22.648571 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a278d03-191e-47df-8420-82f12d170fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:22.648888 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a278d03-191e-47df-8420-82f12d170fb8 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:22.649669 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a278d03-191e-47df-8420-82f12d170fb8 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:22.650028 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a278d03-191e-47df-8420-82f12d170fb8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:22.651735 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a278d03-191e-47df-8420-82f12d170fb8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:22.657300 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 463/929] 10.222.0.75 () {56 vars in 1147 bytes} [Wed Feb 16 05:21:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:22.662909 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720844a0-a868-41fa-9394-ffe2013ba572 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:22.673735 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720844a0-a868-41fa-9394-ffe2013ba572 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:22.678473 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf887c6-e78e-4a6b-9431-4f9bae7e77fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:22.679109 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf887c6-e78e-4a6b-9431-4f9bae7e77fa admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:22.679437 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf887c6-e78e-4a6b-9431-4f9bae7e77fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:22.679706 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf887c6-e78e-4a6b-9431-4f9bae7e77fa admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:22.680506 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf887c6-e78e-4a6b-9431-4f9bae7e77fa admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:22.681870 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-eaf887c6-e78e-4a6b-9431-4f9bae7e77fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:21:22.681870 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Feb 16 05:21:22.681870 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: Feb 16 05:21:22.682798 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf887c6-e78e-4a6b-9431-4f9bae7e77fa admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:22.711371 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 467/930] 10.222.0.75 () {60 vars in 1165 bytes} [Wed Feb 16 05:21:22 2022] POST /identity/v3/endpoints => generated 347 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:21:23.778629 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74665039-a1f7-4808-8072-dcd15c5681d0 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:23.778629 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74665039-a1f7-4808-8072-dcd15c5681d0 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:23.778629 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74665039-a1f7-4808-8072-dcd15c5681d0 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:23.778629 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 464/931] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:23.787117 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667171e-1c66-48cf-bbc2-5f3983cee191 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:23.787117 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667171e-1c66-48cf-bbc2-5f3983cee191 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:23.787117 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1667171e-1c66-48cf-bbc2-5f3983cee191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:23.804361 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-1667171e-1c66-48cf-bbc2-5f3983cee191 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:23.806143 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1667171e-1c66-48cf-bbc2-5f3983cee191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:23.819480 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f9e79-1aee-4c05-9b08-ebc69d4c465f None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:23.819761 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f9e79-1aee-4c05-9b08-ebc69d4c465f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:23.820035 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f9e79-1aee-4c05-9b08-ebc69d4c465f None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:23.822058 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 465/932] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:23.829438 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3e99a-2252-4ca4-be0d-ada4bf96525b None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:23.829438 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3e99a-2252-4ca4-be0d-ada4bf96525b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:23.829438 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3e99a-2252-4ca4-be0d-ada4bf96525b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:23.829725 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 468/933] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:23 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:23.845665 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f6c3e99a-2252-4ca4-be0d-ada4bf96525b None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:23.846843 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f6c3e99a-2252-4ca4-be0d-ada4bf96525b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:23.852577 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667171e-1c66-48cf-bbc2-5f3983cee191 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:23.859037 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 466/934] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:23 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:21:23.863735 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1667171e-1c66-48cf-bbc2-5f3983cee191 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:23.868657 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da73e9f-0f55-4e93-8817-3bc4854c2d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:23.869754 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da73e9f-0f55-4e93-8817-3bc4854c2d82 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:23.870811 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da73e9f-0f55-4e93-8817-3bc4854c2d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:23.871284 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da73e9f-0f55-4e93-8817-3bc4854c2d82 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:23.872148 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da73e9f-0f55-4e93-8817-3bc4854c2d82 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:23.874006 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da73e9f-0f55-4e93-8817-3bc4854c2d82 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:23.883482 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3e99a-2252-4ca4-be0d-ada4bf96525b None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:23.888349 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-6da73e9f-0f55-4e93-8817-3bc4854c2d82 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 16 05:21:23.897303 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3e99a-2252-4ca4-be0d-ada4bf96525b None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:23.897496 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 469/935] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Feb 16 05:21:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:23.900647 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da73e9f-0f55-4e93-8817-3bc4854c2d82 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:23.901771 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923e1eb-a627-4921-a422-b62b0fffc5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:23.902596 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923e1eb-a627-4921-a422-b62b0fffc5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:23.902863 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923e1eb-a627-4921-a422-b62b0fffc5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:23.903139 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923e1eb-a627-4921-a422-b62b0fffc5b2 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:23.903809 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923e1eb-a627-4921-a422-b62b0fffc5b2 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:23.905491 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923e1eb-a627-4921-a422-b62b0fffc5b2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:23.913030 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da73e9f-0f55-4e93-8817-3bc4854c2d82 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:23.917955 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-7923e1eb-a627-4921-a422-b62b0fffc5b2 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 16 05:21:23.918472 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d9ea5-b46d-43bb-9f83-b3cac7da18f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:23.919343 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d9ea5-b46d-43bb-9f83-b3cac7da18f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:23.919677 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 467/936] 10.222.0.75 () {56 vars in 1147 bytes} [Wed Feb 16 05:21:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:23.920121 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d9ea5-b46d-43bb-9f83-b3cac7da18f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:23.920715 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d9ea5-b46d-43bb-9f83-b3cac7da18f1 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:23.921738 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d9ea5-b46d-43bb-9f83-b3cac7da18f1 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:23.922245 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d9ea5-b46d-43bb-9f83-b3cac7da18f1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:23.924039 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d9ea5-b46d-43bb-9f83-b3cac7da18f1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:23.925591 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923e1eb-a627-4921-a422-b62b0fffc5b2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:23.935311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 470/937] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Feb 16 05:21:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:23.935913 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923e1eb-a627-4921-a422-b62b0fffc5b2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:23.937057 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d9ea5-b46d-43bb-9f83-b3cac7da18f1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:23.940480 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f10abb-592d-474b-9527-c9f83fcc8812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:23.941117 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f10abb-592d-474b-9527-c9f83fcc8812 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:23.941446 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f10abb-592d-474b-9527-c9f83fcc8812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:23.941719 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f10abb-592d-474b-9527-c9f83fcc8812 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:23.942421 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f10abb-592d-474b-9527-c9f83fcc8812 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:23.942724 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f10abb-592d-474b-9527-c9f83fcc8812 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:23.944329 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f10abb-592d-474b-9527-c9f83fcc8812 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:23.949671 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d9ea5-b46d-43bb-9f83-b3cac7da18f1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:23.950075 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 468/938] 10.222.0.75 () {56 vars in 1143 bytes} [Wed Feb 16 05:21:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:23.955498 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f10abb-592d-474b-9527-c9f83fcc8812 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:23.956707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955ed5c-aa41-4993-8243-ff5a22082b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:23.957685 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955ed5c-aa41-4993-8243-ff5a22082b36 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:23.958223 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955ed5c-aa41-4993-8243-ff5a22082b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:23.958742 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955ed5c-aa41-4993-8243-ff5a22082b36 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:23.959706 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955ed5c-aa41-4993-8243-ff5a22082b36 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:23.960224 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955ed5c-aa41-4993-8243-ff5a22082b36 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:23.962091 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955ed5c-aa41-4993-8243-ff5a22082b36 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:23.964875 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f10abb-592d-474b-9527-c9f83fcc8812 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:23.972962 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b10b0-6d1b-4c6c-9ab7-72bf4c10e4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:23.972962 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b10b0-6d1b-4c6c-9ab7-72bf4c10e4ff admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:23.972962 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b10b0-6d1b-4c6c-9ab7-72bf4c10e4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:23.972962 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b10b0-6d1b-4c6c-9ab7-72bf4c10e4ff admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:23.973336 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b10b0-6d1b-4c6c-9ab7-72bf4c10e4ff admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:23.973336 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b10b0-6d1b-4c6c-9ab7-72bf4c10e4ff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:23.973336 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b10b0-6d1b-4c6c-9ab7-72bf4c10e4ff admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:23.973764 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 471/939] 10.222.0.75 () {56 vars in 1135 bytes} [Wed Feb 16 05:21:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:23.978411 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955ed5c-aa41-4993-8243-ff5a22082b36 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:23.978658 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 469/940] 10.222.0.75 () {56 vars in 1143 bytes} [Wed Feb 16 05:21:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:23.984500 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b10b0-6d1b-4c6c-9ab7-72bf4c10e4ff admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:23.989933 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955ed5c-aa41-4993-8243-ff5a22082b36 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:23.993806 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b10b0-6d1b-4c6c-9ab7-72bf4c10e4ff admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:23.996781 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9328c3ca-33f5-49e9-b51b-0f310da02f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:23.997936 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328c3ca-33f5-49e9-b51b-0f310da02f5f admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:23.998469 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328c3ca-33f5-49e9-b51b-0f310da02f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:23.998902 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41247dc4-3361-40f5-b632-344769a379f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:23.999195 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9328c3ca-33f5-49e9-b51b-0f310da02f5f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:23.999529 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41247dc4-3361-40f5-b632-344769a379f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:23.999806 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41247dc4-3361-40f5-b632-344769a379f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:24.000078 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41247dc4-3361-40f5-b632-344769a379f0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:24.000859 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41247dc4-3361-40f5-b632-344769a379f0 admin admin] RBAC: Adding query filter params (interface=public, service_id=b07076505bcc4638b185998bba077143, region_id=RegionOne) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:24.001093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9328c3ca-33f5-49e9-b51b-0f310da02f5f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:24.001190 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41247dc4-3361-40f5-b632-344769a379f0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:24.002795 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41247dc4-3361-40f5-b632-344769a379f0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:24.003290 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9328c3ca-33f5-49e9-b51b-0f310da02f5f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:24.013241 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 470/941] 10.222.0.75 () {56 vars in 1272 bytes} [Wed Feb 16 05:21:23 2022] GET /identity/v3/endpoints?service_id=b07076505bcc4638b185998bba077143&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:24.014416 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41247dc4-3361-40f5-b632-344769a379f0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:24.023967 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41247dc4-3361-40f5-b632-344769a379f0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:24.028497 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 472/942] 10.222.0.75 () {60 vars in 1165 bytes} [Wed Feb 16 05:21:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:21:24.038244 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eb3bc-b690-4f6e-82f9-148ac71a05ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:24.038766 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fe41c-6a1a-40c1-adc7-a1889864361c None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:24.038905 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eb3bc-b690-4f6e-82f9-148ac71a05ac admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:24.039079 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fe41c-6a1a-40c1-adc7-a1889864361c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:24.039173 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eb3bc-b690-4f6e-82f9-148ac71a05ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:24.039316 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fe41c-6a1a-40c1-adc7-a1889864361c None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:24.039403 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eb3bc-b690-4f6e-82f9-148ac71a05ac admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:24.040068 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6eb3bc-b690-4f6e-82f9-148ac71a05ac admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:24.043667 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 473/943] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:24 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:24.043817 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6eb3bc-b690-4f6e-82f9-148ac71a05ac admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:24.050788 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074a6e8-2592-496a-ae4b-fd557b359780 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:24.051109 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074a6e8-2592-496a-ae4b-fd557b359780 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:24.051348 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074a6e8-2592-496a-ae4b-fd557b359780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:24.051830 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 471/944] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Feb 16 05:21:24 2022] GET /identity/v3/services => generated 1497 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:21:24.081286 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2074a6e8-2592-496a-ae4b-fd557b359780 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:24.084339 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2074a6e8-2592-496a-ae4b-fd557b359780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:24.093811 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 474/945] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:24 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:24.119023 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eb3bc-b690-4f6e-82f9-148ac71a05ac admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:24.132400 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eb3bc-b690-4f6e-82f9-148ac71a05ac admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:24.138579 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fd7e9-e7a2-4241-acda-c08031fe7ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:24.139882 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fd7e9-e7a2-4241-acda-c08031fe7ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:24.140375 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fd7e9-e7a2-4241-acda-c08031fe7ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:24.140939 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fd7e9-e7a2-4241-acda-c08031fe7ba0 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:24.155988 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fd7e9-e7a2-4241-acda-c08031fe7ba0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:21:24.164180 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-bb5fd7e9-e7a2-4241-acda-c08031fe7ba0 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 05:21:24.166204 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 472/946] 10.222.0.75 () {56 vars in 1141 bytes} [Wed Feb 16 05:21:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:24.173710 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074a6e8-2592-496a-ae4b-fd557b359780 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:24.185706 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074a6e8-2592-496a-ae4b-fd557b359780 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:24.191217 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcae5c-bc9c-47bc-8a45-d61701e8a7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:24.192301 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcae5c-bc9c-47bc-8a45-d61701e8a7a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:24.192788 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcae5c-bc9c-47bc-8a45-d61701e8a7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:24.193357 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcae5c-bc9c-47bc-8a45-d61701e8a7a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:24.194384 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcae5c-bc9c-47bc-8a45-d61701e8a7a1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:24.194970 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcae5c-bc9c-47bc-8a45-d61701e8a7a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:24.196855 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcae5c-bc9c-47bc-8a45-d61701e8a7a1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:24.207753 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 475/947] 10.222.0.75 () {56 vars in 1136 bytes} [Wed Feb 16 05:21:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:24.214059 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fd7e9-e7a2-4241-acda-c08031fe7ba0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:24.225445 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fd7e9-e7a2-4241-acda-c08031fe7ba0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:24.231382 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d5a4d-ffc7-4b85-b381-a57951c94984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:24.232582 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d5a4d-ffc7-4b85-b381-a57951c94984 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:24.233106 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d5a4d-ffc7-4b85-b381-a57951c94984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:24.233657 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d5a4d-ffc7-4b85-b381-a57951c94984 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:24.247542 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d5a4d-ffc7-4b85-b381-a57951c94984 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:24.249850 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d5a4d-ffc7-4b85-b381-a57951c94984 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:24.268615 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-6e9d5a4d-ffc7-4b85-b381-a57951c94984 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:24.270434 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 473/948] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:24.276222 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcae5c-bc9c-47bc-8a45-d61701e8a7a1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:24.287117 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcae5c-bc9c-47bc-8a45-d61701e8a7a1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:24.292805 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6977a-efe9-4f45-9c6f-4b7e71aad8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:24.293582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6977a-efe9-4f45-9c6f-4b7e71aad8aa admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:24.293933 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6977a-efe9-4f45-9c6f-4b7e71aad8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:24.294284 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6977a-efe9-4f45-9c6f-4b7e71aad8aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:24.295085 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6977a-efe9-4f45-9c6f-4b7e71aad8aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:24.295461 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6977a-efe9-4f45-9c6f-4b7e71aad8aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:24.297156 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6977a-efe9-4f45-9c6f-4b7e71aad8aa admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:24.310043 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 476/949] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:24.315470 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d5a4d-ffc7-4b85-b381-a57951c94984 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:24.326109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d5a4d-ffc7-4b85-b381-a57951c94984 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:24.330961 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a210e-2b50-4f79-be47-a84a96cefc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:24.331806 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a210e-2b50-4f79-be47-a84a96cefc8f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:24.332084 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a210e-2b50-4f79-be47-a84a96cefc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:24.332353 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a210e-2b50-4f79-be47-a84a96cefc8f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:24.340842 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a210e-2b50-4f79-be47-a84a96cefc8f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:24.342967 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a210e-2b50-4f79-be47-a84a96cefc8f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:24.358393 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-d77a210e-2b50-4f79-be47-a84a96cefc8f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 16 05:21:24.360724 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 474/950] 10.222.0.75 () {56 vars in 1138 bytes} [Wed Feb 16 05:21:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:24.368711 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6977a-efe9-4f45-9c6f-4b7e71aad8aa admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:24.380406 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6977a-efe9-4f45-9c6f-4b7e71aad8aa admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:24.385204 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd40e3-2567-4aed-b8a2-11985fd98baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:24.385984 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd40e3-2567-4aed-b8a2-11985fd98baf admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:24.386316 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd40e3-2567-4aed-b8a2-11985fd98baf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:24.386586 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd40e3-2567-4aed-b8a2-11985fd98baf admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:24.387473 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd40e3-2567-4aed-b8a2-11985fd98baf admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:24.387774 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd40e3-2567-4aed-b8a2-11985fd98baf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:24.389769 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd40e3-2567-4aed-b8a2-11985fd98baf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:24.408284 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 477/951] 10.222.0.75 () {56 vars in 1170 bytes} [Wed Feb 16 05:21:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:24.413877 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a210e-2b50-4f79-be47-a84a96cefc8f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:24.424620 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a210e-2b50-4f79-be47-a84a96cefc8f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:24.429291 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e86e70-87c8-4a60-b591-e6bb47e8af0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:24.430011 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e86e70-87c8-4a60-b591-e6bb47e8af0f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:24.430288 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e86e70-87c8-4a60-b591-e6bb47e8af0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:24.430555 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e86e70-87c8-4a60-b591-e6bb47e8af0f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:24.440105 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e86e70-87c8-4a60-b591-e6bb47e8af0f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:24.442021 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e86e70-87c8-4a60-b591-e6bb47e8af0f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:24.451808 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 475/952] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:21:24 2022] GET /identity/v3/auth/tokens => generated 2138 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:21:24.457509 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd40e3-2567-4aed-b8a2-11985fd98baf admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:24.468246 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd40e3-2567-4aed-b8a2-11985fd98baf admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:24.473116 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300523f7-4910-4381-b0a2-26f56e7714a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:24.473934 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300523f7-4910-4381-b0a2-26f56e7714a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:24.474261 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300523f7-4910-4381-b0a2-26f56e7714a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:24.474531 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300523f7-4910-4381-b0a2-26f56e7714a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:24.486168 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300523f7-4910-4381-b0a2-26f56e7714a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:24.488016 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300523f7-4910-4381-b0a2-26f56e7714a8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:24.505244 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-300523f7-4910-4381-b0a2-26f56e7714a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:24.506777 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 478/953] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:24.512331 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e86e70-87c8-4a60-b591-e6bb47e8af0f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:24.521536 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e86e70-87c8-4a60-b591-e6bb47e8af0f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:24.526223 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c4a23-49c3-4243-a7d1-d843a4f4c1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:24.527406 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c4a23-49c3-4243-a7d1-d843a4f4c1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:24.527683 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c4a23-49c3-4243-a7d1-d843a4f4c1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:24.527953 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c4a23-49c3-4243-a7d1-d843a4f4c1a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:24.528669 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c4a23-49c3-4243-a7d1-d843a4f4c1a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:24.528973 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c4a23-49c3-4243-a7d1-d843a4f4c1a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:24.530730 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c4a23-49c3-4243-a7d1-d843a4f4c1a1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:24.543241 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 476/954] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:24.548767 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300523f7-4910-4381-b0a2-26f56e7714a8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:24.559195 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300523f7-4910-4381-b0a2-26f56e7714a8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:24.563897 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35921f1-78c5-4e65-9f8b-03a39bcd961f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:24.564713 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35921f1-78c5-4e65-9f8b-03a39bcd961f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:24.564996 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35921f1-78c5-4e65-9f8b-03a39bcd961f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:24.565304 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35921f1-78c5-4e65-9f8b-03a39bcd961f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:24.572476 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35921f1-78c5-4e65-9f8b-03a39bcd961f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:24.574561 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35921f1-78c5-4e65-9f8b-03a39bcd961f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:24.587659 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-f35921f1-78c5-4e65-9f8b-03a39bcd961f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:21:24.589666 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 479/955] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:24.595308 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c4a23-49c3-4243-a7d1-d843a4f4c1a1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:24.605929 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c4a23-49c3-4243-a7d1-d843a4f4c1a1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:24.610761 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8db600-4c2e-4fa5-988c-db77520cda9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:24.611463 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db600-4c2e-4fa5-988c-db77520cda9f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:24.611744 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db600-4c2e-4fa5-988c-db77520cda9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:24.612018 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db600-4c2e-4fa5-988c-db77520cda9f admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:24.612847 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8db600-4c2e-4fa5-988c-db77520cda9f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:24.613160 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8db600-4c2e-4fa5-988c-db77520cda9f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:24.620134 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8db600-4c2e-4fa5-988c-db77520cda9f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:24.627953 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 477/956] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:21:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:24.633814 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35921f1-78c5-4e65-9f8b-03a39bcd961f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:24.644715 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35921f1-78c5-4e65-9f8b-03a39bcd961f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:24.654501 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b36a2-54d9-4c8f-9cd7-227523e9b578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:24.655200 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b36a2-54d9-4c8f-9cd7-227523e9b578 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:24.655476 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b36a2-54d9-4c8f-9cd7-227523e9b578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:24.655741 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b36a2-54d9-4c8f-9cd7-227523e9b578 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:24.657490 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b36a2-54d9-4c8f-9cd7-227523e9b578 admin admin] RBAC: Adding query filter params (role.id=b8f12ed3613649e2bd643eca3c00d034, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=4d22345d2e2646cc99c74a2f9692b648) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:24.657847 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b36a2-54d9-4c8f-9cd7-227523e9b578 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:24.659750 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b36a2-54d9-4c8f-9cd7-227523e9b578 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:24.666849 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 480/957] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:21:24 2022] GET /identity/v3/role_assignments?user.id=4d22345d2e2646cc99c74a2f9692b648&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=b8f12ed3613649e2bd643eca3c00d034 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:25.134143 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654a9c3-1a9b-422e-a638-8b8cf50d952c None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:25.134979 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654a9c3-1a9b-422e-a638-8b8cf50d952c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:25.134979 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654a9c3-1a9b-422e-a638-8b8cf50d952c None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:25.137214 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 478/958] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:25.142626 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06c7ea-d8f7-44e2-b486-cc4a9b4e9b9a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:25.143124 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06c7ea-d8f7-44e2-b486-cc4a9b4e9b9a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:25.143284 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b06c7ea-d8f7-44e2-b486-cc4a9b4e9b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:25.161008 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-1b06c7ea-d8f7-44e2-b486-cc4a9b4e9b9a None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:25.162248 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1b06c7ea-d8f7-44e2-b486-cc4a9b4e9b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:25.174679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 481/959] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:25 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:25.197052 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654a9c3-1a9b-422e-a638-8b8cf50d952c None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:25.210137 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654a9c3-1a9b-422e-a638-8b8cf50d952c None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:25.215274 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d7418-77df-4a72-96c4-a0ba7036bbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:25.216049 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d7418-77df-4a72-96c4-a0ba7036bbfd admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:25.216327 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d7418-77df-4a72-96c4-a0ba7036bbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:25.216597 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d7418-77df-4a72-96c4-a0ba7036bbfd admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:25.217252 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d7418-77df-4a72-96c4-a0ba7036bbfd admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:25.218896 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d7418-77df-4a72-96c4-a0ba7036bbfd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:25.229896 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-059d7418-77df-4a72-96c4-a0ba7036bbfd admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 16 05:21:25.231343 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 479/960] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:25.237210 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06c7ea-d8f7-44e2-b486-cc4a9b4e9b9a None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:25.247296 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b06c7ea-d8f7-44e2-b486-cc4a9b4e9b9a None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:25.252171 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf985e0b-48b1-4bf4-a8b0-0639f7fdd5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:25.252947 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf985e0b-48b1-4bf4-a8b0-0639f7fdd5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:25.253359 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf985e0b-48b1-4bf4-a8b0-0639f7fdd5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:25.253707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf985e0b-48b1-4bf4-a8b0-0639f7fdd5d9 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:25.254506 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf985e0b-48b1-4bf4-a8b0-0639f7fdd5d9 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:25.254885 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf985e0b-48b1-4bf4-a8b0-0639f7fdd5d9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:25.256581 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf985e0b-48b1-4bf4-a8b0-0639f7fdd5d9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:25.262847 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 482/961] 10.222.0.75 () {56 vars in 1133 bytes} [Wed Feb 16 05:21:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:25.270513 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d7418-77df-4a72-96c4-a0ba7036bbfd admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:25.281480 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d7418-77df-4a72-96c4-a0ba7036bbfd admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:25.286471 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114bf0a-5a20-4da1-8bd0-b674595a3593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:25.287368 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114bf0a-5a20-4da1-8bd0-b674595a3593 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:25.287854 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114bf0a-5a20-4da1-8bd0-b674595a3593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:25.288357 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114bf0a-5a20-4da1-8bd0-b674595a3593 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:25.289356 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114bf0a-5a20-4da1-8bd0-b674595a3593 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:25.289899 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114bf0a-5a20-4da1-8bd0-b674595a3593 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:25.291711 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114bf0a-5a20-4da1-8bd0-b674595a3593 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:25.297637 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 480/962] 10.222.0.75 () {56 vars in 1133 bytes} [Wed Feb 16 05:21:25 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:26.442274 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85a3f8-f0d7-44d5-bd6c-561b889ca3d9 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:26.442815 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85a3f8-f0d7-44d5-bd6c-561b889ca3d9 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:26.442815 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85a3f8-f0d7-44d5-bd6c-561b889ca3d9 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:26.444866 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 483/963] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:26.451263 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb56f7d-aea0-4eeb-a786-b69659325688 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:26.451796 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb56f7d-aea0-4eeb-a786-b69659325688 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:26.451796 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb56f7d-aea0-4eeb-a786-b69659325688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:26.471028 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-3eb56f7d-aea0-4eeb-a786-b69659325688 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:26.472219 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3eb56f7d-aea0-4eeb-a786-b69659325688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:26.485368 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 481/964] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:26 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:26.503533 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85a3f8-f0d7-44d5-bd6c-561b889ca3d9 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:26.511401 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f9590-e05c-4e93-9458-3d0fc0e7b426 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:26.511962 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f9590-e05c-4e93-9458-3d0fc0e7b426 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:26.512440 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f9590-e05c-4e93-9458-3d0fc0e7b426 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:26.514685 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 482/965] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:26.516864 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85a3f8-f0d7-44d5-bd6c-561b889ca3d9 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:26.520393 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956906eb-e57d-408e-91ad-e88da49f66f1 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:26.520993 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956906eb-e57d-408e-91ad-e88da49f66f1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:26.521435 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005e8ae-dbf4-491e-bd28-c985d3361f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:26.521754 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956906eb-e57d-408e-91ad-e88da49f66f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:26.522215 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005e8ae-dbf4-491e-bd28-c985d3361f71 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:26.522491 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005e8ae-dbf4-491e-bd28-c985d3361f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:26.522761 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005e8ae-dbf4-491e-bd28-c985d3361f71 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:26.523406 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005e8ae-dbf4-491e-bd28-c985d3361f71 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:26.524995 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005e8ae-dbf4-491e-bd28-c985d3361f71 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:26.537146 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-a005e8ae-dbf4-491e-bd28-c985d3361f71 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 16 05:21:26.541387 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 484/966] 10.222.0.75 () {56 vars in 1147 bytes} [Wed Feb 16 05:21:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:26.544825 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-956906eb-e57d-408e-91ad-e88da49f66f1 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:26.545111 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005e8ae-dbf4-491e-bd28-c985d3361f71 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:26.546626 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-956906eb-e57d-408e-91ad-e88da49f66f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:26.555047 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 483/967] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:26 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:21:26.561308 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005e8ae-dbf4-491e-bd28-c985d3361f71 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:26.564249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e335eb-99f2-42f3-9a9d-4f5c674d59f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:26.565042 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e335eb-99f2-42f3-9a9d-4f5c674d59f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:26.565522 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e335eb-99f2-42f3-9a9d-4f5c674d59f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:26.565958 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e335eb-99f2-42f3-9a9d-4f5c674d59f8 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:26.566810 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e335eb-99f2-42f3-9a9d-4f5c674d59f8 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:26.567262 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e335eb-99f2-42f3-9a9d-4f5c674d59f8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:26.568992 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e335eb-99f2-42f3-9a9d-4f5c674d59f8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:26.578526 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 485/968] 10.222.0.75 () {56 vars in 1143 bytes} [Wed Feb 16 05:21:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:26.580854 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956906eb-e57d-408e-91ad-e88da49f66f1 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:26.582197 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e335eb-99f2-42f3-9a9d-4f5c674d59f8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:26.591392 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956906eb-e57d-408e-91ad-e88da49f66f1 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:26.592293 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e335eb-99f2-42f3-9a9d-4f5c674d59f8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:26.596504 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714feee-9717-4ca2-bd56-a2788c8ee357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:26.597158 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714feee-9717-4ca2-bd56-a2788c8ee357 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:26.597478 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714feee-9717-4ca2-bd56-a2788c8ee357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:26.597750 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714feee-9717-4ca2-bd56-a2788c8ee357 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:26.598333 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a902e3-7536-42e4-b3c9-bb28130200ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:26.598469 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714feee-9717-4ca2-bd56-a2788c8ee357 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:26.598749 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714feee-9717-4ca2-bd56-a2788c8ee357 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:26.599501 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a902e3-7536-42e4-b3c9-bb28130200ac admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:26.599980 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a902e3-7536-42e4-b3c9-bb28130200ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:26.600360 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714feee-9717-4ca2-bd56-a2788c8ee357 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:26.600675 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a902e3-7536-42e4-b3c9-bb28130200ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:26.601616 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a902e3-7536-42e4-b3c9-bb28130200ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:26.603874 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a902e3-7536-42e4-b3c9-bb28130200ac admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:26.605943 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 484/969] 10.222.0.75 () {56 vars in 1143 bytes} [Wed Feb 16 05:21:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:26.606427 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.common [None req-b6a902e3-7536-42e4-b3c9-bb28130200ac admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 16 05:21:26.612316 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714feee-9717-4ca2-bd56-a2788c8ee357 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:26.623320 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714feee-9717-4ca2-bd56-a2788c8ee357 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:26.628673 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.sql.core [None req-b6a902e3-7536-42e4-b3c9-bb28130200ac admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 16 05:21:26.628673 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 16 05:21:26.628673 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [parameters: {'id': 'a76ad758bbe04580a181bee0ba88d756', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 16 05:21:26.628673 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79198) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 16 05:21:26.628996 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74add80c-e437-4971-a06a-2238042581e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:26.629601 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74add80c-e437-4971-a06a-2238042581e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:26.629884 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74add80c-e437-4971-a06a-2238042581e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:26.630153 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74add80c-e437-4971-a06a-2238042581e0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:26.630892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74add80c-e437-4971-a06a-2238042581e0 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:26.632502 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74add80c-e437-4971-a06a-2238042581e0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:26.646986 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-b6a902e3-7536-42e4-b3c9-bb28130200ac admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a76ad758bbe04580a181bee0ba88d756.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a76ad758bbe04580a181bee0ba88d756. Feb 16 05:21:26.648656 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 486/970] 10.222.0.75 () {60 vars in 1161 bytes} [Wed Feb 16 05:21:26 2022] POST /identity/v3/projects => generated 262 bytes in 67 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:26.653059 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 485/971] 10.222.0.75 () {60 vars in 1165 bytes} [Wed Feb 16 05:21:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:21:26.663676 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a902e3-7536-42e4-b3c9-bb28130200ac admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:26.678397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a902e3-7536-42e4-b3c9-bb28130200ac admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:26.703069 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a127a4-d31d-4837-8538-b0aed958ecf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:26.704274 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a127a4-d31d-4837-8538-b0aed958ecf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:26.704828 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a127a4-d31d-4837-8538-b0aed958ecf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:26.705332 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a127a4-d31d-4837-8538-b0aed958ecf5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:26.714915 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a127a4-d31d-4837-8538-b0aed958ecf5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:26.717736 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a127a4-d31d-4837-8538-b0aed958ecf5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:26.733236 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-30a127a4-d31d-4837-8538-b0aed958ecf5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:21:26.735372 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 487/972] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:26.741808 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74add80c-e437-4971-a06a-2238042581e0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:26.753983 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74add80c-e437-4971-a06a-2238042581e0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:26.759202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7d18a-195f-4847-ab90-58b42bcd0ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:26.760214 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7d18a-195f-4847-ab90-58b42bcd0ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:26.760737 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7d18a-195f-4847-ab90-58b42bcd0ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:26.761793 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7d18a-195f-4847-ab90-58b42bcd0ed6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:26.762849 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7d18a-195f-4847-ab90-58b42bcd0ed6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:26.763384 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7d18a-195f-4847-ab90-58b42bcd0ed6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:26.765645 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7d18a-195f-4847-ab90-58b42bcd0ed6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:26.786332 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 486/973] 10.222.0.75 () {56 vars in 1133 bytes} [Wed Feb 16 05:21:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:27.066273 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ecb71-d87e-48cb-97da-161440c597c8 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:27.066647 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ecb71-d87e-48cb-97da-161440c597c8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:27.066828 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ecb71-d87e-48cb-97da-161440c597c8 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:27.068883 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 488/974] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:27.075042 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab3bd8-6d8f-4f6c-a1ab-cd608c984375 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:27.075329 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab3bd8-6d8f-4f6c-a1ab-cd608c984375 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:27.075605 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab3bd8-6d8f-4f6c-a1ab-cd608c984375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:27.093968 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-8fab3bd8-6d8f-4f6c-a1ab-cd608c984375 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:27.095145 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8fab3bd8-6d8f-4f6c-a1ab-cd608c984375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:27.103257 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 487/975] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:27 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:27.126902 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ecb71-d87e-48cb-97da-161440c597c8 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:27.139800 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ecb71-d87e-48cb-97da-161440c597c8 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:27.144236 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf95baf-b97d-420e-8c26-339dcab685f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:27.144996 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf95baf-b97d-420e-8c26-339dcab685f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:27.145286 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf95baf-b97d-420e-8c26-339dcab685f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:27.145579 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf95baf-b97d-420e-8c26-339dcab685f0 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:27.146227 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf95baf-b97d-420e-8c26-339dcab685f0 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:27.147910 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf95baf-b97d-420e-8c26-339dcab685f0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:27.158848 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-dcf95baf-b97d-420e-8c26-339dcab685f0 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 16 05:21:27.160328 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 489/976] 10.222.0.75 () {56 vars in 1126 bytes} [Wed Feb 16 05:21:27 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:27.166176 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab3bd8-6d8f-4f6c-a1ab-cd608c984375 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:27.175669 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab3bd8-6d8f-4f6c-a1ab-cd608c984375 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:27.180269 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ddc17-bfa5-488e-9f73-927a18de6fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:27.181171 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ddc17-bfa5-488e-9f73-927a18de6fdb admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:27.181478 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ddc17-bfa5-488e-9f73-927a18de6fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:27.181749 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ddc17-bfa5-488e-9f73-927a18de6fdb admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:27.183145 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ddc17-bfa5-488e-9f73-927a18de6fdb admin admin] RBAC: Adding query filter params (name=image) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:27.183459 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ddc17-bfa5-488e-9f73-927a18de6fdb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:27.185090 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ddc17-bfa5-488e-9f73-927a18de6fdb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:27.190327 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 488/977] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:27.195870 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf95baf-b97d-420e-8c26-339dcab685f0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:27.206326 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf95baf-b97d-420e-8c26-339dcab685f0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:27.211076 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510934a-2af3-41eb-b4a7-1f1717ce0705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:27.211774 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510934a-2af3-41eb-b4a7-1f1717ce0705 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:27.212057 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510934a-2af3-41eb-b4a7-1f1717ce0705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:27.212333 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510934a-2af3-41eb-b4a7-1f1717ce0705 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:27.213037 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510934a-2af3-41eb-b4a7-1f1717ce0705 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:27.213428 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510934a-2af3-41eb-b4a7-1f1717ce0705 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:27.215639 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510934a-2af3-41eb-b4a7-1f1717ce0705 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:27.220697 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 490/978] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:27 2022] GET /identity/v3/services?type=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:27.684521 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a5908-2bff-47fb-a359-1b8d9d0d4d24 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:27.685016 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a5908-2bff-47fb-a359-1b8d9d0d4d24 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:27.685128 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a5908-2bff-47fb-a359-1b8d9d0d4d24 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:27.686846 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 489/979] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:27.692520 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855065d-b329-4c3d-a2a2-570645c383b0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:27.693113 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855065d-b329-4c3d-a2a2-570645c383b0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:27.693113 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855065d-b329-4c3d-a2a2-570645c383b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:27.716184 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-6855065d-b329-4c3d-a2a2-570645c383b0 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:27.718138 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6855065d-b329-4c3d-a2a2-570645c383b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:27.726617 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 491/980] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:27 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:27.750518 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a5908-2bff-47fb-a359-1b8d9d0d4d24 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:27.763683 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a5908-2bff-47fb-a359-1b8d9d0d4d24 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:27.768190 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aace892-6e3f-4d83-b3d6-4c5615523a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:27.768900 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aace892-6e3f-4d83-b3d6-4c5615523a29 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:27.769184 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aace892-6e3f-4d83-b3d6-4c5615523a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:27.769500 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aace892-6e3f-4d83-b3d6-4c5615523a29 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:27.770290 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aace892-6e3f-4d83-b3d6-4c5615523a29 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:27.771914 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aace892-6e3f-4d83-b3d6-4c5615523a29 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:27.786420 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 490/981] 10.222.0.75 () {60 vars in 1162 bytes} [Wed Feb 16 05:21:27 2022] POST /identity/v3/services => generated 242 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:21:29.110590 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56a022-e07f-49fb-a7a0-b979c6964654 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:29.111107 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56a022-e07f-49fb-a7a0-b979c6964654 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:29.111107 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56a022-e07f-49fb-a7a0-b979c6964654 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:29.113232 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 492/982] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:29.118776 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8373cd-d085-41a8-90d9-60792be5050d None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:29.119227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8373cd-d085-41a8-90d9-60792be5050d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:29.119303 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8373cd-d085-41a8-90d9-60792be5050d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:29.139152 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-1f8373cd-d085-41a8-90d9-60792be5050d None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:29.140365 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-1f8373cd-d085-41a8-90d9-60792be5050d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:29.161372 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 491/983] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:29 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:29.181111 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56a022-e07f-49fb-a7a0-b979c6964654 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:29.193995 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56a022-e07f-49fb-a7a0-b979c6964654 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:29.199359 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1726e56-2d90-4adf-8828-14fd1200c0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:29.199759 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1726e56-2d90-4adf-8828-14fd1200c0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:29.199998 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1726e56-2d90-4adf-8828-14fd1200c0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:29.200264 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1726e56-2d90-4adf-8828-14fd1200c0b6 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:29.200910 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1726e56-2d90-4adf-8828-14fd1200c0b6 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:29.202540 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1726e56-2d90-4adf-8828-14fd1200c0b6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:29.213632 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-a1726e56-2d90-4adf-8828-14fd1200c0b6 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 16 05:21:29.219743 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 493/984] 10.222.0.75 () {56 vars in 1147 bytes} [Wed Feb 16 05:21:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:29.221057 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8373cd-d085-41a8-90d9-60792be5050d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:29.230090 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8373cd-d085-41a8-90d9-60792be5050d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:29.234652 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea54742-b1d4-4343-a82a-443439d7769d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:29.235294 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea54742-b1d4-4343-a82a-443439d7769d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:29.235569 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea54742-b1d4-4343-a82a-443439d7769d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:29.235839 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea54742-b1d4-4343-a82a-443439d7769d admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:29.236544 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea54742-b1d4-4343-a82a-443439d7769d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:29.236842 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea54742-b1d4-4343-a82a-443439d7769d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:29.238521 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea54742-b1d4-4343-a82a-443439d7769d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:29.248713 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 492/985] 10.222.0.75 () {56 vars in 1143 bytes} [Wed Feb 16 05:21:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:29.250055 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1726e56-2d90-4adf-8828-14fd1200c0b6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:29.259621 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1726e56-2d90-4adf-8828-14fd1200c0b6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:29.264768 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd51d00-9afd-4227-9071-e69609cef6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:29.265440 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd51d00-9afd-4227-9071-e69609cef6fd admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:29.265715 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd51d00-9afd-4227-9071-e69609cef6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:29.265979 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd51d00-9afd-4227-9071-e69609cef6fd admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:29.266674 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd51d00-9afd-4227-9071-e69609cef6fd admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:29.266968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd51d00-9afd-4227-9071-e69609cef6fd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:29.268539 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd51d00-9afd-4227-9071-e69609cef6fd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:29.277371 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 494/986] 10.222.0.75 () {56 vars in 1143 bytes} [Wed Feb 16 05:21:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:29.283745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea54742-b1d4-4343-a82a-443439d7769d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:29.294962 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea54742-b1d4-4343-a82a-443439d7769d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:29.301329 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a72347-9b3e-4a63-8c52-c5dfae03bcfa None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:29.301329 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a72347-9b3e-4a63-8c52-c5dfae03bcfa None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:29.301329 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a72347-9b3e-4a63-8c52-c5dfae03bcfa None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:29.302332 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 495/987] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 05:21:29.306347 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c63bd-f3a3-47d6-ba9a-e6a19588f7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:29.307181 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c63bd-f3a3-47d6-ba9a-e6a19588f7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:29.307598 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570effac-1e16-45f5-856a-08ffa4ec6fb5 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:29.307869 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c63bd-f3a3-47d6-ba9a-e6a19588f7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:29.307978 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570effac-1e16-45f5-856a-08ffa4ec6fb5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:29.308303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570effac-1e16-45f5-856a-08ffa4ec6fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:29.308589 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c63bd-f3a3-47d6-ba9a-e6a19588f7d6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:29.309576 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c63bd-f3a3-47d6-ba9a-e6a19588f7d6 admin admin] RBAC: Adding query filter params (interface=admin, service_id=b07076505bcc4638b185998bba077143, region_id=RegionOne) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:29.310109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c63bd-f3a3-47d6-ba9a-e6a19588f7d6 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:29.312154 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c63bd-f3a3-47d6-ba9a-e6a19588f7d6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:29.322483 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 493/988] 10.222.0.75 () {56 vars in 1270 bytes} [Wed Feb 16 05:21:29 2022] GET /identity/v3/endpoints?service_id=b07076505bcc4638b185998bba077143&interface=admin®ion_id=RegionOne => generated 193 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:29.324515 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c63bd-f3a3-47d6-ba9a-e6a19588f7d6 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:29.329178 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-570effac-1e16-45f5-856a-08ffa4ec6fb5 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:29.330572 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-570effac-1e16-45f5-856a-08ffa4ec6fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:29.335915 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c63bd-f3a3-47d6-ba9a-e6a19588f7d6 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:29.339950 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 496/989] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:29 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:29.342217 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1bcc37-755c-4c8d-9a13-00286afde408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:29.343127 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bcc37-755c-4c8d-9a13-00286afde408 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:29.343582 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bcc37-755c-4c8d-9a13-00286afde408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:29.344026 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bcc37-755c-4c8d-9a13-00286afde408 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:29.344885 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1bcc37-755c-4c8d-9a13-00286afde408 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:29.346747 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1bcc37-755c-4c8d-9a13-00286afde408 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:29.361524 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 494/990] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Feb 16 05:21:29 2022] GET /identity/v3/services => generated 1727 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:21:29.366556 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570effac-1e16-45f5-856a-08ffa4ec6fb5 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:29.376989 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570effac-1e16-45f5-856a-08ffa4ec6fb5 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:29.381936 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c9279-84c9-473f-828a-d6878e8121ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:29.382623 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c9279-84c9-473f-828a-d6878e8121ac admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:29.382903 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c9279-84c9-473f-828a-d6878e8121ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:29.383178 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c9279-84c9-473f-828a-d6878e8121ac admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:29.383888 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c9279-84c9-473f-828a-d6878e8121ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:29.386484 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28c9279-84c9-473f-828a-d6878e8121ac admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:29.402370 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.sql.core [None req-f28c9279-84c9-473f-828a-d6878e8121ac admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 16 05:21:29.402370 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 16 05:21:29.402370 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [parameters: {'user_id': 'c3dd72e254bb47899d674f5c368020c0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 16 05:21:29.402370 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79198) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 16 05:21:29.408558 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-f28c9279-84c9-473f-828a-d6878e8121ac admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 16 05:21:29.410359 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 497/991] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:21:29 2022] POST /identity/v3/users => generated 160 bytes in 44 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:29.416518 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1bcc37-755c-4c8d-9a13-00286afde408 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:29.427789 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1bcc37-755c-4c8d-9a13-00286afde408 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:29.433501 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc50fd-fed3-4d42-9d72-e6c3d139c178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:29.434395 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc50fd-fed3-4d42-9d72-e6c3d139c178 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:29.434676 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc50fd-fed3-4d42-9d72-e6c3d139c178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:29.434949 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc50fd-fed3-4d42-9d72-e6c3d139c178 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:29.444529 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc50fd-fed3-4d42-9d72-e6c3d139c178 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:29.446644 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc50fd-fed3-4d42-9d72-e6c3d139c178 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:29.463430 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-7ecc50fd-fed3-4d42-9d72-e6c3d139c178 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 16 05:21:29.465063 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 495/992] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:21:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:29.470833 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c9279-84c9-473f-828a-d6878e8121ac admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:29.482620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c9279-84c9-473f-828a-d6878e8121ac admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:29.487983 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69094e12-b62d-4c4d-bb54-b043df290e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:29.488661 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69094e12-b62d-4c4d-bb54-b043df290e53 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:29.488996 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69094e12-b62d-4c4d-bb54-b043df290e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:29.489339 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69094e12-b62d-4c4d-bb54-b043df290e53 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:29.490213 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69094e12-b62d-4c4d-bb54-b043df290e53 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:29.490518 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69094e12-b62d-4c4d-bb54-b043df290e53 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:29.492864 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69094e12-b62d-4c4d-bb54-b043df290e53 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:29.538193 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 498/993] 10.222.0.75 () {56 vars in 1122 bytes} [Wed Feb 16 05:21:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:29.729479 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed6e75-27c4-4120-9497-c2c727178737 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:29.730259 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed6e75-27c4-4120-9497-c2c727178737 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:29.730259 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed6e75-27c4-4120-9497-c2c727178737 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:29.731782 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 496/994] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:29.737366 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf88ba-2a3d-4d51-8f26-55d1e35a5dab None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:29.737655 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf88ba-2a3d-4d51-8f26-55d1e35a5dab None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:29.737929 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf88ba-2a3d-4d51-8f26-55d1e35a5dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:29.758697 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-64cf88ba-2a3d-4d51-8f26-55d1e35a5dab None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:29.760217 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-64cf88ba-2a3d-4d51-8f26-55d1e35a5dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:29.769461 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 499/995] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:29 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:29.792669 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed6e75-27c4-4120-9497-c2c727178737 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:29.806034 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed6e75-27c4-4120-9497-c2c727178737 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:29.811343 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caf43b-64a7-4529-8304-bc1fcb201234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:29.812225 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caf43b-64a7-4529-8304-bc1fcb201234 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:29.812730 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caf43b-64a7-4529-8304-bc1fcb201234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:29.813205 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caf43b-64a7-4529-8304-bc1fcb201234 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:29.814161 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5caf43b-64a7-4529-8304-bc1fcb201234 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:29.816009 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5caf43b-64a7-4529-8304-bc1fcb201234 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:29.838251 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 497/996] 10.222.0.75 () {60 vars in 1162 bytes} [Wed Feb 16 05:21:29 2022] POST /identity/v3/services => generated 242 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:21:30.347681 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9746ed-3728-4805-9053-a219216ca510 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:30.348407 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9746ed-3728-4805-9053-a219216ca510 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:30.348407 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9746ed-3728-4805-9053-a219216ca510 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:30.350210 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 500/997] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:30.355203 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218dba2-dd25-40e6-a002-acd0dd679f3c None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:30.355645 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218dba2-dd25-40e6-a002-acd0dd679f3c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:30.355739 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9218dba2-dd25-40e6-a002-acd0dd679f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:30.373233 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-9218dba2-dd25-40e6-a002-acd0dd679f3c None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:30.374437 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9218dba2-dd25-40e6-a002-acd0dd679f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:30.390989 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 498/998] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:30 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:30.414448 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9746ed-3728-4805-9053-a219216ca510 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:30.426383 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9746ed-3728-4805-9053-a219216ca510 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:30.431088 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b5a90-aad7-478e-8d35-b565c07046c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:30.431855 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b5a90-aad7-478e-8d35-b565c07046c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:30.432127 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b5a90-aad7-478e-8d35-b565c07046c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:30.432416 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b5a90-aad7-478e-8d35-b565c07046c4 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:30.433039 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b5a90-aad7-478e-8d35-b565c07046c4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:30.434696 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b5a90-aad7-478e-8d35-b565c07046c4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:30.445374 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-7a5b5a90-aad7-478e-8d35-b565c07046c4 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 16 05:21:30.446664 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 501/999] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:30.453070 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218dba2-dd25-40e6-a002-acd0dd679f3c None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:30.461924 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9218dba2-dd25-40e6-a002-acd0dd679f3c None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:30.466991 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b29c03-6f1d-48dd-a2b3-2d2171178b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:30.467633 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b29c03-6f1d-48dd-a2b3-2d2171178b23 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:30.467908 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b29c03-6f1d-48dd-a2b3-2d2171178b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:30.468176 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b29c03-6f1d-48dd-a2b3-2d2171178b23 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:30.468876 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b29c03-6f1d-48dd-a2b3-2d2171178b23 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:30.469174 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b29c03-6f1d-48dd-a2b3-2d2171178b23 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:30.470814 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b29c03-6f1d-48dd-a2b3-2d2171178b23 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:30.475653 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 499/1000] 10.222.0.75 () {56 vars in 1133 bytes} [Wed Feb 16 05:21:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:30.481248 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b5a90-aad7-478e-8d35-b565c07046c4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:30.490857 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b5a90-aad7-478e-8d35-b565c07046c4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:30.497516 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d3551-690b-4b1e-a6cb-59d00a70cff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:30.498166 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d3551-690b-4b1e-a6cb-59d00a70cff2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:30.498447 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d3551-690b-4b1e-a6cb-59d00a70cff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:30.498720 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d3551-690b-4b1e-a6cb-59d00a70cff2 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:30.499430 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d3551-690b-4b1e-a6cb-59d00a70cff2 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:30.499736 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d3551-690b-4b1e-a6cb-59d00a70cff2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:30.501356 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d3551-690b-4b1e-a6cb-59d00a70cff2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:30.507162 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 502/1001] 10.222.0.75 () {56 vars in 1133 bytes} [Wed Feb 16 05:21:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:30.513572 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b29c03-6f1d-48dd-a2b3-2d2171178b23 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:30.523665 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b29c03-6f1d-48dd-a2b3-2d2171178b23 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:30.528404 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe86156-d4bd-476b-9b02-e671e2b52022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:30.529047 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe86156-d4bd-476b-9b02-e671e2b52022 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:30.529358 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe86156-d4bd-476b-9b02-e671e2b52022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:30.529634 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe86156-d4bd-476b-9b02-e671e2b52022 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:30.530419 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe86156-d4bd-476b-9b02-e671e2b52022 admin admin] RBAC: Adding query filter params (interface=public, service_id=8e58e940d93e415f8c13258382c615a0, region_id=RegionOne) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:30.530728 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe86156-d4bd-476b-9b02-e671e2b52022 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:30.532332 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe86156-d4bd-476b-9b02-e671e2b52022 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:30.538088 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 500/1002] 10.222.0.75 () {56 vars in 1272 bytes} [Wed Feb 16 05:21:30 2022] GET /identity/v3/endpoints?service_id=8e58e940d93e415f8c13258382c615a0&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:30.543457 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d3551-690b-4b1e-a6cb-59d00a70cff2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:30.553193 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d3551-690b-4b1e-a6cb-59d00a70cff2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:30.558524 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c888e95-ebcf-4c7c-b451-f0793d44d0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:30.559253 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c888e95-ebcf-4c7c-b451-f0793d44d0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:30.559605 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c888e95-ebcf-4c7c-b451-f0793d44d0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:30.559883 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c888e95-ebcf-4c7c-b451-f0793d44d0b0 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:30.560551 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c888e95-ebcf-4c7c-b451-f0793d44d0b0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:30.562166 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c888e95-ebcf-4c7c-b451-f0793d44d0b0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:30.568736 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 503/1003] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Feb 16 05:21:30 2022] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:21:31.678174 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e0bf4-b742-457d-acd1-f383e56331e1 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:31.678623 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e0bf4-b742-457d-acd1-f383e56331e1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:31.678819 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e0bf4-b742-457d-acd1-f383e56331e1 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:31.680894 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 501/1004] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:31.686168 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b340b-c4f4-4458-b5dd-a9a07fbcb9bb None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:31.686659 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b340b-c4f4-4458-b5dd-a9a07fbcb9bb None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:31.686740 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b340b-c4f4-4458-b5dd-a9a07fbcb9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:31.705872 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-101b340b-c4f4-4458-b5dd-a9a07fbcb9bb None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:31.707087 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-101b340b-c4f4-4458-b5dd-a9a07fbcb9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:31.721669 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 504/1005] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:31 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:31.741508 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e0bf4-b742-457d-acd1-f383e56331e1 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:31.753540 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e0bf4-b742-457d-acd1-f383e56331e1 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:31.757916 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d4e24-132c-4ee8-9e35-9ff93ba17989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:31.758683 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d4e24-132c-4ee8-9e35-9ff93ba17989 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:31.758957 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d4e24-132c-4ee8-9e35-9ff93ba17989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:31.759222 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d4e24-132c-4ee8-9e35-9ff93ba17989 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:31.759862 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d4e24-132c-4ee8-9e35-9ff93ba17989 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:31.762016 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937d4e24-132c-4ee8-9e35-9ff93ba17989 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:31.772799 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-937d4e24-132c-4ee8-9e35-9ff93ba17989 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 16 05:21:31.774124 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 502/1006] 10.222.0.75 () {56 vars in 1147 bytes} [Wed Feb 16 05:21:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:31.780309 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b340b-c4f4-4458-b5dd-a9a07fbcb9bb None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:31.789516 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b340b-c4f4-4458-b5dd-a9a07fbcb9bb None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:31.794571 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a524418-3aae-493d-a22e-a6acf60494e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:31.795219 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a524418-3aae-493d-a22e-a6acf60494e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:31.795498 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a524418-3aae-493d-a22e-a6acf60494e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:31.795767 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a524418-3aae-493d-a22e-a6acf60494e4 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:31.796473 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a524418-3aae-493d-a22e-a6acf60494e4 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:31.796773 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a524418-3aae-493d-a22e-a6acf60494e4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:31.798401 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a524418-3aae-493d-a22e-a6acf60494e4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:31.804099 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 505/1007] 10.222.0.75 () {56 vars in 1143 bytes} [Wed Feb 16 05:21:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:31.810798 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d4e24-132c-4ee8-9e35-9ff93ba17989 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:31.820833 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937d4e24-132c-4ee8-9e35-9ff93ba17989 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:31.825496 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3472f-22cb-48a5-835e-4c2761e962a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:31.826166 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3472f-22cb-48a5-835e-4c2761e962a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:31.826443 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3472f-22cb-48a5-835e-4c2761e962a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:31.826712 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3472f-22cb-48a5-835e-4c2761e962a5 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:31.827441 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3472f-22cb-48a5-835e-4c2761e962a5 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:31.827744 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3472f-22cb-48a5-835e-4c2761e962a5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:31.829417 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3472f-22cb-48a5-835e-4c2761e962a5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:31.839476 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 503/1008] 10.222.0.75 () {56 vars in 1143 bytes} [Wed Feb 16 05:21:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:31.840393 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a524418-3aae-493d-a22e-a6acf60494e4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:31.850097 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a524418-3aae-493d-a22e-a6acf60494e4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:31.855032 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294fa28-43b9-4469-bc3d-2a1563483fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:31.855667 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294fa28-43b9-4469-bc3d-2a1563483fad admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:31.855946 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294fa28-43b9-4469-bc3d-2a1563483fad admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:31.856218 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294fa28-43b9-4469-bc3d-2a1563483fad admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:31.856945 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294fa28-43b9-4469-bc3d-2a1563483fad admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:31.858565 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294fa28-43b9-4469-bc3d-2a1563483fad admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:31.880146 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 506/1009] 10.222.0.75 () {60 vars in 1165 bytes} [Wed Feb 16 05:21:31 2022] POST /identity/v3/endpoints => generated 325 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:21:32.173682 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514dfc1-bc18-4b5c-8ac1-0711e3ce1d43 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:32.174080 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514dfc1-bc18-4b5c-8ac1-0711e3ce1d43 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:32.174258 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514dfc1-bc18-4b5c-8ac1-0711e3ce1d43 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:32.176108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 504/1010] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:32.181567 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34d55e-b85c-48b9-b9dc-7f0d8cd0a550 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:32.181861 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34d55e-b85c-48b9-b9dc-7f0d8cd0a550 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:32.182140 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e34d55e-b85c-48b9-b9dc-7f0d8cd0a550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:32.200704 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-9e34d55e-b85c-48b9-b9dc-7f0d8cd0a550 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:32.201915 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9e34d55e-b85c-48b9-b9dc-7f0d8cd0a550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:32.219237 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 507/1011] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:32 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:21:32.242765 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514dfc1-bc18-4b5c-8ac1-0711e3ce1d43 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:32.255504 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514dfc1-bc18-4b5c-8ac1-0711e3ce1d43 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:32.259809 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913f7f1-c6ec-42ba-99a8-e5dc1b651e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:32.261160 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913f7f1-c6ec-42ba-99a8-e5dc1b651e66 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:32.261477 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913f7f1-c6ec-42ba-99a8-e5dc1b651e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:32.261750 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913f7f1-c6ec-42ba-99a8-e5dc1b651e66 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:32.262402 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913f7f1-c6ec-42ba-99a8-e5dc1b651e66 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:32.264016 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913f7f1-c6ec-42ba-99a8-e5dc1b651e66 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:32.275118 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-9913f7f1-c6ec-42ba-99a8-e5dc1b651e66 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 16 05:21:32.277030 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 505/1012] 10.222.0.75 () {56 vars in 1126 bytes} [Wed Feb 16 05:21:32 2022] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:32.282721 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34d55e-b85c-48b9-b9dc-7f0d8cd0a550 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:32.291844 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e34d55e-b85c-48b9-b9dc-7f0d8cd0a550 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:32.297011 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723dec6b-85b3-4d73-90c7-41b9230da802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:32.297762 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dec6b-85b3-4d73-90c7-41b9230da802 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:32.298127 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dec6b-85b3-4d73-90c7-41b9230da802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:32.298470 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723dec6b-85b3-4d73-90c7-41b9230da802 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:32.299235 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723dec6b-85b3-4d73-90c7-41b9230da802 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:32.299601 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723dec6b-85b3-4d73-90c7-41b9230da802 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:32.301291 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723dec6b-85b3-4d73-90c7-41b9230da802 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:32.306615 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 508/1013] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:32.312844 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913f7f1-c6ec-42ba-99a8-e5dc1b651e66 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:32.323595 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913f7f1-c6ec-42ba-99a8-e5dc1b651e66 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:32.328920 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10f72a-3a3f-4ce4-8b2d-3834a6fbcfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:32.329606 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10f72a-3a3f-4ce4-8b2d-3834a6fbcfcb admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:32.331047 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10f72a-3a3f-4ce4-8b2d-3834a6fbcfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:32.331326 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10f72a-3a3f-4ce4-8b2d-3834a6fbcfcb admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:32.332032 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10f72a-3a3f-4ce4-8b2d-3834a6fbcfcb admin admin] RBAC: Adding query filter params (type=image) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:32.332335 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10f72a-3a3f-4ce4-8b2d-3834a6fbcfcb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:32.333964 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10f72a-3a3f-4ce4-8b2d-3834a6fbcfcb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:32.341130 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 506/1014] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:32.346788 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723dec6b-85b3-4d73-90c7-41b9230da802 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:32.356922 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723dec6b-85b3-4d73-90c7-41b9230da802 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:32.361378 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959ae3d-a506-4fd7-88fa-dd374e64b844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:32.362075 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959ae3d-a506-4fd7-88fa-dd374e64b844 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:32.362419 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959ae3d-a506-4fd7-88fa-dd374e64b844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:32.362760 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959ae3d-a506-4fd7-88fa-dd374e64b844 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:32.363602 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959ae3d-a506-4fd7-88fa-dd374e64b844 admin admin] RBAC: Adding query filter params (interface=public, service_id=8b87bb5ce70d4fcfb46bb1a0cb2f9328, region_id=RegionOne) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:32.363973 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959ae3d-a506-4fd7-88fa-dd374e64b844 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:32.365691 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959ae3d-a506-4fd7-88fa-dd374e64b844 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:32.371512 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 509/1015] 10.222.0.75 () {56 vars in 1272 bytes} [Wed Feb 16 05:21:32 2022] GET /identity/v3/endpoints?service_id=8b87bb5ce70d4fcfb46bb1a0cb2f9328&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:32.376907 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10f72a-3a3f-4ce4-8b2d-3834a6fbcfcb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:32.386593 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10f72a-3a3f-4ce4-8b2d-3834a6fbcfcb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:32.391070 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cf056-571e-4596-b84b-8e8a6f90f4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:32.391706 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cf056-571e-4596-b84b-8e8a6f90f4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:32.391987 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cf056-571e-4596-b84b-8e8a6f90f4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:32.392256 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cf056-571e-4596-b84b-8e8a6f90f4c2 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:32.392927 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85cf056-571e-4596-b84b-8e8a6f90f4c2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:32.394601 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85cf056-571e-4596-b84b-8e8a6f90f4c2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:32.402021 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 507/1016] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Feb 16 05:21:32 2022] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:21:32.904492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4b1c1-70df-42c2-86a0-c7291abf1463 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:32.905039 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4b1c1-70df-42c2-86a0-c7291abf1463 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:32.905039 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4b1c1-70df-42c2-86a0-c7291abf1463 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:32.906988 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 510/1017] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:32.912110 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc3f95-d4b9-4219-ae03-6bd2bf09bc74 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:32.912524 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc3f95-d4b9-4219-ae03-6bd2bf09bc74 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:32.912720 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc3f95-d4b9-4219-ae03-6bd2bf09bc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:32.930232 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-fafc3f95-d4b9-4219-ae03-6bd2bf09bc74 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:32.931615 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fafc3f95-d4b9-4219-ae03-6bd2bf09bc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:32.940714 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 508/1018] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:32 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:21:32.964761 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4b1c1-70df-42c2-86a0-c7291abf1463 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:32.982127 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4b1c1-70df-42c2-86a0-c7291abf1463 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:32.987188 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cc6d2-f0d2-4685-932c-896cb258cff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:32.988160 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cc6d2-f0d2-4685-932c-896cb258cff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:32.988474 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cc6d2-f0d2-4685-932c-896cb258cff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:32.988796 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cc6d2-f0d2-4685-932c-896cb258cff7 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:32.989622 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900cc6d2-f0d2-4685-932c-896cb258cff7 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:32.991830 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900cc6d2-f0d2-4685-932c-896cb258cff7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:33.005159 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-900cc6d2-f0d2-4685-932c-896cb258cff7 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 16 05:21:33.006777 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 511/1019] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:33.013157 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc3f95-d4b9-4219-ae03-6bd2bf09bc74 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:33.022234 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc3f95-d4b9-4219-ae03-6bd2bf09bc74 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:33.026776 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890efc8e-eca1-4911-8e8e-cd7851f1c387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:33.027479 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890efc8e-eca1-4911-8e8e-cd7851f1c387 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:33.027765 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890efc8e-eca1-4911-8e8e-cd7851f1c387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:33.028095 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890efc8e-eca1-4911-8e8e-cd7851f1c387 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:33.028799 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890efc8e-eca1-4911-8e8e-cd7851f1c387 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:33.029103 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890efc8e-eca1-4911-8e8e-cd7851f1c387 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:33.030759 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890efc8e-eca1-4911-8e8e-cd7851f1c387 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:33.036499 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 509/1020] 10.222.0.75 () {56 vars in 1133 bytes} [Wed Feb 16 05:21:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:33.042249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cc6d2-f0d2-4685-932c-896cb258cff7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:33.052612 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cc6d2-f0d2-4685-932c-896cb258cff7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:33.057989 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf92da-84be-42fa-aafd-1ec62f6e5200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:33.058644 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf92da-84be-42fa-aafd-1ec62f6e5200 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:33.058926 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf92da-84be-42fa-aafd-1ec62f6e5200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:33.059198 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf92da-84be-42fa-aafd-1ec62f6e5200 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:33.059897 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf92da-84be-42fa-aafd-1ec62f6e5200 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:33.060203 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf92da-84be-42fa-aafd-1ec62f6e5200 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:33.061814 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf92da-84be-42fa-aafd-1ec62f6e5200 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:33.067335 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 512/1021] 10.222.0.75 () {56 vars in 1133 bytes} [Wed Feb 16 05:21:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:33.072819 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890efc8e-eca1-4911-8e8e-cd7851f1c387 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:33.083073 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890efc8e-eca1-4911-8e8e-cd7851f1c387 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:33.087539 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a8e28-92e3-4967-8693-1956194f4e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:33.088175 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a8e28-92e3-4967-8693-1956194f4e2e admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:33.088455 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a8e28-92e3-4967-8693-1956194f4e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:33.088756 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a8e28-92e3-4967-8693-1956194f4e2e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:33.089533 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a8e28-92e3-4967-8693-1956194f4e2e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:33.091133 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a8e28-92e3-4967-8693-1956194f4e2e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:33.110029 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 510/1022] 10.222.0.75 () {60 vars in 1165 bytes} [Wed Feb 16 05:21:33 2022] POST /identity/v3/endpoints => generated 334 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:21:34.213102 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ee1cd-745a-405a-ac7e-cfdbd5d49c30 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:34.214319 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ee1cd-745a-405a-ac7e-cfdbd5d49c30 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:34.214991 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ee1cd-745a-405a-ac7e-cfdbd5d49c30 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:34.216476 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 513/1023] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:34.221694 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67006837-277b-4d7b-a61d-df74ea1e99a9 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:34.222087 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67006837-277b-4d7b-a61d-df74ea1e99a9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:34.222287 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67006837-277b-4d7b-a61d-df74ea1e99a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:34.239556 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-67006837-277b-4d7b-a61d-df74ea1e99a9 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:34.240749 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-67006837-277b-4d7b-a61d-df74ea1e99a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:34.257929 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 511/1024] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:34 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:34.282264 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ee1cd-745a-405a-ac7e-cfdbd5d49c30 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:34.294255 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ee1cd-745a-405a-ac7e-cfdbd5d49c30 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:34.298706 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b307c-206e-4d90-af62-5abe0c2bf97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:34.299474 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b307c-206e-4d90-af62-5abe0c2bf97f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:34.299753 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b307c-206e-4d90-af62-5abe0c2bf97f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:34.300022 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b307c-206e-4d90-af62-5abe0c2bf97f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:34.301182 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b307c-206e-4d90-af62-5abe0c2bf97f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:34.302874 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b307c-206e-4d90-af62-5abe0c2bf97f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:34.304595 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 514/1025] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:34.310894 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67006837-277b-4d7b-a61d-df74ea1e99a9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:34.319899 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67006837-277b-4d7b-a61d-df74ea1e99a9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:34.328720 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a2db2-d041-48a2-b244-5dd144b6bef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:34.330885 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a2db2-d041-48a2-b244-5dd144b6bef5 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:34.331168 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a2db2-d041-48a2-b244-5dd144b6bef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:34.331440 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a2db2-d041-48a2-b244-5dd144b6bef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:34.333394 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a2db2-d041-48a2-b244-5dd144b6bef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:34.335135 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a2db2-d041-48a2-b244-5dd144b6bef5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:34.370050 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 512/1026] 10.222.0.75 () {60 vars in 1162 bytes} [Wed Feb 16 05:21:34 2022] POST /identity/v3/projects => generated 311 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:21:34.757355 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3ed3a-1ff1-4d09-a1a7-dd76efae9948 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:34.757677 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3ed3a-1ff1-4d09-a1a7-dd76efae9948 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:34.757927 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3ed3a-1ff1-4d09-a1a7-dd76efae9948 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:34.759840 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 515/1027] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:34.765571 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9cc50-b7db-4a04-94ec-4e1e32d784f7 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:34.765866 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9cc50-b7db-4a04-94ec-4e1e32d784f7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:34.766153 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9cc50-b7db-4a04-94ec-4e1e32d784f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:34.784279 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-b5a9cc50-b7db-4a04-94ec-4e1e32d784f7 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:34.785498 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b5a9cc50-b7db-4a04-94ec-4e1e32d784f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:34.843277 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 513/1028] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:34 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:34.866913 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3ed3a-1ff1-4d09-a1a7-dd76efae9948 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:34.879733 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3ed3a-1ff1-4d09-a1a7-dd76efae9948 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:34.884142 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84437c3f-41d8-42c4-b69b-448a186eda23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:34.885039 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84437c3f-41d8-42c4-b69b-448a186eda23 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:34.885418 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84437c3f-41d8-42c4-b69b-448a186eda23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:34.885794 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84437c3f-41d8-42c4-b69b-448a186eda23 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:34.886505 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84437c3f-41d8-42c4-b69b-448a186eda23 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:34.888276 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84437c3f-41d8-42c4-b69b-448a186eda23 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:34.899111 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-84437c3f-41d8-42c4-b69b-448a186eda23 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 16 05:21:34.900420 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 516/1029] 10.222.0.75 () {56 vars in 1126 bytes} [Wed Feb 16 05:21:34 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:34.906422 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9cc50-b7db-4a04-94ec-4e1e32d784f7 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:34.915354 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9cc50-b7db-4a04-94ec-4e1e32d784f7 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:34.920456 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d127c02-94fb-455b-8f05-390193a8c7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:34.921045 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d127c02-94fb-455b-8f05-390193a8c7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:34.921357 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d127c02-94fb-455b-8f05-390193a8c7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:34.921635 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d127c02-94fb-455b-8f05-390193a8c7d5 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:34.922344 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d127c02-94fb-455b-8f05-390193a8c7d5 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:34.922650 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d127c02-94fb-455b-8f05-390193a8c7d5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:34.924256 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d127c02-94fb-455b-8f05-390193a8c7d5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:34.929219 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 514/1030] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:34.935998 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84437c3f-41d8-42c4-b69b-448a186eda23 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:34.946561 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84437c3f-41d8-42c4-b69b-448a186eda23 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:34.951047 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa609f9-6299-469c-bd7e-6489e1295dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:34.951671 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa609f9-6299-469c-bd7e-6489e1295dba admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:34.951952 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa609f9-6299-469c-bd7e-6489e1295dba admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:34.952226 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa609f9-6299-469c-bd7e-6489e1295dba admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:34.952920 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa609f9-6299-469c-bd7e-6489e1295dba admin admin] RBAC: Adding query filter params (type=image) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:34.953225 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa609f9-6299-469c-bd7e-6489e1295dba admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:34.954838 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa609f9-6299-469c-bd7e-6489e1295dba admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:34.959645 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 517/1031] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:34.965693 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d127c02-94fb-455b-8f05-390193a8c7d5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:34.975453 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d127c02-94fb-455b-8f05-390193a8c7d5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:34.980875 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4cbd2-474f-41fc-8833-acb779fe7229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:34.981594 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4cbd2-474f-41fc-8833-acb779fe7229 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:34.981879 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4cbd2-474f-41fc-8833-acb779fe7229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:34.982154 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4cbd2-474f-41fc-8833-acb779fe7229 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:34.982959 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4cbd2-474f-41fc-8833-acb779fe7229 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:34.984618 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4cbd2-474f-41fc-8833-acb779fe7229 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:35.004786 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 515/1032] 10.222.0.75 () {60 vars in 1165 bytes} [Wed Feb 16 05:21:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:21:35.544926 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e68454-186a-4476-8e19-c297240050b6 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:35.545466 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e68454-186a-4476-8e19-c297240050b6 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:35.545573 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e68454-186a-4476-8e19-c297240050b6 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:35.547320 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 518/1033] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:35.552566 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6a07f-2003-4c5d-aab3-1c5b8962b079 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:35.553020 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6a07f-2003-4c5d-aab3-1c5b8962b079 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:35.553122 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6a07f-2003-4c5d-aab3-1c5b8962b079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:35.571802 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-61a6a07f-2003-4c5d-aab3-1c5b8962b079 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:35.573572 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-61a6a07f-2003-4c5d-aab3-1c5b8962b079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:35.591385 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 516/1034] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:35 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:35.615170 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e68454-186a-4476-8e19-c297240050b6 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:35.627256 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e68454-186a-4476-8e19-c297240050b6 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:35.631594 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706602d7-ff3e-4777-ab57-b0224f2a3700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:35.632377 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706602d7-ff3e-4777-ab57-b0224f2a3700 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:35.632649 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706602d7-ff3e-4777-ab57-b0224f2a3700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:35.632914 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706602d7-ff3e-4777-ab57-b0224f2a3700 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:35.645392 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706602d7-ff3e-4777-ab57-b0224f2a3700 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:21:35.653219 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-706602d7-ff3e-4777-ab57-b0224f2a3700 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 05:21:35.654460 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 519/1035] 10.222.0.75 () {56 vars in 1141 bytes} [Wed Feb 16 05:21:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:35.660300 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6a07f-2003-4c5d-aab3-1c5b8962b079 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:35.671565 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6a07f-2003-4c5d-aab3-1c5b8962b079 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:35.676130 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e83b3-0a07-4da7-a7f7-9d8ac868f855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:35.676778 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e83b3-0a07-4da7-a7f7-9d8ac868f855 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:35.677054 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e83b3-0a07-4da7-a7f7-9d8ac868f855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:35.677355 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e83b3-0a07-4da7-a7f7-9d8ac868f855 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:35.678105 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e83b3-0a07-4da7-a7f7-9d8ac868f855 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:35.678406 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e83b3-0a07-4da7-a7f7-9d8ac868f855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:35.680001 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e83b3-0a07-4da7-a7f7-9d8ac868f855 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:35.688773 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 517/1036] 10.222.0.75 () {56 vars in 1136 bytes} [Wed Feb 16 05:21:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:35.694555 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706602d7-ff3e-4777-ab57-b0224f2a3700 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:35.705643 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706602d7-ff3e-4777-ab57-b0224f2a3700 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:35.710335 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03204b70-d1ea-4ba1-9fe4-31cc14b2ff07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:35.711102 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03204b70-d1ea-4ba1-9fe4-31cc14b2ff07 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:35.711383 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03204b70-d1ea-4ba1-9fe4-31cc14b2ff07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:35.711678 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03204b70-d1ea-4ba1-9fe4-31cc14b2ff07 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:35.722747 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03204b70-d1ea-4ba1-9fe4-31cc14b2ff07 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:35.724608 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03204b70-d1ea-4ba1-9fe4-31cc14b2ff07 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:35.741222 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-03204b70-d1ea-4ba1-9fe4-31cc14b2ff07 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:35.747504 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 520/1037] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:35.748697 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e83b3-0a07-4da7-a7f7-9d8ac868f855 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:35.758737 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e83b3-0a07-4da7-a7f7-9d8ac868f855 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:35.763960 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d40d6-5855-423c-8dc6-16d6dfed7507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:35.764618 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d40d6-5855-423c-8dc6-16d6dfed7507 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:35.764905 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d40d6-5855-423c-8dc6-16d6dfed7507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:35.765224 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d40d6-5855-423c-8dc6-16d6dfed7507 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:35.765979 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d40d6-5855-423c-8dc6-16d6dfed7507 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:35.766338 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d40d6-5855-423c-8dc6-16d6dfed7507 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:35.768004 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d40d6-5855-423c-8dc6-16d6dfed7507 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:35.784597 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 518/1038] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:35.785920 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03204b70-d1ea-4ba1-9fe4-31cc14b2ff07 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:35.797093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03204b70-d1ea-4ba1-9fe4-31cc14b2ff07 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:35.803952 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f94c4d-a600-4d44-b7b0-b99cd5efc613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:35.804795 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f94c4d-a600-4d44-b7b0-b99cd5efc613 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:35.805117 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f94c4d-a600-4d44-b7b0-b99cd5efc613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:35.805446 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f94c4d-a600-4d44-b7b0-b99cd5efc613 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:35.814004 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f94c4d-a600-4d44-b7b0-b99cd5efc613 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:35.816087 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f94c4d-a600-4d44-b7b0-b99cd5efc613 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:35.830662 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-33f94c4d-a600-4d44-b7b0-b99cd5efc613 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 05:21:35.834572 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 521/1039] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Feb 16 05:21:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:35.837937 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d40d6-5855-423c-8dc6-16d6dfed7507 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:35.848281 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d40d6-5855-423c-8dc6-16d6dfed7507 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:35.852738 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1e9dc-3f56-4be4-99b5-995b91cf7b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:35.853428 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1e9dc-3f56-4be4-99b5-995b91cf7b59 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:35.853707 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1e9dc-3f56-4be4-99b5-995b91cf7b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:35.853974 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1e9dc-3f56-4be4-99b5-995b91cf7b59 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:35.855394 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1e9dc-3f56-4be4-99b5-995b91cf7b59 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:35.855701 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1e9dc-3f56-4be4-99b5-995b91cf7b59 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:35.857574 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1e9dc-3f56-4be4-99b5-995b91cf7b59 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:35.874445 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 519/1040] 10.222.0.75 () {56 vars in 1154 bytes} [Wed Feb 16 05:21:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:35.879893 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f94c4d-a600-4d44-b7b0-b99cd5efc613 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:35.889766 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f94c4d-a600-4d44-b7b0-b99cd5efc613 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:35.894251 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511733ad-03ed-4d74-9e56-aed1f000e774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:35.894910 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511733ad-03ed-4d74-9e56-aed1f000e774 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:35.895194 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511733ad-03ed-4d74-9e56-aed1f000e774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:35.895471 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511733ad-03ed-4d74-9e56-aed1f000e774 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:35.903800 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511733ad-03ed-4d74-9e56-aed1f000e774 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:35.905579 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511733ad-03ed-4d74-9e56-aed1f000e774 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:35.914520 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 522/1041] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:21:35 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:21:35.921079 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1e9dc-3f56-4be4-99b5-995b91cf7b59 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:35.931055 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1e9dc-3f56-4be4-99b5-995b91cf7b59 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:35.935748 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9ceae-9a9f-4765-80bb-29b861cf1d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:35.936599 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9ceae-9a9f-4765-80bb-29b861cf1d60 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:35.936941 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9ceae-9a9f-4765-80bb-29b861cf1d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:35.937310 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9ceae-9a9f-4765-80bb-29b861cf1d60 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:35.947626 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9ceae-9a9f-4765-80bb-29b861cf1d60 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:35.950665 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9ceae-9a9f-4765-80bb-29b861cf1d60 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:35.967868 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-7ba9ceae-9a9f-4765-80bb-29b861cf1d60 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:35.969185 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 520/1042] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:35.974912 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511733ad-03ed-4d74-9e56-aed1f000e774 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:35.984442 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511733ad-03ed-4d74-9e56-aed1f000e774 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:35.989074 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4243dd-4be2-4086-a4cb-39382459a4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:35.989817 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4243dd-4be2-4086-a4cb-39382459a4ba admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:35.990171 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4243dd-4be2-4086-a4cb-39382459a4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:35.990517 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4243dd-4be2-4086-a4cb-39382459a4ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:35.991312 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4243dd-4be2-4086-a4cb-39382459a4ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:35.991699 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4243dd-4be2-4086-a4cb-39382459a4ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:35.993479 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4243dd-4be2-4086-a4cb-39382459a4ba admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:36.004804 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 523/1043] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:36.010035 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9ceae-9a9f-4765-80bb-29b861cf1d60 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:36.019614 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9ceae-9a9f-4765-80bb-29b861cf1d60 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:36.024163 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66ad60-4cb0-4910-b40a-e75ad73e0806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:36.025006 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66ad60-4cb0-4910-b40a-e75ad73e0806 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:36.025391 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66ad60-4cb0-4910-b40a-e75ad73e0806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:36.025736 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66ad60-4cb0-4910-b40a-e75ad73e0806 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:36.036659 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66ad60-4cb0-4910-b40a-e75ad73e0806 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:36.038695 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66ad60-4cb0-4910-b40a-e75ad73e0806 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:36.052446 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-5b66ad60-4cb0-4910-b40a-e75ad73e0806 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:21:36.053778 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 521/1044] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:36.059692 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4243dd-4be2-4086-a4cb-39382459a4ba admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:36.069473 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4243dd-4be2-4086-a4cb-39382459a4ba admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:36.074674 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ab490-8718-4454-a398-c6847cc73b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:36.075320 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ab490-8718-4454-a398-c6847cc73b02 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:36.075599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ab490-8718-4454-a398-c6847cc73b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:36.075873 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ab490-8718-4454-a398-c6847cc73b02 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:36.076653 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ab490-8718-4454-a398-c6847cc73b02 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:36.076961 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ab490-8718-4454-a398-c6847cc73b02 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:36.078882 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ab490-8718-4454-a398-c6847cc73b02 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:36.091794 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 524/1045] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:21:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:36.097602 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66ad60-4cb0-4910-b40a-e75ad73e0806 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:36.107938 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66ad60-4cb0-4910-b40a-e75ad73e0806 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:36.112401 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d976c-8956-42a3-8282-8bfbec5d9e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:36.113018 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d976c-8956-42a3-8282-8bfbec5d9e83 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:36.113320 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d976c-8956-42a3-8282-8bfbec5d9e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:36.113594 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d976c-8956-42a3-8282-8bfbec5d9e83 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:36.114403 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d976c-8956-42a3-8282-8bfbec5d9e83 admin admin] RBAC: Adding query filter params (role.id=b8f12ed3613649e2bd643eca3c00d034, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=6522d231532a48ad8dbc9c9e79a021dd) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:36.114710 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d976c-8956-42a3-8282-8bfbec5d9e83 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:36.116559 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d976c-8956-42a3-8282-8bfbec5d9e83 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:36.121986 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 522/1046] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:21:36 2022] GET /identity/v3/role_assignments?user.id=6522d231532a48ad8dbc9c9e79a021dd&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=b8f12ed3613649e2bd643eca3c00d034 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:37.077027 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c9f5f-5b69-4218-9aff-964003904e38 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:37.077577 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c9f5f-5b69-4218-9aff-964003904e38 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:37.077577 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c9f5f-5b69-4218-9aff-964003904e38 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:37.079416 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 525/1047] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:37.084828 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159636d8-5ddb-4207-850b-b089d283c3ef None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:37.085229 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159636d8-5ddb-4207-850b-b089d283c3ef None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:37.085421 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159636d8-5ddb-4207-850b-b089d283c3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:37.103776 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-159636d8-5ddb-4207-850b-b089d283c3ef None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:37.104997 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-159636d8-5ddb-4207-850b-b089d283c3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:37.112997 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 523/1048] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:37 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:37.138773 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c9f5f-5b69-4218-9aff-964003904e38 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:37.151788 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c9f5f-5b69-4218-9aff-964003904e38 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:37.156148 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6238d71-ab9e-414c-9c25-0bc1083f95d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:37.156967 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6238d71-ab9e-414c-9c25-0bc1083f95d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:37.157243 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6238d71-ab9e-414c-9c25-0bc1083f95d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:37.157538 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6238d71-ab9e-414c-9c25-0bc1083f95d1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:37.158687 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6238d71-ab9e-414c-9c25-0bc1083f95d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:37.160441 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6238d71-ab9e-414c-9c25-0bc1083f95d1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:37.162368 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 526/1049] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:37.167975 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159636d8-5ddb-4207-850b-b089d283c3ef None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:37.177181 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159636d8-5ddb-4207-850b-b089d283c3ef None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:37.182126 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cf5f9-c378-4fa7-8e61-b063a4c7c657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:37.182885 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cf5f9-c378-4fa7-8e61-b063a4c7c657 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:37.183238 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cf5f9-c378-4fa7-8e61-b063a4c7c657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:37.183584 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cf5f9-c378-4fa7-8e61-b063a4c7c657 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:37.184362 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cf5f9-c378-4fa7-8e61-b063a4c7c657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:37.186341 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cf5f9-c378-4fa7-8e61-b063a4c7c657 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:37.206763 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 524/1050] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Feb 16 05:21:37 2022] POST /identity/v3/users => generated 285 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:21:37.600038 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaae1fd-a12a-4883-a726-cea3c63d8e4f None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:37.600508 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaae1fd-a12a-4883-a726-cea3c63d8e4f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:37.600645 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaae1fd-a12a-4883-a726-cea3c63d8e4f None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:37.602410 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 527/1051] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:37.610649 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de772811-e10b-4a70-8b1b-00534ba081b1 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:37.611074 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de772811-e10b-4a70-8b1b-00534ba081b1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:37.611458 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de772811-e10b-4a70-8b1b-00534ba081b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:37.635486 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-de772811-e10b-4a70-8b1b-00534ba081b1 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:37.637108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-de772811-e10b-4a70-8b1b-00534ba081b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:37.647958 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 525/1052] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:37 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:37.680307 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaae1fd-a12a-4883-a726-cea3c63d8e4f None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:37.693183 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaae1fd-a12a-4883-a726-cea3c63d8e4f None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:37.697573 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f52b31-3700-4666-aa9b-6a68baf7a0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:37.698705 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f52b31-3700-4666-aa9b-6a68baf7a0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:37.698978 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f52b31-3700-4666-aa9b-6a68baf7a0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:37.699243 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f52b31-3700-4666-aa9b-6a68baf7a0f1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:37.706951 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f52b31-3700-4666-aa9b-6a68baf7a0f1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:37.708678 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f52b31-3700-4666-aa9b-6a68baf7a0f1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:37.722483 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 528/1053] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:21:37 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:21:37.727985 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de772811-e10b-4a70-8b1b-00534ba081b1 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:37.736892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de772811-e10b-4a70-8b1b-00534ba081b1 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:37.741399 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4cd5a-8cae-444a-9c97-af4bc461211e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:37.742250 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4cd5a-8cae-444a-9c97-af4bc461211e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:37.742526 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4cd5a-8cae-444a-9c97-af4bc461211e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:37.742792 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4cd5a-8cae-444a-9c97-af4bc461211e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:37.743946 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4cd5a-8cae-444a-9c97-af4bc461211e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:37.745815 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4cd5a-8cae-444a-9c97-af4bc461211e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:37.747648 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 526/1054] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:38.412574 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56384667-6d72-4775-91cc-299c750f64ba None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:38.413129 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56384667-6d72-4775-91cc-299c750f64ba None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:38.413129 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56384667-6d72-4775-91cc-299c750f64ba None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:38.414931 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 529/1055] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:38.421156 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a1f94-de83-4cc1-bb8f-f32e18711464 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:38.421709 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a1f94-de83-4cc1-bb8f-f32e18711464 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:38.421709 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a1f94-de83-4cc1-bb8f-f32e18711464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:38.440985 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-874a1f94-de83-4cc1-bb8f-f32e18711464 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:38.442203 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-874a1f94-de83-4cc1-bb8f-f32e18711464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:38.450041 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 527/1056] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:38 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:38.472526 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56384667-6d72-4775-91cc-299c750f64ba None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:38.484915 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56384667-6d72-4775-91cc-299c750f64ba None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:38.489169 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee8b31-b180-4a26-aa2d-9ff0ac2212d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:38.490003 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee8b31-b180-4a26-aa2d-9ff0ac2212d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:38.490276 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee8b31-b180-4a26-aa2d-9ff0ac2212d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:38.490541 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee8b31-b180-4a26-aa2d-9ff0ac2212d0 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:38.501448 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee8b31-b180-4a26-aa2d-9ff0ac2212d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:21:38.508513 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-b8ee8b31-b180-4a26-aa2d-9ff0ac2212d0 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 05:21:38.509729 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 530/1057] 10.222.0.75 () {56 vars in 1141 bytes} [Wed Feb 16 05:21:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:38.516308 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a1f94-de83-4cc1-bb8f-f32e18711464 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:38.525097 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a1f94-de83-4cc1-bb8f-f32e18711464 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:38.530118 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20b2d7-6150-4eed-9cd7-3dd6adbe2059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:38.530754 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20b2d7-6150-4eed-9cd7-3dd6adbe2059 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:38.531027 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20b2d7-6150-4eed-9cd7-3dd6adbe2059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:38.531293 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20b2d7-6150-4eed-9cd7-3dd6adbe2059 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:38.532025 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20b2d7-6150-4eed-9cd7-3dd6adbe2059 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:38.532320 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20b2d7-6150-4eed-9cd7-3dd6adbe2059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:38.533938 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20b2d7-6150-4eed-9cd7-3dd6adbe2059 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:38.541744 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 528/1058] 10.222.0.75 () {56 vars in 1136 bytes} [Wed Feb 16 05:21:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:38.547349 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee8b31-b180-4a26-aa2d-9ff0ac2212d0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:38.559154 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee8b31-b180-4a26-aa2d-9ff0ac2212d0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:38.563562 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d4089-b272-4867-9fca-ff567b6d1c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:38.564321 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d4089-b272-4867-9fca-ff567b6d1c91 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:38.564599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d4089-b272-4867-9fca-ff567b6d1c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:38.564870 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d4089-b272-4867-9fca-ff567b6d1c91 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:38.575222 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d4089-b272-4867-9fca-ff567b6d1c91 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:38.577033 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d4089-b272-4867-9fca-ff567b6d1c91 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:38.593548 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-928d4089-b272-4867-9fca-ff567b6d1c91 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:38.594676 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 531/1059] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:38.600243 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20b2d7-6150-4eed-9cd7-3dd6adbe2059 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:38.610154 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20b2d7-6150-4eed-9cd7-3dd6adbe2059 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:38.614660 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43ddfc-5b11-4c92-861f-3e00eb04b5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:38.615299 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43ddfc-5b11-4c92-861f-3e00eb04b5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:38.615577 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43ddfc-5b11-4c92-861f-3e00eb04b5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:38.615850 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43ddfc-5b11-4c92-861f-3e00eb04b5c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:38.616560 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43ddfc-5b11-4c92-861f-3e00eb04b5c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:38.616861 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43ddfc-5b11-4c92-861f-3e00eb04b5c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:38.618499 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43ddfc-5b11-4c92-861f-3e00eb04b5c9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:38.630004 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 529/1060] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:38.635888 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d4089-b272-4867-9fca-ff567b6d1c91 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:38.645310 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d4089-b272-4867-9fca-ff567b6d1c91 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:38.649848 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f79ba3-1d01-4e9b-ac41-43f62630b33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:38.650616 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f79ba3-1d01-4e9b-ac41-43f62630b33d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:38.650893 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f79ba3-1d01-4e9b-ac41-43f62630b33d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:38.651763 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f79ba3-1d01-4e9b-ac41-43f62630b33d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:38.658973 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f79ba3-1d01-4e9b-ac41-43f62630b33d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:38.660967 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f79ba3-1d01-4e9b-ac41-43f62630b33d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:38.674188 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-d2f79ba3-1d01-4e9b-ac41-43f62630b33d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 05:21:38.675339 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 532/1061] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Feb 16 05:21:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:38.681274 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43ddfc-5b11-4c92-861f-3e00eb04b5c9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:38.690841 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43ddfc-5b11-4c92-861f-3e00eb04b5c9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:38.695292 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d96a2-be55-4beb-9581-19a55c8ca8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:38.695929 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d96a2-be55-4beb-9581-19a55c8ca8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:38.696205 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d96a2-be55-4beb-9581-19a55c8ca8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:38.696472 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d96a2-be55-4beb-9581-19a55c8ca8b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:38.697323 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d96a2-be55-4beb-9581-19a55c8ca8b3 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:38.697627 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d96a2-be55-4beb-9581-19a55c8ca8b3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:38.699970 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13d96a2-be55-4beb-9581-19a55c8ca8b3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:38.721891 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 530/1062] 10.222.0.75 () {56 vars in 1154 bytes} [Wed Feb 16 05:21:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:38.722816 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f79ba3-1d01-4e9b-ac41-43f62630b33d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:38.732310 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f79ba3-1d01-4e9b-ac41-43f62630b33d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:38.736749 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082c796-2a94-4440-8eca-4b6bbc65b565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:38.737536 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082c796-2a94-4440-8eca-4b6bbc65b565 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:38.737813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082c796-2a94-4440-8eca-4b6bbc65b565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:38.738082 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082c796-2a94-4440-8eca-4b6bbc65b565 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:38.748483 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082c796-2a94-4440-8eca-4b6bbc65b565 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:38.750339 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082c796-2a94-4440-8eca-4b6bbc65b565 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:38.767109 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-6082c796-2a94-4440-8eca-4b6bbc65b565 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:38.768242 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 533/1063] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:38.773857 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d96a2-be55-4beb-9581-19a55c8ca8b3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:38.783356 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d96a2-be55-4beb-9581-19a55c8ca8b3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:38.787838 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8332c-ea02-4518-8e1d-1a582cd95574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:38.788468 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8332c-ea02-4518-8e1d-1a582cd95574 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:38.788745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8332c-ea02-4518-8e1d-1a582cd95574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:38.789012 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8332c-ea02-4518-8e1d-1a582cd95574 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:38.789749 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8332c-ea02-4518-8e1d-1a582cd95574 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:38.790051 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8332c-ea02-4518-8e1d-1a582cd95574 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:38.791661 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8332c-ea02-4518-8e1d-1a582cd95574 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:38.806970 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 531/1064] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:38.808859 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082c796-2a94-4440-8eca-4b6bbc65b565 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:38.818217 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082c796-2a94-4440-8eca-4b6bbc65b565 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:38.822599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca6ab4-bc69-49bc-885a-489bec290b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:38.823956 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca6ab4-bc69-49bc-885a-489bec290b66 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:38.824234 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca6ab4-bc69-49bc-885a-489bec290b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:38.824498 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca6ab4-bc69-49bc-885a-489bec290b66 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:38.831139 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca6ab4-bc69-49bc-885a-489bec290b66 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:38.833063 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca6ab4-bc69-49bc-885a-489bec290b66 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:38.845824 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-2bca6ab4-bc69-49bc-885a-489bec290b66 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:21:38.846972 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 534/1065] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:38.852719 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8332c-ea02-4518-8e1d-1a582cd95574 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:38.862460 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8332c-ea02-4518-8e1d-1a582cd95574 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:38.866997 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff4b79-707e-40b1-9453-0e377e192df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:38.867703 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff4b79-707e-40b1-9453-0e377e192df7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:38.868052 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff4b79-707e-40b1-9453-0e377e192df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:38.868392 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff4b79-707e-40b1-9453-0e377e192df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:38.869281 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff4b79-707e-40b1-9453-0e377e192df7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:38.870238 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff4b79-707e-40b1-9453-0e377e192df7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:38.872240 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff4b79-707e-40b1-9453-0e377e192df7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:38.884209 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 532/1066] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:21:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:38.890788 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca6ab4-bc69-49bc-885a-489bec290b66 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:38.901617 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca6ab4-bc69-49bc-885a-489bec290b66 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:38.906336 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df316096-02c5-4701-8eda-43f5fbed821d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:38.907196 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df316096-02c5-4701-8eda-43f5fbed821d admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:38.907472 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df316096-02c5-4701-8eda-43f5fbed821d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:38.907737 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df316096-02c5-4701-8eda-43f5fbed821d admin admin] PATH_INFO: `/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/6522d231532a48ad8dbc9c9e79a021dd/roles/b8f12ed3613649e2bd643eca3c00d034` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:38.910149 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df316096-02c5-4701-8eda-43f5fbed821d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4d0b5a3f7d4542a47a26e623500b4f, user_id=6522d231532a48ad8dbc9c9e79a021dd, role_id=b8f12ed3613649e2bd643eca3c00d034)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:38.912789 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df316096-02c5-4701-8eda-43f5fbed821d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:39.136901 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 535/1067] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:21:38 2022] PUT /identity/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/6522d231532a48ad8dbc9c9e79a021dd/roles/b8f12ed3613649e2bd643eca3c00d034 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:21:39.591540 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff595c46-bf94-4962-9b95-c3e4b68b1b5d None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:39.592087 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff595c46-bf94-4962-9b95-c3e4b68b1b5d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:39.592087 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff595c46-bf94-4962-9b95-c3e4b68b1b5d None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:39.593870 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 533/1068] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:39.599085 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084077d-8731-4b89-ae19-8868ce65aa22 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:39.599491 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084077d-8731-4b89-ae19-8868ce65aa22 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:39.599629 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084077d-8731-4b89-ae19-8868ce65aa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:39.617184 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-6084077d-8731-4b89-ae19-8868ce65aa22 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:39.618390 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6084077d-8731-4b89-ae19-8868ce65aa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:39.674700 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 536/1069] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:39 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:39.699299 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff595c46-bf94-4962-9b95-c3e4b68b1b5d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:39.711179 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff595c46-bf94-4962-9b95-c3e4b68b1b5d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:39.715523 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c91f80-0d64-4513-8d3f-0cb75921711e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:39.716289 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c91f80-0d64-4513-8d3f-0cb75921711e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:39.716564 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c91f80-0d64-4513-8d3f-0cb75921711e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:39.716831 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c91f80-0d64-4513-8d3f-0cb75921711e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:39.726938 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c91f80-0d64-4513-8d3f-0cb75921711e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:21:39.733567 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-18c91f80-0d64-4513-8d3f-0cb75921711e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:21:39.734902 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 534/1070] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:21:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:39.740692 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084077d-8731-4b89-ae19-8868ce65aa22 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:39.750129 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084077d-8731-4b89-ae19-8868ce65aa22 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:39.754603 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d6ba5-812e-4f8d-8fa6-f5c055ca6079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:39.755248 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d6ba5-812e-4f8d-8fa6-f5c055ca6079 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:39.755529 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d6ba5-812e-4f8d-8fa6-f5c055ca6079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:39.755802 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d6ba5-812e-4f8d-8fa6-f5c055ca6079 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:39.756541 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d6ba5-812e-4f8d-8fa6-f5c055ca6079 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:39.756847 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d6ba5-812e-4f8d-8fa6-f5c055ca6079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:39.758626 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d6ba5-812e-4f8d-8fa6-f5c055ca6079 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:39.767307 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 537/1071] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:21:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:39.772808 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c91f80-0d64-4513-8d3f-0cb75921711e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:39.783402 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c91f80-0d64-4513-8d3f-0cb75921711e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:39.787863 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22333655-55d0-4b3b-883e-3160259609e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:39.788687 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22333655-55d0-4b3b-883e-3160259609e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:39.788962 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22333655-55d0-4b3b-883e-3160259609e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:39.789227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22333655-55d0-4b3b-883e-3160259609e7 admin admin] PATH_INFO: `/v3/users/02c01a3c127b4ec7bea1a07fd88df0b5` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:39.802420 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22333655-55d0-4b3b-883e-3160259609e7 admin admin] RBAC: Authorizing `identity:get_user(user_id=02c01a3c127b4ec7bea1a07fd88df0b5)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:39.804552 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22333655-55d0-4b3b-883e-3160259609e7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:39.806612 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 535/1072] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:21:39 2022] GET /identity/v3/users/02c01a3c127b4ec7bea1a07fd88df0b5 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:39.817590 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d6ba5-812e-4f8d-8fa6-f5c055ca6079 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:39.830760 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d6ba5-812e-4f8d-8fa6-f5c055ca6079 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:39.835352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c77a2-166b-4110-8fda-4529431cb94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:39.835983 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c77a2-166b-4110-8fda-4529431cb94d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:39.836263 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c77a2-166b-4110-8fda-4529431cb94d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:39.836537 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c77a2-166b-4110-8fda-4529431cb94d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:39.844884 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c77a2-166b-4110-8fda-4529431cb94d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:39.846625 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c77a2-166b-4110-8fda-4529431cb94d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:39.855324 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 538/1073] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:21:39 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:21:39.861355 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22333655-55d0-4b3b-883e-3160259609e7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:39.870989 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22333655-55d0-4b3b-883e-3160259609e7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:39.875483 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a5b8b-0125-4fe0-9034-5e19c47cd4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:39.876309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a5b8b-0125-4fe0-9034-5e19c47cd4dd admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:39.876584 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a5b8b-0125-4fe0-9034-5e19c47cd4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:39.876850 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a5b8b-0125-4fe0-9034-5e19c47cd4dd admin admin] PATH_INFO: `/v3/projects/c9dd9d870cf64fb89ba8244fd967c258` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:39.878029 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a5b8b-0125-4fe0-9034-5e19c47cd4dd admin admin] RBAC: Authorizing `identity:get_project(project_id=c9dd9d870cf64fb89ba8244fd967c258)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:39.880080 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a5b8b-0125-4fe0-9034-5e19c47cd4dd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:39.881738 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 536/1074] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:21:39 2022] GET /identity/v3/projects/c9dd9d870cf64fb89ba8244fd967c258 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:39.888374 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c77a2-166b-4110-8fda-4529431cb94d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:39.897355 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c77a2-166b-4110-8fda-4529431cb94d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:39.902538 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf42d4-b10e-49b8-a3f9-019f72670bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:39.903162 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf42d4-b10e-49b8-a3f9-019f72670bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:39.903440 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf42d4-b10e-49b8-a3f9-019f72670bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:39.903711 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf42d4-b10e-49b8-a3f9-019f72670bc4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:39.904532 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf42d4-b10e-49b8-a3f9-019f72670bc4 admin admin] RBAC: Adding query filter params (role.id=9ba4a5967ed243178927661616f08901, scope.project.id=c9dd9d870cf64fb89ba8244fd967c258, user.id=02c01a3c127b4ec7bea1a07fd88df0b5) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:39.904840 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf42d4-b10e-49b8-a3f9-019f72670bc4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:39.906719 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf42d4-b10e-49b8-a3f9-019f72670bc4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:39.912084 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 539/1075] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:21:39 2022] GET /identity/v3/role_assignments?user.id=02c01a3c127b4ec7bea1a07fd88df0b5&scope.project.id=c9dd9d870cf64fb89ba8244fd967c258&role.id=9ba4a5967ed243178927661616f08901 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:41.465466 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1b153-dd92-449f-9e3d-c7dafe1fb3e1 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:41.465984 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1b153-dd92-449f-9e3d-c7dafe1fb3e1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:41.466097 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1b153-dd92-449f-9e3d-c7dafe1fb3e1 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:41.467760 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 537/1076] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:41.473074 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a9e4f-8cfe-4970-8ac3-0b0bf0d4311e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:41.473486 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a9e4f-8cfe-4970-8ac3-0b0bf0d4311e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:41.473661 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a9e4f-8cfe-4970-8ac3-0b0bf0d4311e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:41.491598 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-1e4a9e4f-8cfe-4970-8ac3-0b0bf0d4311e None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:41.492789 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1e4a9e4f-8cfe-4970-8ac3-0b0bf0d4311e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:41.500943 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 540/1077] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:41 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:41.524554 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1b153-dd92-449f-9e3d-c7dafe1fb3e1 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:41.536478 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1b153-dd92-449f-9e3d-c7dafe1fb3e1 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:41.540751 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f205fc-8bb6-4c36-8558-2d3ec30e8c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:41.542082 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f205fc-8bb6-4c36-8558-2d3ec30e8c6d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:41.542359 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f205fc-8bb6-4c36-8558-2d3ec30e8c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:41.542629 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f205fc-8bb6-4c36-8558-2d3ec30e8c6d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:41.552577 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f205fc-8bb6-4c36-8558-2d3ec30e8c6d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:21:41.560688 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-73f205fc-8bb6-4c36-8558-2d3ec30e8c6d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 16 05:21:41.562003 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 538/1078] 10.222.0.75 () {56 vars in 1141 bytes} [Wed Feb 16 05:21:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:41.567591 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a9e4f-8cfe-4970-8ac3-0b0bf0d4311e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:41.576329 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a9e4f-8cfe-4970-8ac3-0b0bf0d4311e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:41.580671 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3301491-f9e8-4622-8b35-2bd79fc2cc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:41.581397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3301491-f9e8-4622-8b35-2bd79fc2cc86 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:41.581675 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3301491-f9e8-4622-8b35-2bd79fc2cc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:41.581942 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3301491-f9e8-4622-8b35-2bd79fc2cc86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:41.582678 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3301491-f9e8-4622-8b35-2bd79fc2cc86 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:41.582976 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3301491-f9e8-4622-8b35-2bd79fc2cc86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:41.584591 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3301491-f9e8-4622-8b35-2bd79fc2cc86 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:41.592355 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 541/1079] 10.222.0.75 () {56 vars in 1136 bytes} [Wed Feb 16 05:21:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:41.597787 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f205fc-8bb6-4c36-8558-2d3ec30e8c6d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:41.608604 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f205fc-8bb6-4c36-8558-2d3ec30e8c6d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:41.613249 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910197d1-9069-4514-aace-54d0ea0ae1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:41.614025 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910197d1-9069-4514-aace-54d0ea0ae1fd admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:41.614296 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910197d1-9069-4514-aace-54d0ea0ae1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:41.614561 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910197d1-9069-4514-aace-54d0ea0ae1fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:41.625190 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910197d1-9069-4514-aace-54d0ea0ae1fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:41.627045 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910197d1-9069-4514-aace-54d0ea0ae1fd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:41.643686 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-910197d1-9069-4514-aace-54d0ea0ae1fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:41.645028 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 539/1080] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:21:41.650458 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3301491-f9e8-4622-8b35-2bd79fc2cc86 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:41.660398 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3301491-f9e8-4622-8b35-2bd79fc2cc86 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:41.664799 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef17d81-7728-4d8a-9b3d-e94f2431c1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:41.665461 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef17d81-7728-4d8a-9b3d-e94f2431c1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:41.668794 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef17d81-7728-4d8a-9b3d-e94f2431c1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:41.668794 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef17d81-7728-4d8a-9b3d-e94f2431c1e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:41.668794 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef17d81-7728-4d8a-9b3d-e94f2431c1e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:41.668794 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef17d81-7728-4d8a-9b3d-e94f2431c1e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:41.669104 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef17d81-7728-4d8a-9b3d-e94f2431c1e5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:41.681105 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 542/1081] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:41.687610 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910197d1-9069-4514-aace-54d0ea0ae1fd admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:41.701187 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910197d1-9069-4514-aace-54d0ea0ae1fd admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:41.705650 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b13528-b6d1-4aae-b170-b9b97019cd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:41.706416 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b13528-b6d1-4aae-b170-b9b97019cd37 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:41.706687 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b13528-b6d1-4aae-b170-b9b97019cd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:41.706949 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b13528-b6d1-4aae-b170-b9b97019cd37 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:41.714785 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b13528-b6d1-4aae-b170-b9b97019cd37 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:41.716874 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b13528-b6d1-4aae-b170-b9b97019cd37 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:41.730890 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-e0b13528-b6d1-4aae-b170-b9b97019cd37 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 16 05:21:41.732022 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 540/1082] 10.222.0.75 () {56 vars in 1114 bytes} [Wed Feb 16 05:21:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:41.737700 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef17d81-7728-4d8a-9b3d-e94f2431c1e5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:41.747882 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef17d81-7728-4d8a-9b3d-e94f2431c1e5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:41.752374 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec4054-f746-4613-b4c3-be804cffd803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:41.753015 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec4054-f746-4613-b4c3-be804cffd803 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:41.753312 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec4054-f746-4613-b4c3-be804cffd803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:41.753591 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec4054-f746-4613-b4c3-be804cffd803 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:41.754409 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec4054-f746-4613-b4c3-be804cffd803 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:41.754707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec4054-f746-4613-b4c3-be804cffd803 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:41.756535 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec4054-f746-4613-b4c3-be804cffd803 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:41.774537 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 543/1083] 10.222.0.75 () {56 vars in 1154 bytes} [Wed Feb 16 05:21:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:41.780083 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b13528-b6d1-4aae-b170-b9b97019cd37 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:41.789641 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b13528-b6d1-4aae-b170-b9b97019cd37 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:41.794152 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efceb840-f383-4b01-ac0c-07e928243c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:41.794788 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efceb840-f383-4b01-ac0c-07e928243c9f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:41.795057 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efceb840-f383-4b01-ac0c-07e928243c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:41.795329 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efceb840-f383-4b01-ac0c-07e928243c9f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:41.803372 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efceb840-f383-4b01-ac0c-07e928243c9f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:41.805130 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efceb840-f383-4b01-ac0c-07e928243c9f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:41.814585 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 541/1084] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:21:41 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:21:41.820309 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec4054-f746-4613-b4c3-be804cffd803 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:41.830365 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec4054-f746-4613-b4c3-be804cffd803 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:41.834919 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b90ef1-079e-44c5-a90e-02eee8b7f459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:41.835693 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b90ef1-079e-44c5-a90e-02eee8b7f459 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:41.835969 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b90ef1-079e-44c5-a90e-02eee8b7f459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:41.836239 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b90ef1-079e-44c5-a90e-02eee8b7f459 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:41.846433 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b90ef1-079e-44c5-a90e-02eee8b7f459 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:41.848303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b90ef1-079e-44c5-a90e-02eee8b7f459 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:41.866345 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-33b90ef1-079e-44c5-a90e-02eee8b7f459 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:21:41.867627 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 544/1085] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:41.874208 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efceb840-f383-4b01-ac0c-07e928243c9f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:41.883361 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efceb840-f383-4b01-ac0c-07e928243c9f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:41.888404 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b3be0-8210-4d21-90a8-53bf8c0e4ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:41.889046 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b3be0-8210-4d21-90a8-53bf8c0e4ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:41.889350 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b3be0-8210-4d21-90a8-53bf8c0e4ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:41.889620 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b3be0-8210-4d21-90a8-53bf8c0e4ee4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:41.890328 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b3be0-8210-4d21-90a8-53bf8c0e4ee4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:41.890628 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b3be0-8210-4d21-90a8-53bf8c0e4ee4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:41.892218 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b3be0-8210-4d21-90a8-53bf8c0e4ee4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:41.903613 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 542/1086] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:41.909245 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b90ef1-079e-44c5-a90e-02eee8b7f459 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:41.918935 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b90ef1-079e-44c5-a90e-02eee8b7f459 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:41.923353 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8213c-2d26-454d-bec8-67bdbfc44846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:41.924115 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8213c-2d26-454d-bec8-67bdbfc44846 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:41.924395 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8213c-2d26-454d-bec8-67bdbfc44846 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:41.924663 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8213c-2d26-454d-bec8-67bdbfc44846 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:41.931669 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8213c-2d26-454d-bec8-67bdbfc44846 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:41.934183 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8213c-2d26-454d-bec8-67bdbfc44846 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:41.946717 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-31a8213c-2d26-454d-bec8-67bdbfc44846 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:21:41.948558 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 545/1087] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:21:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:41.954244 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b3be0-8210-4d21-90a8-53bf8c0e4ee4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:41.964219 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b3be0-8210-4d21-90a8-53bf8c0e4ee4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:41.968695 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8288d5-f171-42a5-ac02-d81d0bbc08bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:41.969314 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8288d5-f171-42a5-ac02-d81d0bbc08bd admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:41.969594 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8288d5-f171-42a5-ac02-d81d0bbc08bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:41.969862 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8288d5-f171-42a5-ac02-d81d0bbc08bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:41.970638 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8288d5-f171-42a5-ac02-d81d0bbc08bd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:41.970939 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8288d5-f171-42a5-ac02-d81d0bbc08bd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:41.972777 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8288d5-f171-42a5-ac02-d81d0bbc08bd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:41.985474 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 543/1088] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:21:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:41.991327 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8213c-2d26-454d-bec8-67bdbfc44846 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:42.001396 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8213c-2d26-454d-bec8-67bdbfc44846 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:42.006127 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1ab6d-cab2-4ca9-984d-ed9f0aa449c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:42.006807 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1ab6d-cab2-4ca9-984d-ed9f0aa449c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:42.007143 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1ab6d-cab2-4ca9-984d-ed9f0aa449c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:42.007415 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1ab6d-cab2-4ca9-984d-ed9f0aa449c7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:42.008351 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1ab6d-cab2-4ca9-984d-ed9f0aa449c7 admin admin] RBAC: Adding query filter params (role.id=b8f12ed3613649e2bd643eca3c00d034, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=6522d231532a48ad8dbc9c9e79a021dd) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:42.008709 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1ab6d-cab2-4ca9-984d-ed9f0aa449c7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:42.010812 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1ab6d-cab2-4ca9-984d-ed9f0aa449c7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:42.017543 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 546/1089] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:21:41 2022] GET /identity/v3/role_assignments?user.id=6522d231532a48ad8dbc9c9e79a021dd&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=b8f12ed3613649e2bd643eca3c00d034 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:42.224745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa2f1d-bdcc-43f8-9d91-e6078209e411 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:42.225024 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa2f1d-bdcc-43f8-9d91-e6078209e411 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:42.225382 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa2f1d-bdcc-43f8-9d91-e6078209e411 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:42.227716 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 544/1090] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:42.236452 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9688fa-47b6-41f9-8fd0-7b0438e56ae4 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:42.236796 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9688fa-47b6-41f9-8fd0-7b0438e56ae4 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:42.237090 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9688fa-47b6-41f9-8fd0-7b0438e56ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:42.255109 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-af9688fa-47b6-41f9-8fd0-7b0438e56ae4 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:42.256304 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-af9688fa-47b6-41f9-8fd0-7b0438e56ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:42.264695 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 547/1091] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:42 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:21:42.288609 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa2f1d-bdcc-43f8-9d91-e6078209e411 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:42.301594 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa2f1d-bdcc-43f8-9d91-e6078209e411 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:42.306257 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37eb6e3-fc0e-4eb7-a346-35b3974e6336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:42.307051 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37eb6e3-fc0e-4eb7-a346-35b3974e6336 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:42.307852 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37eb6e3-fc0e-4eb7-a346-35b3974e6336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:42.308125 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37eb6e3-fc0e-4eb7-a346-35b3974e6336 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:42.318530 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37eb6e3-fc0e-4eb7-a346-35b3974e6336 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:21:42.325330 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-d37eb6e3-fc0e-4eb7-a346-35b3974e6336 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:21:42.326511 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 545/1092] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:21:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:42.332510 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9688fa-47b6-41f9-8fd0-7b0438e56ae4 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:42.341530 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9688fa-47b6-41f9-8fd0-7b0438e56ae4 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:42.346154 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923724ec-dd60-4784-ae5c-9be7e3da4db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:42.346806 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923724ec-dd60-4784-ae5c-9be7e3da4db5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:42.347089 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923724ec-dd60-4784-ae5c-9be7e3da4db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:42.347361 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923724ec-dd60-4784-ae5c-9be7e3da4db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:42.348107 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923724ec-dd60-4784-ae5c-9be7e3da4db5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:42.348411 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923724ec-dd60-4784-ae5c-9be7e3da4db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:42.350047 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923724ec-dd60-4784-ae5c-9be7e3da4db5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:42.359237 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 548/1093] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:21:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:42.365407 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37eb6e3-fc0e-4eb7-a346-35b3974e6336 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:42.376544 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37eb6e3-fc0e-4eb7-a346-35b3974e6336 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:42.381177 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcf291-2938-4c0f-879b-145db92dda52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:42.382050 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcf291-2938-4c0f-879b-145db92dda52 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:42.382329 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcf291-2938-4c0f-879b-145db92dda52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:42.382604 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcf291-2938-4c0f-879b-145db92dda52 admin admin] PATH_INFO: `/v3/users/02c01a3c127b4ec7bea1a07fd88df0b5` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:42.383807 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcf291-2938-4c0f-879b-145db92dda52 admin admin] RBAC: Authorizing `identity:get_user(user_id=02c01a3c127b4ec7bea1a07fd88df0b5)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:42.386499 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcf291-2938-4c0f-879b-145db92dda52 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:42.388081 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 546/1094] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:21:42 2022] GET /identity/v3/users/02c01a3c127b4ec7bea1a07fd88df0b5 => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:42.393909 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923724ec-dd60-4784-ae5c-9be7e3da4db5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:42.404532 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923724ec-dd60-4784-ae5c-9be7e3da4db5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:42.410042 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a999ef-5965-4ac0-b832-e70d981f5914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:42.410880 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a999ef-5965-4ac0-b832-e70d981f5914 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:42.411155 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a999ef-5965-4ac0-b832-e70d981f5914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:42.411424 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a999ef-5965-4ac0-b832-e70d981f5914 admin admin] PATH_INFO: `/v3/projects/c9dd9d870cf64fb89ba8244fd967c258` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:42.412589 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a999ef-5965-4ac0-b832-e70d981f5914 admin admin] RBAC: Authorizing `identity:get_project(project_id=c9dd9d870cf64fb89ba8244fd967c258)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:42.414704 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a999ef-5965-4ac0-b832-e70d981f5914 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:42.417039 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 549/1095] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:21:42 2022] GET /identity/v3/projects/c9dd9d870cf64fb89ba8244fd967c258 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:42.422959 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcf291-2938-4c0f-879b-145db92dda52 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:42.433629 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcf291-2938-4c0f-879b-145db92dda52 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:42.438733 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d887165-28be-4251-9260-b62abe428532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:42.439603 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d887165-28be-4251-9260-b62abe428532 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:42.439876 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d887165-28be-4251-9260-b62abe428532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:42.440144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d887165-28be-4251-9260-b62abe428532 admin admin] PATH_INFO: `/v3/projects/c9dd9d870cf64fb89ba8244fd967c258/users/02c01a3c127b4ec7bea1a07fd88df0b5/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:42.442169 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d887165-28be-4251-9260-b62abe428532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9dd9d870cf64fb89ba8244fd967c258, user_id=02c01a3c127b4ec7bea1a07fd88df0b5, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:42.444812 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d887165-28be-4251-9260-b62abe428532 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:42.458001 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 547/1096] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:21:42 2022] PUT /identity/v3/projects/c9dd9d870cf64fb89ba8244fd967c258/users/02c01a3c127b4ec7bea1a07fd88df0b5/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:21:44.751183 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98caa778-5ff0-4059-9b7a-d0b7bff45b52 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:44.751690 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98caa778-5ff0-4059-9b7a-d0b7bff45b52 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:44.751795 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98caa778-5ff0-4059-9b7a-d0b7bff45b52 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:44.753562 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 550/1097] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:44.758588 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7d991-d8ea-4711-9d5f-0553aa69ee8f None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:44.758979 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7d991-d8ea-4711-9d5f-0553aa69ee8f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:44.759132 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7d991-d8ea-4711-9d5f-0553aa69ee8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:44.777026 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c5d7d991-d8ea-4711-9d5f-0553aa69ee8f None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:44.778225 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c5d7d991-d8ea-4711-9d5f-0553aa69ee8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:44.832235 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 548/1098] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:44 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:44.857750 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98caa778-5ff0-4059-9b7a-d0b7bff45b52 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:44.870256 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98caa778-5ff0-4059-9b7a-d0b7bff45b52 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:44.874595 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b1370-6ac1-40dd-a8c7-a00f2023ab6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:44.875349 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b1370-6ac1-40dd-a8c7-a00f2023ab6c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:44.875626 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b1370-6ac1-40dd-a8c7-a00f2023ab6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:44.875894 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b1370-6ac1-40dd-a8c7-a00f2023ab6c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:44.886346 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b1370-6ac1-40dd-a8c7-a00f2023ab6c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:21:44.893049 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-6f2b1370-6ac1-40dd-a8c7-a00f2023ab6c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:21:44.894189 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 551/1099] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:21:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:21:44.899707 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7d991-d8ea-4711-9d5f-0553aa69ee8f None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:44.908376 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7d991-d8ea-4711-9d5f-0553aa69ee8f None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:44.912782 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f224130-58fe-488e-88cf-f9221366e0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:44.913448 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f224130-58fe-488e-88cf-f9221366e0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:44.913724 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f224130-58fe-488e-88cf-f9221366e0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:44.913998 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f224130-58fe-488e-88cf-f9221366e0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:44.914722 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f224130-58fe-488e-88cf-f9221366e0b6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:44.915019 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f224130-58fe-488e-88cf-f9221366e0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:44.916659 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f224130-58fe-488e-88cf-f9221366e0b6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:44.924593 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 549/1100] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:21:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:44.929943 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b1370-6ac1-40dd-a8c7-a00f2023ab6c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:44.941441 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b1370-6ac1-40dd-a8c7-a00f2023ab6c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:44.945937 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2317a70-aec3-4a6d-9161-27a548bc8676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:44.946747 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2317a70-aec3-4a6d-9161-27a548bc8676 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:44.947025 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2317a70-aec3-4a6d-9161-27a548bc8676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:44.947290 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2317a70-aec3-4a6d-9161-27a548bc8676 admin admin] PATH_INFO: `/v3/users/02c01a3c127b4ec7bea1a07fd88df0b5` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:44.949065 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2317a70-aec3-4a6d-9161-27a548bc8676 admin admin] RBAC: Authorizing `identity:get_user(user_id=02c01a3c127b4ec7bea1a07fd88df0b5)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:44.951207 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2317a70-aec3-4a6d-9161-27a548bc8676 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:44.952871 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 552/1101] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:21:44 2022] GET /identity/v3/users/02c01a3c127b4ec7bea1a07fd88df0b5 => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:44.958123 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f224130-58fe-488e-88cf-f9221366e0b6 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:44.967416 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f224130-58fe-488e-88cf-f9221366e0b6 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:44.971938 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc916a-7250-4d97-9993-7a1ba1abbc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:44.972543 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc916a-7250-4d97-9993-7a1ba1abbc23 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:44.972823 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc916a-7250-4d97-9993-7a1ba1abbc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:44.973097 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc916a-7250-4d97-9993-7a1ba1abbc23 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:44.980673 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc916a-7250-4d97-9993-7a1ba1abbc23 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:44.982442 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc916a-7250-4d97-9993-7a1ba1abbc23 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:44.991104 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 550/1102] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:21:44 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:21:44.996879 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2317a70-aec3-4a6d-9161-27a548bc8676 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:45.006140 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2317a70-aec3-4a6d-9161-27a548bc8676 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:45.011119 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86238c03-ba05-4a95-96c5-0077e9bdc00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:45.011911 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86238c03-ba05-4a95-96c5-0077e9bdc00e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:45.012193 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86238c03-ba05-4a95-96c5-0077e9bdc00e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:45.012460 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86238c03-ba05-4a95-96c5-0077e9bdc00e admin admin] PATH_INFO: `/v3/projects/c9dd9d870cf64fb89ba8244fd967c258` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:45.013638 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86238c03-ba05-4a95-96c5-0077e9bdc00e admin admin] RBAC: Authorizing `identity:get_project(project_id=c9dd9d870cf64fb89ba8244fd967c258)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:45.015656 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86238c03-ba05-4a95-96c5-0077e9bdc00e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:45.017237 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 553/1103] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:21:44 2022] GET /identity/v3/projects/c9dd9d870cf64fb89ba8244fd967c258 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:45.022601 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc916a-7250-4d97-9993-7a1ba1abbc23 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:45.031550 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc916a-7250-4d97-9993-7a1ba1abbc23 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:45.035989 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9b0e0-6b70-472d-af71-723e149c464c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:45.036585 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9b0e0-6b70-472d-af71-723e149c464c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:45.036865 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9b0e0-6b70-472d-af71-723e149c464c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:45.037139 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9b0e0-6b70-472d-af71-723e149c464c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:45.037981 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9b0e0-6b70-472d-af71-723e149c464c admin admin] RBAC: Adding query filter params (role.id=9ba4a5967ed243178927661616f08901, scope.project.id=c9dd9d870cf64fb89ba8244fd967c258, user.id=02c01a3c127b4ec7bea1a07fd88df0b5) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:45.038289 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9b0e0-6b70-472d-af71-723e149c464c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:45.040087 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9b0e0-6b70-472d-af71-723e149c464c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:45.046380 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 551/1104] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:21:45 2022] GET /identity/v3/role_assignments?user.id=02c01a3c127b4ec7bea1a07fd88df0b5&scope.project.id=c9dd9d870cf64fb89ba8244fd967c258&role.id=9ba4a5967ed243178927661616f08901 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:47.357785 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa5874-0ff0-4cf8-a46b-e1630d597709 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:47.358311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa5874-0ff0-4cf8-a46b-e1630d597709 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:47.358311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa5874-0ff0-4cf8-a46b-e1630d597709 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:47.360099 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 554/1105] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:47.365319 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4870024-26c5-4bf4-ab10-0fe2fb96493e None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:47.365704 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4870024-26c5-4bf4-ab10-0fe2fb96493e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:47.365868 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4870024-26c5-4bf4-ab10-0fe2fb96493e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:47.383691 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f4870024-26c5-4bf4-ab10-0fe2fb96493e None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:47.384880 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f4870024-26c5-4bf4-ab10-0fe2fb96493e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:47.392849 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 552/1106] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:47 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:47.417692 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa5874-0ff0-4cf8-a46b-e1630d597709 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:47.429652 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa5874-0ff0-4cf8-a46b-e1630d597709 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:47.434256 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0e20d-bcf2-42b7-9462-7e1222ce505d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:47.435035 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0e20d-bcf2-42b7-9462-7e1222ce505d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:47.435313 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0e20d-bcf2-42b7-9462-7e1222ce505d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:47.435583 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0e20d-bcf2-42b7-9462-7e1222ce505d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:47.436723 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0e20d-bcf2-42b7-9462-7e1222ce505d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:47.438433 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0e20d-bcf2-42b7-9462-7e1222ce505d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:47.439968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 555/1107] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:47.444936 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4870024-26c5-4bf4-ab10-0fe2fb96493e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:47.454039 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4870024-26c5-4bf4-ab10-0fe2fb96493e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:47.458476 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453800fd-3023-41aa-b512-1be305ab6734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:47.459118 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453800fd-3023-41aa-b512-1be305ab6734 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:47.459391 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453800fd-3023-41aa-b512-1be305ab6734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:47.459658 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453800fd-3023-41aa-b512-1be305ab6734 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:47.460340 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453800fd-3023-41aa-b512-1be305ab6734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:47.462267 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453800fd-3023-41aa-b512-1be305ab6734 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:47.480661 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 553/1108] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Feb 16 05:21:47 2022] POST /identity/v3/users => generated 286 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:21:49.862528 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c16ca-5a5f-4399-9898-532cda1f592e None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:49.863068 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c16ca-5a5f-4399-9898-532cda1f592e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:49.863068 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c16ca-5a5f-4399-9898-532cda1f592e None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:49.864844 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 556/1109] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:49.870146 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419a974-292e-4760-825b-dc256ec74869 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:49.870676 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419a974-292e-4760-825b-dc256ec74869 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:49.870676 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419a974-292e-4760-825b-dc256ec74869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:49.888427 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-6419a974-292e-4760-825b-dc256ec74869 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:49.889635 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6419a974-292e-4760-825b-dc256ec74869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:49.897239 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 554/1110] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:49 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:49.922195 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c16ca-5a5f-4399-9898-532cda1f592e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:49.934942 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c16ca-5a5f-4399-9898-532cda1f592e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:49.939306 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f7033-3b1a-4820-a2e0-c9a4b0a0e03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:49.940132 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f7033-3b1a-4820-a2e0-c9a4b0a0e03e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:49.940409 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f7033-3b1a-4820-a2e0-c9a4b0a0e03e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:49.940680 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f7033-3b1a-4820-a2e0-c9a4b0a0e03e admin admin] PATH_INFO: `/v3/roles/997c650af0d54f31940fbb188fe4172c` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:49.942164 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f7033-3b1a-4820-a2e0-c9a4b0a0e03e admin admin] RBAC: Authorizing `identity:get_role(role_id=997c650af0d54f31940fbb188fe4172c)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:49.943168 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-ae4f7033-3b1a-4820-a2e0-c9a4b0a0e03e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:21:49.943168 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Feb 16 05:21:49.943168 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: Feb 16 05:21:49.944038 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f7033-3b1a-4820-a2e0-c9a4b0a0e03e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:49.945352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 557/1111] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:21:49 2022] GET /identity/v3/roles/997c650af0d54f31940fbb188fe4172c => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:21:49.950970 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419a974-292e-4760-825b-dc256ec74869 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:49.959615 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419a974-292e-4760-825b-dc256ec74869 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:49.964739 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cb70c-41a9-4523-8885-e0d55ce3bc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:49.965602 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cb70c-41a9-4523-8885-e0d55ce3bc39 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:49.965881 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cb70c-41a9-4523-8885-e0d55ce3bc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:49.966153 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cb70c-41a9-4523-8885-e0d55ce3bc39 admin admin] PATH_INFO: `/v3/users/dd225023d8624226abb6bfa8686ad476` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:49.979006 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cb70c-41a9-4523-8885-e0d55ce3bc39 admin admin] RBAC: Authorizing `identity:get_user(user_id=dd225023d8624226abb6bfa8686ad476)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:49.981131 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cb70c-41a9-4523-8885-e0d55ce3bc39 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:49.982730 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 555/1112] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:21:49 2022] GET /identity/v3/users/dd225023d8624226abb6bfa8686ad476 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:49.988001 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f7033-3b1a-4820-a2e0-c9a4b0a0e03e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:49.997786 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f7033-3b1a-4820-a2e0-c9a4b0a0e03e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:50.002224 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea8489-85ae-4672-bac1-ce983dcde10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:50.002831 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea8489-85ae-4672-bac1-ce983dcde10c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:50.003115 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea8489-85ae-4672-bac1-ce983dcde10c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:50.003389 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea8489-85ae-4672-bac1-ce983dcde10c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:50.011560 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea8489-85ae-4672-bac1-ce983dcde10c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:50.013285 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea8489-85ae-4672-bac1-ce983dcde10c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:50.022029 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 558/1113] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:21:49 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:21:50.027783 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cb70c-41a9-4523-8885-e0d55ce3bc39 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:50.037013 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cb70c-41a9-4523-8885-e0d55ce3bc39 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:50.042044 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb34e5-e021-40c5-9c00-94f572290315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:50.042840 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb34e5-e021-40c5-9c00-94f572290315 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:50.043122 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb34e5-e021-40c5-9c00-94f572290315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:50.043389 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb34e5-e021-40c5-9c00-94f572290315 admin admin] PATH_INFO: `/v3/projects/c9dd9d870cf64fb89ba8244fd967c258` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:50.044539 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb34e5-e021-40c5-9c00-94f572290315 admin admin] RBAC: Authorizing `identity:get_project(project_id=c9dd9d870cf64fb89ba8244fd967c258)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:50.046586 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb34e5-e021-40c5-9c00-94f572290315 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:50.048167 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 556/1114] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:21:50 2022] GET /identity/v3/projects/c9dd9d870cf64fb89ba8244fd967c258 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:50.053538 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea8489-85ae-4672-bac1-ce983dcde10c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:50.062646 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea8489-85ae-4672-bac1-ce983dcde10c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:50.067198 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3b43f3-cbad-4a69-8851-b7b53072484e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:50.067792 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b43f3-cbad-4a69-8851-b7b53072484e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:50.068072 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b43f3-cbad-4a69-8851-b7b53072484e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:50.068346 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3b43f3-cbad-4a69-8851-b7b53072484e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:50.069145 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b43f3-cbad-4a69-8851-b7b53072484e admin admin] RBAC: Adding query filter params (role.id=997c650af0d54f31940fbb188fe4172c, scope.project.id=c9dd9d870cf64fb89ba8244fd967c258, user.id=dd225023d8624226abb6bfa8686ad476) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:50.069489 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b43f3-cbad-4a69-8851-b7b53072484e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:50.071276 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3b43f3-cbad-4a69-8851-b7b53072484e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:50.077005 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 559/1115] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:21:50 2022] GET /identity/v3/role_assignments?user.id=dd225023d8624226abb6bfa8686ad476&scope.project.id=c9dd9d870cf64fb89ba8244fd967c258&role.id=997c650af0d54f31940fbb188fe4172c => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:52.315954 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e7151-67b7-4fe4-b30e-4bad967cce54 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:52.316499 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e7151-67b7-4fe4-b30e-4bad967cce54 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:52.316499 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e7151-67b7-4fe4-b30e-4bad967cce54 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:52.318291 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 557/1116] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:52.323969 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a4618-97df-42c9-ad8e-b7e02ea69ecd None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:52.324387 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a4618-97df-42c9-ad8e-b7e02ea69ecd None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:52.324517 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a4618-97df-42c9-ad8e-b7e02ea69ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:52.341745 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-cc3a4618-97df-42c9-ad8e-b7e02ea69ecd None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:52.343033 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cc3a4618-97df-42c9-ad8e-b7e02ea69ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:52.350567 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 560/1117] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:52 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:52.373167 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e7151-67b7-4fe4-b30e-4bad967cce54 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:52.385808 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e7151-67b7-4fe4-b30e-4bad967cce54 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:52.390125 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa16fb-445d-4a6d-a478-ba72c9d37703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:52.390930 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa16fb-445d-4a6d-a478-ba72c9d37703 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:52.391202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa16fb-445d-4a6d-a478-ba72c9d37703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:52.391463 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa16fb-445d-4a6d-a478-ba72c9d37703 admin admin] PATH_INFO: `/v3/roles/997c650af0d54f31940fbb188fe4172c` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:52.392908 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa16fb-445d-4a6d-a478-ba72c9d37703 admin admin] RBAC: Authorizing `identity:get_role(role_id=997c650af0d54f31940fbb188fe4172c)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:52.393958 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-22fa16fb-445d-4a6d-a478-ba72c9d37703 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:21:52.393958 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Feb 16 05:21:52.393958 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: Feb 16 05:21:52.394824 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa16fb-445d-4a6d-a478-ba72c9d37703 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:52.396115 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 558/1118] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:21:52 2022] GET /identity/v3/roles/997c650af0d54f31940fbb188fe4172c => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:52.401689 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a4618-97df-42c9-ad8e-b7e02ea69ecd None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:52.410422 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a4618-97df-42c9-ad8e-b7e02ea69ecd None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:52.414882 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680d0d0-7d1c-4f39-b118-0bf7333c02ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:52.415712 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680d0d0-7d1c-4f39-b118-0bf7333c02ca admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:52.415989 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680d0d0-7d1c-4f39-b118-0bf7333c02ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:52.416260 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680d0d0-7d1c-4f39-b118-0bf7333c02ca admin admin] PATH_INFO: `/v3/users/dd225023d8624226abb6bfa8686ad476` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:52.417459 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680d0d0-7d1c-4f39-b118-0bf7333c02ca admin admin] RBAC: Authorizing `identity:get_user(user_id=dd225023d8624226abb6bfa8686ad476)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:52.419554 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680d0d0-7d1c-4f39-b118-0bf7333c02ca admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:52.421089 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 561/1119] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:21:52 2022] GET /identity/v3/users/dd225023d8624226abb6bfa8686ad476 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:52.426248 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa16fb-445d-4a6d-a478-ba72c9d37703 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:52.436174 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa16fb-445d-4a6d-a478-ba72c9d37703 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:52.440573 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9626f4-a70b-4cb4-85ba-61e8e5ca82c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:52.441392 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9626f4-a70b-4cb4-85ba-61e8e5ca82c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:52.441667 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9626f4-a70b-4cb4-85ba-61e8e5ca82c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:52.441933 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9626f4-a70b-4cb4-85ba-61e8e5ca82c9 admin admin] PATH_INFO: `/v3/projects/c9dd9d870cf64fb89ba8244fd967c258` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:52.443065 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9626f4-a70b-4cb4-85ba-61e8e5ca82c9 admin admin] RBAC: Authorizing `identity:get_project(project_id=c9dd9d870cf64fb89ba8244fd967c258)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:52.445058 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9626f4-a70b-4cb4-85ba-61e8e5ca82c9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:52.446652 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 559/1120] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:21:52 2022] GET /identity/v3/projects/c9dd9d870cf64fb89ba8244fd967c258 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:52.452562 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680d0d0-7d1c-4f39-b118-0bf7333c02ca admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:52.461624 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680d0d0-7d1c-4f39-b118-0bf7333c02ca admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:52.466086 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930ad2d-1755-40e8-81eb-8ea17b2b9cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:52.466913 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930ad2d-1755-40e8-81eb-8ea17b2b9cea admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:52.467194 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930ad2d-1755-40e8-81eb-8ea17b2b9cea admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:52.467466 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930ad2d-1755-40e8-81eb-8ea17b2b9cea admin admin] PATH_INFO: `/v3/projects/c9dd9d870cf64fb89ba8244fd967c258/users/dd225023d8624226abb6bfa8686ad476/roles/997c650af0d54f31940fbb188fe4172c` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:52.469675 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930ad2d-1755-40e8-81eb-8ea17b2b9cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9dd9d870cf64fb89ba8244fd967c258, user_id=dd225023d8624226abb6bfa8686ad476, role_id=997c650af0d54f31940fbb188fe4172c)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:52.472238 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930ad2d-1755-40e8-81eb-8ea17b2b9cea admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:52.484355 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 562/1121] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:21:52 2022] PUT /identity/v3/projects/c9dd9d870cf64fb89ba8244fd967c258/users/dd225023d8624226abb6bfa8686ad476/roles/997c650af0d54f31940fbb188fe4172c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:21:54.752717 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162370fd-4ad4-446d-9269-672472c8e489 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:54.753237 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162370fd-4ad4-446d-9269-672472c8e489 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:54.753237 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162370fd-4ad4-446d-9269-672472c8e489 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:54.755040 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 560/1122] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:54.760841 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb276a9-0df7-4208-90f9-8511d9495732 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:54.761244 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb276a9-0df7-4208-90f9-8511d9495732 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:54.761414 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb276a9-0df7-4208-90f9-8511d9495732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:54.778596 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-1eb276a9-0df7-4208-90f9-8511d9495732 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:54.779778 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1eb276a9-0df7-4208-90f9-8511d9495732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:54.834959 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 563/1123] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:54 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:21:54.858352 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162370fd-4ad4-446d-9269-672472c8e489 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:54.870668 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162370fd-4ad4-446d-9269-672472c8e489 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:54.874937 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df55527-c564-4f7a-8ae9-2d0a70dd278c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:54.875741 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df55527-c564-4f7a-8ae9-2d0a70dd278c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:54.876014 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df55527-c564-4f7a-8ae9-2d0a70dd278c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:54.876281 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df55527-c564-4f7a-8ae9-2d0a70dd278c admin admin] PATH_INFO: `/v3/roles/997c650af0d54f31940fbb188fe4172c` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:54.877742 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df55527-c564-4f7a-8ae9-2d0a70dd278c admin admin] RBAC: Authorizing `identity:get_role(role_id=997c650af0d54f31940fbb188fe4172c)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:54.879319 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df55527-c564-4f7a-8ae9-2d0a70dd278c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:54.880588 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 561/1124] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:21:54 2022] GET /identity/v3/roles/997c650af0d54f31940fbb188fe4172c => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:54.886344 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb276a9-0df7-4208-90f9-8511d9495732 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:54.894935 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb276a9-0df7-4208-90f9-8511d9495732 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:54.899436 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab4787-0334-498e-bb3e-920949359cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:54.900265 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab4787-0334-498e-bb3e-920949359cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:54.901089 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab4787-0334-498e-bb3e-920949359cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:54.901396 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab4787-0334-498e-bb3e-920949359cd8 admin admin] PATH_INFO: `/v3/users/dd225023d8624226abb6bfa8686ad476` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:54.902589 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab4787-0334-498e-bb3e-920949359cd8 admin admin] RBAC: Authorizing `identity:get_user(user_id=dd225023d8624226abb6bfa8686ad476)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:54.904693 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab4787-0334-498e-bb3e-920949359cd8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:54.906313 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 564/1125] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:21:54 2022] GET /identity/v3/users/dd225023d8624226abb6bfa8686ad476 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:54.911291 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df55527-c564-4f7a-8ae9-2d0a70dd278c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:54.920316 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df55527-c564-4f7a-8ae9-2d0a70dd278c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:54.924611 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3f3cc-bb17-43ad-b879-f611e1e1dde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:54.925184 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3f3cc-bb17-43ad-b879-f611e1e1dde8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:54.925493 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3f3cc-bb17-43ad-b879-f611e1e1dde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:54.925762 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3f3cc-bb17-43ad-b879-f611e1e1dde8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:54.933425 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3f3cc-bb17-43ad-b879-f611e1e1dde8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:54.935095 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3f3cc-bb17-43ad-b879-f611e1e1dde8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:54.943546 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 562/1126] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:21:54 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:21:54.949312 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab4787-0334-498e-bb3e-920949359cd8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:54.958303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab4787-0334-498e-bb3e-920949359cd8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:54.962717 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8cfc8-5931-40a2-ad0c-6e9ba335a984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:54.964032 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8cfc8-5931-40a2-ad0c-6e9ba335a984 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:54.964308 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8cfc8-5931-40a2-ad0c-6e9ba335a984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:54.964582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8cfc8-5931-40a2-ad0c-6e9ba335a984 admin admin] PATH_INFO: `/v3/projects/c9dd9d870cf64fb89ba8244fd967c258` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:54.965759 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8cfc8-5931-40a2-ad0c-6e9ba335a984 admin admin] RBAC: Authorizing `identity:get_project(project_id=c9dd9d870cf64fb89ba8244fd967c258)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:54.967775 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8cfc8-5931-40a2-ad0c-6e9ba335a984 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:54.969382 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 565/1127] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:21:54 2022] GET /identity/v3/projects/c9dd9d870cf64fb89ba8244fd967c258 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:54.974640 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3f3cc-bb17-43ad-b879-f611e1e1dde8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:54.983364 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3f3cc-bb17-43ad-b879-f611e1e1dde8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:54.987740 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8d752-8481-4045-bbd7-24aaa86ce5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:54.988318 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8d752-8481-4045-bbd7-24aaa86ce5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:54.988593 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8d752-8481-4045-bbd7-24aaa86ce5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:54.988858 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8d752-8481-4045-bbd7-24aaa86ce5d0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:54.989687 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8d752-8481-4045-bbd7-24aaa86ce5d0 admin admin] RBAC: Adding query filter params (role.id=997c650af0d54f31940fbb188fe4172c, scope.project.id=c9dd9d870cf64fb89ba8244fd967c258, user.id=dd225023d8624226abb6bfa8686ad476) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:21:54.989988 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8d752-8481-4045-bbd7-24aaa86ce5d0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:54.991746 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8d752-8481-4045-bbd7-24aaa86ce5d0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:54.997821 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 563/1128] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:21:54 2022] GET /identity/v3/role_assignments?user.id=dd225023d8624226abb6bfa8686ad476&scope.project.id=c9dd9d870cf64fb89ba8244fd967c258&role.id=997c650af0d54f31940fbb188fe4172c => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:57.280700 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607d4e8-4547-42e6-ae29-ca8912ac606d None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:57.281224 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607d4e8-4547-42e6-ae29-ca8912ac606d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:57.281224 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607d4e8-4547-42e6-ae29-ca8912ac606d None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:57.283070 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 566/1129] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:57.288164 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7d0c5-602f-417f-aced-155266222ca1 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:57.288565 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7d0c5-602f-417f-aced-155266222ca1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:57.288711 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7d0c5-602f-417f-aced-155266222ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:57.306492 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-4ba7d0c5-602f-417f-aced-155266222ca1 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:57.308268 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4ba7d0c5-602f-417f-aced-155266222ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:57.315729 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 564/1130] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:57 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:21:57.338799 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607d4e8-4547-42e6-ae29-ca8912ac606d None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:57.350604 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607d4e8-4547-42e6-ae29-ca8912ac606d None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:57.355589 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f3b27-fd23-4b22-8c0f-04facfc6b568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:57.356338 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f3b27-fd23-4b22-8c0f-04facfc6b568 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:57.356616 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f3b27-fd23-4b22-8c0f-04facfc6b568 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:57.356888 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f3b27-fd23-4b22-8c0f-04facfc6b568 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:57.358081 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f3b27-fd23-4b22-8c0f-04facfc6b568 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:57.359759 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f3b27-fd23-4b22-8c0f-04facfc6b568 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:57.361317 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 567/1131] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:57.366598 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7d0c5-602f-417f-aced-155266222ca1 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:57.375926 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7d0c5-602f-417f-aced-155266222ca1 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:57.380339 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6aacb3-95f3-4e17-ab6d-14d22813a9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:57.380963 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6aacb3-95f3-4e17-ab6d-14d22813a9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:57.381240 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6aacb3-95f3-4e17-ab6d-14d22813a9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:57.381561 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6aacb3-95f3-4e17-ab6d-14d22813a9f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:57.382250 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6aacb3-95f3-4e17-ab6d-14d22813a9f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:57.384133 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6aacb3-95f3-4e17-ab6d-14d22813a9f9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:57.408891 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 565/1132] 10.222.0.75 () {60 vars in 1162 bytes} [Wed Feb 16 05:21:57 2022] POST /identity/v3/projects => generated 311 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:21:59.702788 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f3982-23e9-4196-b22e-a7ae94f05116 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:59.703252 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f3982-23e9-4196-b22e-a7ae94f05116 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:59.703354 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f3982-23e9-4196-b22e-a7ae94f05116 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:59.705072 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 568/1133] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:21:59.710298 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb48534-07fb-467b-bbff-e5226aff472d None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:59.710740 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb48534-07fb-467b-bbff-e5226aff472d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:59.710837 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb48534-07fb-467b-bbff-e5226aff472d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:59.728903 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-3eb48534-07fb-467b-bbff-e5226aff472d None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:21:59.730104 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3eb48534-07fb-467b-bbff-e5226aff472d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:21:59.784788 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 566/1134] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:21:59 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:21:59.811104 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f3982-23e9-4196-b22e-a7ae94f05116 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:59.823637 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f3982-23e9-4196-b22e-a7ae94f05116 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:59.827992 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f5b56-8a44-4277-a054-d37b5609f4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:59.828755 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f5b56-8a44-4277-a054-d37b5609f4ab admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:59.829033 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f5b56-8a44-4277-a054-d37b5609f4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:59.829332 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f5b56-8a44-4277-a054-d37b5609f4ab admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:59.830487 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f5b56-8a44-4277-a054-d37b5609f4ab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:59.832167 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f5b56-8a44-4277-a054-d37b5609f4ab admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:59.833754 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 569/1135] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:21:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:21:59.838974 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb48534-07fb-467b-bbff-e5226aff472d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:21:59.847525 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb48534-07fb-467b-bbff-e5226aff472d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:21:59.851942 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4ef51-0a66-4ab8-b8a6-f5da1df272f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:21:59.852574 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4ef51-0a66-4ab8-b8a6-f5da1df272f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:21:59.852848 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4ef51-0a66-4ab8-b8a6-f5da1df272f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:21:59.853113 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4ef51-0a66-4ab8-b8a6-f5da1df272f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:21:59.853845 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4ef51-0a66-4ab8-b8a6-f5da1df272f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:21:59.855744 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4ef51-0a66-4ab8-b8a6-f5da1df272f1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:21:59.875196 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 567/1136] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Feb 16 05:21:59 2022] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:22:02.193321 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052556b1-5d78-4fa4-825b-e92ba9304d3d None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:02.193864 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052556b1-5d78-4fa4-825b-e92ba9304d3d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:02.193864 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052556b1-5d78-4fa4-825b-e92ba9304d3d None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:02.195623 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 570/1137] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:22:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:22:02.200748 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca5f17-1832-42ff-af57-2a8368612b09 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:02.201180 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca5f17-1832-42ff-af57-2a8368612b09 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:02.201309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca5f17-1832-42ff-af57-2a8368612b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:02.219024 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-57ca5f17-1832-42ff-af57-2a8368612b09 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:22:02.220211 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-57ca5f17-1832-42ff-af57-2a8368612b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:22:02.227788 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 568/1138] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:22:02 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:22:02.252059 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052556b1-5d78-4fa4-825b-e92ba9304d3d None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:02.263902 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052556b1-5d78-4fa4-825b-e92ba9304d3d None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:02.268164 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c12b34-5b96-47df-b93c-31d6dd8e9336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:02.268910 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c12b34-5b96-47df-b93c-31d6dd8e9336 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:02.269187 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c12b34-5b96-47df-b93c-31d6dd8e9336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:02.269488 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c12b34-5b96-47df-b93c-31d6dd8e9336 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:02.279870 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c12b34-5b96-47df-b93c-31d6dd8e9336 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:22:02.286551 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-63c12b34-5b96-47df-b93c-31d6dd8e9336 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:22:02.287672 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 571/1139] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:22:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:22:02.293800 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca5f17-1832-42ff-af57-2a8368612b09 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:02.302484 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca5f17-1832-42ff-af57-2a8368612b09 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:02.307745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4506e-56ab-48e5-ae5a-1199cad45fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:02.308386 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4506e-56ab-48e5-ae5a-1199cad45fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:02.308667 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4506e-56ab-48e5-ae5a-1199cad45fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:02.308941 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4506e-56ab-48e5-ae5a-1199cad45fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:02.309728 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4506e-56ab-48e5-ae5a-1199cad45fd9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:22:02.310036 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4506e-56ab-48e5-ae5a-1199cad45fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:02.311669 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4506e-56ab-48e5-ae5a-1199cad45fd9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:02.319722 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 569/1140] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:22:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:22:02.326862 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c12b34-5b96-47df-b93c-31d6dd8e9336 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:02.337629 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c12b34-5b96-47df-b93c-31d6dd8e9336 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:02.342200 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d595adc-9af6-4d2f-9420-fb117c8e7d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:02.343017 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d595adc-9af6-4d2f-9420-fb117c8e7d4e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:02.343290 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d595adc-9af6-4d2f-9420-fb117c8e7d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:02.343555 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d595adc-9af6-4d2f-9420-fb117c8e7d4e admin admin] PATH_INFO: `/v3/users/f535d845537f40c6b2d388b4d4ec4f53` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:02.356716 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d595adc-9af6-4d2f-9420-fb117c8e7d4e admin admin] RBAC: Authorizing `identity:get_user(user_id=f535d845537f40c6b2d388b4d4ec4f53)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:02.358848 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d595adc-9af6-4d2f-9420-fb117c8e7d4e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:02.360473 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 572/1141] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:22:02 2022] GET /identity/v3/users/f535d845537f40c6b2d388b4d4ec4f53 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:22:02.366219 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4506e-56ab-48e5-ae5a-1199cad45fd9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:02.376360 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4506e-56ab-48e5-ae5a-1199cad45fd9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:02.380853 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9ff49-9063-417a-8450-68b064dbe879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:02.381556 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9ff49-9063-417a-8450-68b064dbe879 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:02.381556 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9ff49-9063-417a-8450-68b064dbe879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:02.382498 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9ff49-9063-417a-8450-68b064dbe879 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:02.390730 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9ff49-9063-417a-8450-68b064dbe879 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:02.392504 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9ff49-9063-417a-8450-68b064dbe879 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:02.401138 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 570/1142] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:22:02 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:22:02.406577 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d595adc-9af6-4d2f-9420-fb117c8e7d4e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:02.416291 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d595adc-9af6-4d2f-9420-fb117c8e7d4e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:02.420753 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac1f913-6bc7-4ad0-9639-8e3238e1550c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:02.421608 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1f913-6bc7-4ad0-9639-8e3238e1550c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:02.421888 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1f913-6bc7-4ad0-9639-8e3238e1550c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:02.422157 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac1f913-6bc7-4ad0-9639-8e3238e1550c admin admin] PATH_INFO: `/v3/projects/3d89155a36d54884bca0c3e3e78d58d7` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:02.423297 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1f913-6bc7-4ad0-9639-8e3238e1550c admin admin] RBAC: Authorizing `identity:get_project(project_id=3d89155a36d54884bca0c3e3e78d58d7)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:02.425321 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac1f913-6bc7-4ad0-9639-8e3238e1550c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:02.426921 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 573/1143] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:22:02 2022] GET /identity/v3/projects/3d89155a36d54884bca0c3e3e78d58d7 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:22:02.433249 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9ff49-9063-417a-8450-68b064dbe879 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:02.441715 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9ff49-9063-417a-8450-68b064dbe879 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:02.446253 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065d2b3-064f-4746-bf7a-f0483cd5a94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:02.446798 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065d2b3-064f-4746-bf7a-f0483cd5a94b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:02.447079 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065d2b3-064f-4746-bf7a-f0483cd5a94b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:02.447352 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065d2b3-064f-4746-bf7a-f0483cd5a94b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:02.448159 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065d2b3-064f-4746-bf7a-f0483cd5a94b admin admin] RBAC: Adding query filter params (role.id=9ba4a5967ed243178927661616f08901, scope.project.id=3d89155a36d54884bca0c3e3e78d58d7, user.id=f535d845537f40c6b2d388b4d4ec4f53) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:22:02.448466 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065d2b3-064f-4746-bf7a-f0483cd5a94b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:02.450311 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065d2b3-064f-4746-bf7a-f0483cd5a94b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:02.455477 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 571/1144] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:22:02 2022] GET /identity/v3/role_assignments?user.id=f535d845537f40c6b2d388b4d4ec4f53&scope.project.id=3d89155a36d54884bca0c3e3e78d58d7&role.id=9ba4a5967ed243178927661616f08901 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:22:04.724154 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300347d-cd21-4254-a4e4-3623cc2dba1a None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:04.724637 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300347d-cd21-4254-a4e4-3623cc2dba1a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:04.724728 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300347d-cd21-4254-a4e4-3623cc2dba1a None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:04.726484 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 574/1145] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:22:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:22:04.732223 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95522a-60b8-4450-99c6-3370319a25fe None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:04.732653 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95522a-60b8-4450-99c6-3370319a25fe None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:04.732776 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95522a-60b8-4450-99c6-3370319a25fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:04.750591 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-5c95522a-60b8-4450-99c6-3370319a25fe None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:22:04.751767 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5c95522a-60b8-4450-99c6-3370319a25fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:22:04.759369 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 572/1146] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:22:04 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:22:04.782661 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300347d-cd21-4254-a4e4-3623cc2dba1a None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:04.794982 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300347d-cd21-4254-a4e4-3623cc2dba1a None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:04.799273 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08d6eb-0e81-40c4-9f70-eccb98ce278a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:04.800021 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08d6eb-0e81-40c4-9f70-eccb98ce278a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:04.800297 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08d6eb-0e81-40c4-9f70-eccb98ce278a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:04.800566 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08d6eb-0e81-40c4-9f70-eccb98ce278a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:04.811214 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf08d6eb-0e81-40c4-9f70-eccb98ce278a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:22:04.817921 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-bf08d6eb-0e81-40c4-9f70-eccb98ce278a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:22:04.819035 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 575/1147] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:22:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:22:04.824989 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95522a-60b8-4450-99c6-3370319a25fe None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:04.833702 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95522a-60b8-4450-99c6-3370319a25fe None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:04.838796 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f3748-3a8f-4097-89c7-7efc7a6b3fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:04.839429 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f3748-3a8f-4097-89c7-7efc7a6b3fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:04.839707 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f3748-3a8f-4097-89c7-7efc7a6b3fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:04.839979 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f3748-3a8f-4097-89c7-7efc7a6b3fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:04.840719 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f3748-3a8f-4097-89c7-7efc7a6b3fb7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:22:04.841025 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f3748-3a8f-4097-89c7-7efc7a6b3fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:04.842664 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f3748-3a8f-4097-89c7-7efc7a6b3fb7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:04.850646 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 573/1148] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:22:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:22:04.855812 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08d6eb-0e81-40c4-9f70-eccb98ce278a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:04.865728 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08d6eb-0e81-40c4-9f70-eccb98ce278a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:04.870221 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e1f18-0343-4bb4-8c8a-94efd2d7e20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:04.871027 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e1f18-0343-4bb4-8c8a-94efd2d7e20c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:04.871311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e1f18-0343-4bb4-8c8a-94efd2d7e20c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:04.871581 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e1f18-0343-4bb4-8c8a-94efd2d7e20c admin admin] PATH_INFO: `/v3/users/f535d845537f40c6b2d388b4d4ec4f53` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:04.872758 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e1f18-0343-4bb4-8c8a-94efd2d7e20c admin admin] RBAC: Authorizing `identity:get_user(user_id=f535d845537f40c6b2d388b4d4ec4f53)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:04.874889 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e1f18-0343-4bb4-8c8a-94efd2d7e20c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:04.876569 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 576/1149] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:22:04 2022] GET /identity/v3/users/f535d845537f40c6b2d388b4d4ec4f53 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:22:04.881338 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f3748-3a8f-4097-89c7-7efc7a6b3fb7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:04.890953 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f3748-3a8f-4097-89c7-7efc7a6b3fb7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:04.895425 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6d75b-b645-4fd1-8264-0dee51fa22e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:04.896229 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6d75b-b645-4fd1-8264-0dee51fa22e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:04.896511 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6d75b-b645-4fd1-8264-0dee51fa22e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:04.896789 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6d75b-b645-4fd1-8264-0dee51fa22e2 admin admin] PATH_INFO: `/v3/projects/3d89155a36d54884bca0c3e3e78d58d7` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:04.897952 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6d75b-b645-4fd1-8264-0dee51fa22e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=3d89155a36d54884bca0c3e3e78d58d7)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:04.900009 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6d75b-b645-4fd1-8264-0dee51fa22e2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:04.902141 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 574/1150] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:22:04 2022] GET /identity/v3/projects/3d89155a36d54884bca0c3e3e78d58d7 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:22:04.907145 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e1f18-0343-4bb4-8c8a-94efd2d7e20c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:04.916824 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e1f18-0343-4bb4-8c8a-94efd2d7e20c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:04.921221 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a21252-09b4-416c-9c5a-335fb0b5a1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:04.922021 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a21252-09b4-416c-9c5a-335fb0b5a1b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:04.922294 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a21252-09b4-416c-9c5a-335fb0b5a1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:04.922563 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a21252-09b4-416c-9c5a-335fb0b5a1b0 admin admin] PATH_INFO: `/v3/projects/3d89155a36d54884bca0c3e3e78d58d7/users/f535d845537f40c6b2d388b4d4ec4f53/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:04.924466 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a21252-09b4-416c-9c5a-335fb0b5a1b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d89155a36d54884bca0c3e3e78d58d7, user_id=f535d845537f40c6b2d388b4d4ec4f53, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:04.927051 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a21252-09b4-416c-9c5a-335fb0b5a1b0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:04.940753 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 577/1151] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:22:04 2022] PUT /identity/v3/projects/3d89155a36d54884bca0c3e3e78d58d7/users/f535d845537f40c6b2d388b4d4ec4f53/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:22:07.258897 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dfe04-d2b7-47aa-87c9-5db0b692a3d7 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:07.259428 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dfe04-d2b7-47aa-87c9-5db0b692a3d7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:07.259546 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dfe04-d2b7-47aa-87c9-5db0b692a3d7 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:07.261793 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 575/1152] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:22:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:22:07.267008 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efce24-5dc7-4c59-a28d-d356ba08a3ab None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:07.267397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efce24-5dc7-4c59-a28d-d356ba08a3ab None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:07.267567 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efce24-5dc7-4c59-a28d-d356ba08a3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:07.284737 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-e8efce24-5dc7-4c59-a28d-d356ba08a3ab None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:22:07.285951 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e8efce24-5dc7-4c59-a28d-d356ba08a3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:22:07.341696 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 578/1153] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:22:07 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:22:07.365534 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dfe04-d2b7-47aa-87c9-5db0b692a3d7 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:07.377396 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dfe04-d2b7-47aa-87c9-5db0b692a3d7 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:07.381676 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ecc6b-5b7e-4e27-9370-b9cc8e47d5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:07.382428 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ecc6b-5b7e-4e27-9370-b9cc8e47d5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:07.382706 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ecc6b-5b7e-4e27-9370-b9cc8e47d5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:07.382974 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ecc6b-5b7e-4e27-9370-b9cc8e47d5d1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:07.392891 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ecc6b-5b7e-4e27-9370-b9cc8e47d5d1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:22:07.399609 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-e08ecc6b-5b7e-4e27-9370-b9cc8e47d5d1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:22:07.401226 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 576/1154] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:22:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:22:07.406886 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efce24-5dc7-4c59-a28d-d356ba08a3ab None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:07.415384 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efce24-5dc7-4c59-a28d-d356ba08a3ab None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:07.420528 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d677e2c-65d4-435c-ac3b-6efe88ef58f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:07.421159 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d677e2c-65d4-435c-ac3b-6efe88ef58f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:07.421477 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d677e2c-65d4-435c-ac3b-6efe88ef58f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:07.421752 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d677e2c-65d4-435c-ac3b-6efe88ef58f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:07.422487 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d677e2c-65d4-435c-ac3b-6efe88ef58f3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:22:07.422789 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d677e2c-65d4-435c-ac3b-6efe88ef58f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:07.424368 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d677e2c-65d4-435c-ac3b-6efe88ef58f3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:07.432534 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 579/1155] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:22:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:22:07.438153 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ecc6b-5b7e-4e27-9370-b9cc8e47d5d1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:07.448077 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ecc6b-5b7e-4e27-9370-b9cc8e47d5d1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:07.452484 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb830d3e-fb3d-41f8-b9f5-af283eadfc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:07.453333 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb830d3e-fb3d-41f8-b9f5-af283eadfc97 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:07.453609 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb830d3e-fb3d-41f8-b9f5-af283eadfc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:07.453875 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb830d3e-fb3d-41f8-b9f5-af283eadfc97 admin admin] PATH_INFO: `/v3/users/f535d845537f40c6b2d388b4d4ec4f53` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:07.455049 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb830d3e-fb3d-41f8-b9f5-af283eadfc97 admin admin] RBAC: Authorizing `identity:get_user(user_id=f535d845537f40c6b2d388b4d4ec4f53)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:07.457157 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb830d3e-fb3d-41f8-b9f5-af283eadfc97 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:07.458714 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 577/1156] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:22:07 2022] GET /identity/v3/users/f535d845537f40c6b2d388b4d4ec4f53 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:22:07.464470 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d677e2c-65d4-435c-ac3b-6efe88ef58f3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:07.473598 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d677e2c-65d4-435c-ac3b-6efe88ef58f3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:07.478026 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b519be9-50b3-43bf-b4bd-1896e7980daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:07.479221 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b519be9-50b3-43bf-b4bd-1896e7980daa admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:07.479507 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b519be9-50b3-43bf-b4bd-1896e7980daa admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:07.479781 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b519be9-50b3-43bf-b4bd-1896e7980daa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:07.487199 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b519be9-50b3-43bf-b4bd-1896e7980daa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:07.488902 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b519be9-50b3-43bf-b4bd-1896e7980daa admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:07.497426 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 580/1157] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:22:07 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:22:07.502625 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb830d3e-fb3d-41f8-b9f5-af283eadfc97 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:07.511712 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb830d3e-fb3d-41f8-b9f5-af283eadfc97 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:07.516003 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645f3ba-d163-4d62-90fa-a8eeb79dc4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:07.516766 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645f3ba-d163-4d62-90fa-a8eeb79dc4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:07.517039 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645f3ba-d163-4d62-90fa-a8eeb79dc4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:07.517336 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645f3ba-d163-4d62-90fa-a8eeb79dc4f9 admin admin] PATH_INFO: `/v3/projects/3d89155a36d54884bca0c3e3e78d58d7` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:07.518458 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645f3ba-d163-4d62-90fa-a8eeb79dc4f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=3d89155a36d54884bca0c3e3e78d58d7)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:07.520428 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645f3ba-d163-4d62-90fa-a8eeb79dc4f9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:07.522034 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 578/1158] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:22:07 2022] GET /identity/v3/projects/3d89155a36d54884bca0c3e3e78d58d7 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:22:07.527793 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b519be9-50b3-43bf-b4bd-1896e7980daa admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:07.535955 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b519be9-50b3-43bf-b4bd-1896e7980daa admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:07.540363 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdedfba-2811-4fe0-a531-05a45f129f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:07.541582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdedfba-2811-4fe0-a531-05a45f129f38 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:07.541859 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdedfba-2811-4fe0-a531-05a45f129f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:07.542126 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdedfba-2811-4fe0-a531-05a45f129f38 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:07.542914 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdedfba-2811-4fe0-a531-05a45f129f38 admin admin] RBAC: Adding query filter params (role.id=9ba4a5967ed243178927661616f08901, scope.project.id=3d89155a36d54884bca0c3e3e78d58d7, user.id=f535d845537f40c6b2d388b4d4ec4f53) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:22:07.543216 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdedfba-2811-4fe0-a531-05a45f129f38 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:07.544958 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdedfba-2811-4fe0-a531-05a45f129f38 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:07.550426 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 581/1159] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:22:07 2022] GET /identity/v3/role_assignments?user.id=f535d845537f40c6b2d388b4d4ec4f53&scope.project.id=3d89155a36d54884bca0c3e3e78d58d7&role.id=9ba4a5967ed243178927661616f08901 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:22:09.850930 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76924e97-24d6-4126-9b50-e874fb416640 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:09.851436 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76924e97-24d6-4126-9b50-e874fb416640 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:09.851554 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76924e97-24d6-4126-9b50-e874fb416640 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:09.853783 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 579/1160] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:22:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:22:09.858899 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9fec1-a8c3-4e8f-bd4e-920892e0452d None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:09.859315 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9fec1-a8c3-4e8f-bd4e-920892e0452d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:09.859446 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9fec1-a8c3-4e8f-bd4e-920892e0452d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:09.877205 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0bf9fec1-a8c3-4e8f-bd4e-920892e0452d None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:22:09.878562 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0bf9fec1-a8c3-4e8f-bd4e-920892e0452d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:22:09.886116 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 582/1161] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:22:09 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:22:09.908186 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76924e97-24d6-4126-9b50-e874fb416640 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:09.920722 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76924e97-24d6-4126-9b50-e874fb416640 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:09.925017 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b33fb-ae6d-4bf4-89fd-3836fd026768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:09.925666 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b33fb-ae6d-4bf4-89fd-3836fd026768 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:09.925945 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b33fb-ae6d-4bf4-89fd-3836fd026768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:09.926219 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b33fb-ae6d-4bf4-89fd-3836fd026768 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:09.934659 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b33fb-ae6d-4bf4-89fd-3836fd026768 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:09.936414 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b33fb-ae6d-4bf4-89fd-3836fd026768 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:09.945497 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 580/1162] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:22:09 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:22:09.951039 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9fec1-a8c3-4e8f-bd4e-920892e0452d None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:09.959667 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9fec1-a8c3-4e8f-bd4e-920892e0452d None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:09.964120 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3d0cb-bcd2-4c6f-a899-31d8b6e5267c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:09.964887 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3d0cb-bcd2-4c6f-a899-31d8b6e5267c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:09.965168 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3d0cb-bcd2-4c6f-a899-31d8b6e5267c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:09.965474 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3d0cb-bcd2-4c6f-a899-31d8b6e5267c admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:09.972123 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3d0cb-bcd2-4c6f-a899-31d8b6e5267c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:09.973975 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3d0cb-bcd2-4c6f-a899-31d8b6e5267c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:09.987770 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-03b3d0cb-bcd2-4c6f-a899-31d8b6e5267c admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 16 05:22:09.988905 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 583/1163] 10.222.0.75 () {56 vars in 1138 bytes} [Wed Feb 16 05:22:09 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:22:09.994862 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b33fb-ae6d-4bf4-89fd-3836fd026768 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:10.003454 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b33fb-ae6d-4bf4-89fd-3836fd026768 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:10.007905 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04a6a2-2a60-482c-b018-36e055273cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:10.008529 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04a6a2-2a60-482c-b018-36e055273cbc admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:10.008809 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04a6a2-2a60-482c-b018-36e055273cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:10.009083 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04a6a2-2a60-482c-b018-36e055273cbc admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:10.010330 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04a6a2-2a60-482c-b018-36e055273cbc admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:22:10.010636 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04a6a2-2a60-482c-b018-36e055273cbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:10.012199 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04a6a2-2a60-482c-b018-36e055273cbc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:10.019275 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 581/1164] 10.222.0.75 () {56 vars in 1136 bytes} [Wed Feb 16 05:22:09 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:22:12.259622 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b222da-8dd9-4a18-8080-353da7b9436e None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:12.260147 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b222da-8dd9-4a18-8080-353da7b9436e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:12.260147 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b222da-8dd9-4a18-8080-353da7b9436e None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:12.261966 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 584/1165] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:22:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:22:12.267067 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de925b-3f29-4b7a-a590-b8c5bb1088cc None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:12.267430 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de925b-3f29-4b7a-a590-b8c5bb1088cc None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:12.267621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de925b-3f29-4b7a-a590-b8c5bb1088cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:12.285373 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-51de925b-3f29-4b7a-a590-b8c5bb1088cc None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:22:12.286544 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-51de925b-3f29-4b7a-a590-b8c5bb1088cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:22:12.294056 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 582/1166] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:22:12 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:22:12.316844 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b222da-8dd9-4a18-8080-353da7b9436e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:12.329200 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b222da-8dd9-4a18-8080-353da7b9436e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:12.333554 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1e192-de49-4ec6-bcdf-f6f5c07744ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:12.334179 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1e192-de49-4ec6-bcdf-f6f5c07744ca admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:12.334460 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1e192-de49-4ec6-bcdf-f6f5c07744ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:12.334761 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1e192-de49-4ec6-bcdf-f6f5c07744ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:12.335503 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1e192-de49-4ec6-bcdf-f6f5c07744ca admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:12.336502 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-7aa1e192-de49-4ec6-bcdf-f6f5c07744ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:22:12.336502 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Feb 16 05:22:12.336502 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: Feb 16 05:22:12.337991 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1e192-de49-4ec6-bcdf-f6f5c07744ca admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:12.351772 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 585/1167] 10.222.0.75 () {60 vars in 1159 bytes} [Wed Feb 16 05:22:12 2022] POST /identity/v3/domains => generated 267 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:22:14.664684 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0d987-c13d-4a61-aa73-17bb1e2d76f1 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:14.665814 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0d987-c13d-4a61-aa73-17bb1e2d76f1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:14.665814 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0d987-c13d-4a61-aa73-17bb1e2d76f1 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:14.667536 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 583/1168] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:22:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:22:14.672902 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd81303-305c-4d62-b948-fd322849c3c9 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:14.673351 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd81303-305c-4d62-b948-fd322849c3c9 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:14.673478 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd81303-305c-4d62-b948-fd322849c3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:14.691561 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-acd81303-305c-4d62-b948-fd322849c3c9 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:22:14.692730 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-acd81303-305c-4d62-b948-fd322849c3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:22:14.748049 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 586/1169] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:22:14 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:22:14.771850 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0d987-c13d-4a61-aa73-17bb1e2d76f1 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:14.784064 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0d987-c13d-4a61-aa73-17bb1e2d76f1 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:14.788304 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090e97a-135d-4b1c-92f5-89232afaf92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:14.789120 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090e97a-135d-4b1c-92f5-89232afaf92b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:14.789427 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090e97a-135d-4b1c-92f5-89232afaf92b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:14.789695 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090e97a-135d-4b1c-92f5-89232afaf92b admin admin] PATH_INFO: `/v3/domains/03f63a426c594ed194de50dbb9ed090d` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:14.800385 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090e97a-135d-4b1c-92f5-89232afaf92b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=03f63a426c594ed194de50dbb9ed090d)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:14.802388 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090e97a-135d-4b1c-92f5-89232afaf92b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:14.803930 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 584/1170] 10.222.0.75 () {56 vars in 1204 bytes} [Wed Feb 16 05:22:14 2022] GET /identity/v3/domains/03f63a426c594ed194de50dbb9ed090d => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:22:14.809530 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd81303-305c-4d62-b948-fd322849c3c9 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:14.818102 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd81303-305c-4d62-b948-fd322849c3c9 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:14.822529 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3d904-6584-42ab-bd62-754da12dac06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:14.823160 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3d904-6584-42ab-bd62-754da12dac06 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:14.823435 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3d904-6584-42ab-bd62-754da12dac06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:14.823703 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3d904-6584-42ab-bd62-754da12dac06 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:14.824405 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3d904-6584-42ab-bd62-754da12dac06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:14.826338 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3d904-6584-42ab-bd62-754da12dac06 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:14.851930 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 587/1171] 10.222.0.75 () {60 vars in 1162 bytes} [Wed Feb 16 05:22:14 2022] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:22:17.132723 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8726c-9522-421f-8d34-cab616389048 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:17.133243 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8726c-9522-421f-8d34-cab616389048 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:17.133243 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8726c-9522-421f-8d34-cab616389048 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:17.135061 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 585/1172] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:22:17.140150 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86df6d-05bb-48d6-8573-6a7e0d9cc514 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:17.140532 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86df6d-05bb-48d6-8573-6a7e0d9cc514 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:17.140707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86df6d-05bb-48d6-8573-6a7e0d9cc514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:17.159236 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-aa86df6d-05bb-48d6-8573-6a7e0d9cc514 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:22:17.160406 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-aa86df6d-05bb-48d6-8573-6a7e0d9cc514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:22:17.215685 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 588/1173] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:22:17 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:22:17.240831 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8726c-9522-421f-8d34-cab616389048 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:17.252545 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8726c-9522-421f-8d34-cab616389048 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:17.256782 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87cbae-2b7b-4d6f-b7b8-3d63866b41cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:17.257625 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87cbae-2b7b-4d6f-b7b8-3d63866b41cb admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:17.257903 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87cbae-2b7b-4d6f-b7b8-3d63866b41cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:17.258170 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87cbae-2b7b-4d6f-b7b8-3d63866b41cb admin admin] PATH_INFO: `/v3/domains/03f63a426c594ed194de50dbb9ed090d` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:17.259318 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87cbae-2b7b-4d6f-b7b8-3d63866b41cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=03f63a426c594ed194de50dbb9ed090d)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:17.261282 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87cbae-2b7b-4d6f-b7b8-3d63866b41cb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:17.262810 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 586/1174] 10.222.0.75 () {56 vars in 1204 bytes} [Wed Feb 16 05:22:17 2022] GET /identity/v3/domains/03f63a426c594ed194de50dbb9ed090d => generated 267 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:22:17.268120 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86df6d-05bb-48d6-8573-6a7e0d9cc514 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:17.277203 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86df6d-05bb-48d6-8573-6a7e0d9cc514 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:17.281799 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b2534-b707-4c80-bdcd-543b83074b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:17.282433 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b2534-b707-4c80-bdcd-543b83074b7e admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:17.282709 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b2534-b707-4c80-bdcd-543b83074b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:17.282976 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b2534-b707-4c80-bdcd-543b83074b7e admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:17.283666 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b2534-b707-4c80-bdcd-543b83074b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:17.285595 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b2534-b707-4c80-bdcd-543b83074b7e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:17.305356 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 589/1175] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Feb 16 05:22:17 2022] POST /identity/v3/users => generated 311 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:22:19.628985 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9d2cf-04b2-452b-a476-1784d0bc78f6 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:19.629558 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9d2cf-04b2-452b-a476-1784d0bc78f6 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:19.629693 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9d2cf-04b2-452b-a476-1784d0bc78f6 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:19.631478 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 587/1176] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:22:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:22:19.636709 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811587cd-917b-4da4-8071-4bc3e122fcbd None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:19.637097 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811587cd-917b-4da4-8071-4bc3e122fcbd None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:19.637301 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811587cd-917b-4da4-8071-4bc3e122fcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:19.654443 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-811587cd-917b-4da4-8071-4bc3e122fcbd None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:22:19.655619 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-811587cd-917b-4da4-8071-4bc3e122fcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:22:19.663160 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 590/1177] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:22:19 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:22:19.687831 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9d2cf-04b2-452b-a476-1784d0bc78f6 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:19.700231 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9d2cf-04b2-452b-a476-1784d0bc78f6 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:19.704597 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03526dd-6dd3-4ac8-94e7-ce0f24c6cecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:19.705385 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03526dd-6dd3-4ac8-94e7-ce0f24c6cecb admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:19.705664 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03526dd-6dd3-4ac8-94e7-ce0f24c6cecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:19.705934 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03526dd-6dd3-4ac8-94e7-ce0f24c6cecb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:19.716849 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03526dd-6dd3-4ac8-94e7-ce0f24c6cecb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:22:19.723525 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-a03526dd-6dd3-4ac8-94e7-ce0f24c6cecb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:22:19.724662 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 588/1178] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:22:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:22:19.730362 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811587cd-917b-4da4-8071-4bc3e122fcbd None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:19.739079 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811587cd-917b-4da4-8071-4bc3e122fcbd None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:19.743503 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a901f-a36f-4bf8-b40d-eb7607de0c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:19.744132 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a901f-a36f-4bf8-b40d-eb7607de0c33 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:19.744407 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a901f-a36f-4bf8-b40d-eb7607de0c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:19.744673 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a901f-a36f-4bf8-b40d-eb7607de0c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:19.745436 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a901f-a36f-4bf8-b40d-eb7607de0c33 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:22:19.745739 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a901f-a36f-4bf8-b40d-eb7607de0c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:19.747303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a901f-a36f-4bf8-b40d-eb7607de0c33 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:19.755134 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 591/1179] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:22:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:22:19.761184 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03526dd-6dd3-4ac8-94e7-ce0f24c6cecb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:19.770658 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03526dd-6dd3-4ac8-94e7-ce0f24c6cecb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:19.775752 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40850ebc-f9e4-4f49-acab-6b3abaa1ad57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:19.776590 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40850ebc-f9e4-4f49-acab-6b3abaa1ad57 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:19.776868 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40850ebc-f9e4-4f49-acab-6b3abaa1ad57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:19.777139 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40850ebc-f9e4-4f49-acab-6b3abaa1ad57 admin admin] PATH_INFO: `/v3/users/afc181a6b72a4b70bb076d330f30eca9` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:19.794226 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40850ebc-f9e4-4f49-acab-6b3abaa1ad57 admin admin] RBAC: Authorizing `identity:get_user(user_id=afc181a6b72a4b70bb076d330f30eca9)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:19.796412 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40850ebc-f9e4-4f49-acab-6b3abaa1ad57 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:19.798105 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 589/1180] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:22:19 2022] GET /identity/v3/users/afc181a6b72a4b70bb076d330f30eca9 => generated 311 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:22:19.803983 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a901f-a36f-4bf8-b40d-eb7607de0c33 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:19.813752 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a901f-a36f-4bf8-b40d-eb7607de0c33 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:19.818217 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7061fa3-e546-4afa-82a2-507f92cb2c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:19.818841 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7061fa3-e546-4afa-82a2-507f92cb2c33 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:19.819119 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7061fa3-e546-4afa-82a2-507f92cb2c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:19.819391 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7061fa3-e546-4afa-82a2-507f92cb2c33 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:19.827483 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7061fa3-e546-4afa-82a2-507f92cb2c33 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:19.829220 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7061fa3-e546-4afa-82a2-507f92cb2c33 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:19.838506 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 592/1181] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:22:19 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:22:19.843775 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40850ebc-f9e4-4f49-acab-6b3abaa1ad57 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:19.852942 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40850ebc-f9e4-4f49-acab-6b3abaa1ad57 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:19.857359 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de932a0-49b8-434c-8e85-68d53ddc6e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:19.858170 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de932a0-49b8-434c-8e85-68d53ddc6e16 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:19.858448 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de932a0-49b8-434c-8e85-68d53ddc6e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:19.858718 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de932a0-49b8-434c-8e85-68d53ddc6e16 admin admin] PATH_INFO: `/v3/projects/a13200ae57df4f15bca8288112036d34` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:19.859859 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de932a0-49b8-434c-8e85-68d53ddc6e16 admin admin] RBAC: Authorizing `identity:get_project(project_id=a13200ae57df4f15bca8288112036d34)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:19.861910 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de932a0-49b8-434c-8e85-68d53ddc6e16 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:19.863489 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 590/1182] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:22:19 2022] GET /identity/v3/projects/a13200ae57df4f15bca8288112036d34 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:22:19.869074 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7061fa3-e546-4afa-82a2-507f92cb2c33 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:19.877510 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7061fa3-e546-4afa-82a2-507f92cb2c33 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:19.882035 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aa656f-a7aa-4a2e-9f95-da4554f13d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:19.882578 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa656f-a7aa-4a2e-9f95-da4554f13d0a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:19.882858 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa656f-a7aa-4a2e-9f95-da4554f13d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:19.883130 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aa656f-a7aa-4a2e-9f95-da4554f13d0a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:19.884441 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa656f-a7aa-4a2e-9f95-da4554f13d0a admin admin] RBAC: Adding query filter params (role.id=9ba4a5967ed243178927661616f08901, scope.project.id=a13200ae57df4f15bca8288112036d34, user.id=afc181a6b72a4b70bb076d330f30eca9) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:22:19.884747 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa656f-a7aa-4a2e-9f95-da4554f13d0a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:19.886565 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aa656f-a7aa-4a2e-9f95-da4554f13d0a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:19.891669 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 593/1183] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:22:19 2022] GET /identity/v3/role_assignments?user.id=afc181a6b72a4b70bb076d330f30eca9&scope.project.id=a13200ae57df4f15bca8288112036d34&role.id=9ba4a5967ed243178927661616f08901 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:22:22.157896 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf891a0-c5e4-4de8-b697-1770b77ba554 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:22.158413 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf891a0-c5e4-4de8-b697-1770b77ba554 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:22.158413 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf891a0-c5e4-4de8-b697-1770b77ba554 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:22.160169 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 591/1184] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:22:22.165931 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49314d22-1020-4f8b-86c6-2452d1037b46 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:22.166371 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49314d22-1020-4f8b-86c6-2452d1037b46 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:22.166489 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49314d22-1020-4f8b-86c6-2452d1037b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:22.184543 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-49314d22-1020-4f8b-86c6-2452d1037b46 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:22:22.185748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-49314d22-1020-4f8b-86c6-2452d1037b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:22:22.193302 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 594/1185] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:22:22 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:22:22.215852 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf891a0-c5e4-4de8-b697-1770b77ba554 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:22.228131 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf891a0-c5e4-4de8-b697-1770b77ba554 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:22.232398 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac634df-7c3c-4489-81cb-02a2bb826ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:22.233136 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac634df-7c3c-4489-81cb-02a2bb826ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:22.233451 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac634df-7c3c-4489-81cb-02a2bb826ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:22.233721 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac634df-7c3c-4489-81cb-02a2bb826ab6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:22.243504 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac634df-7c3c-4489-81cb-02a2bb826ab6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:22:22.250077 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-cac634df-7c3c-4489-81cb-02a2bb826ab6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:22:22.251171 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 592/1186] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:22:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:22:22.256735 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49314d22-1020-4f8b-86c6-2452d1037b46 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:22.265455 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49314d22-1020-4f8b-86c6-2452d1037b46 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:22.269907 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12942eb0-84cc-4d21-a458-639b67b89821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:22.270537 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12942eb0-84cc-4d21-a458-639b67b89821 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:22.270817 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12942eb0-84cc-4d21-a458-639b67b89821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:22.271088 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12942eb0-84cc-4d21-a458-639b67b89821 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:22.271826 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12942eb0-84cc-4d21-a458-639b67b89821 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:22:22.272131 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12942eb0-84cc-4d21-a458-639b67b89821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:22.273763 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12942eb0-84cc-4d21-a458-639b67b89821 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:22.282249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 595/1187] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:22:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:22:22.287452 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac634df-7c3c-4489-81cb-02a2bb826ab6 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:22.298762 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac634df-7c3c-4489-81cb-02a2bb826ab6 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:22.303159 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151c490-3b98-4735-bc8a-34eea4eb4789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:22.303962 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151c490-3b98-4735-bc8a-34eea4eb4789 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:22.304236 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151c490-3b98-4735-bc8a-34eea4eb4789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:22.304502 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151c490-3b98-4735-bc8a-34eea4eb4789 admin admin] PATH_INFO: `/v3/users/afc181a6b72a4b70bb076d330f30eca9` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:22.305947 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151c490-3b98-4735-bc8a-34eea4eb4789 admin admin] RBAC: Authorizing `identity:get_user(user_id=afc181a6b72a4b70bb076d330f30eca9)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:22.308051 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151c490-3b98-4735-bc8a-34eea4eb4789 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:22.309601 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 593/1188] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:22:22 2022] GET /identity/v3/users/afc181a6b72a4b70bb076d330f30eca9 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:22:22.314600 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12942eb0-84cc-4d21-a458-639b67b89821 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:22.323771 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12942eb0-84cc-4d21-a458-639b67b89821 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:22.328199 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4cc50-ce80-4738-844b-456a1f18c466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:22.329010 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4cc50-ce80-4738-844b-456a1f18c466 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:22.329329 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4cc50-ce80-4738-844b-456a1f18c466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:22.329604 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4cc50-ce80-4738-844b-456a1f18c466 admin admin] PATH_INFO: `/v3/projects/a13200ae57df4f15bca8288112036d34` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:22.330758 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4cc50-ce80-4738-844b-456a1f18c466 admin admin] RBAC: Authorizing `identity:get_project(project_id=a13200ae57df4f15bca8288112036d34)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:22.332804 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4cc50-ce80-4738-844b-456a1f18c466 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:22.334557 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 596/1189] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:22:22 2022] GET /identity/v3/projects/a13200ae57df4f15bca8288112036d34 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:22:22.340015 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151c490-3b98-4735-bc8a-34eea4eb4789 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:22.349181 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151c490-3b98-4735-bc8a-34eea4eb4789 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:22.354503 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b456f-fc0a-4baf-a9d4-0f56095912a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:22.355327 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b456f-fc0a-4baf-a9d4-0f56095912a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:22.355604 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b456f-fc0a-4baf-a9d4-0f56095912a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:22.355872 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b456f-fc0a-4baf-a9d4-0f56095912a4 admin admin] PATH_INFO: `/v3/projects/a13200ae57df4f15bca8288112036d34/users/afc181a6b72a4b70bb076d330f30eca9/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:22.357812 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b456f-fc0a-4baf-a9d4-0f56095912a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a13200ae57df4f15bca8288112036d34, user_id=afc181a6b72a4b70bb076d330f30eca9, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:22.360416 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b456f-fc0a-4baf-a9d4-0f56095912a4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:22.372715 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 594/1190] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:22:22 2022] PUT /identity/v3/projects/a13200ae57df4f15bca8288112036d34/users/afc181a6b72a4b70bb076d330f30eca9/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:22:24.636685 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf0482-ce31-4388-975d-40ec632ae0e1 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:24.637215 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf0482-ce31-4388-975d-40ec632ae0e1 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:24.637215 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf0482-ce31-4388-975d-40ec632ae0e1 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:24.639218 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 597/1191] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:22:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:22:24.644315 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbf3a5-4e4d-4429-924b-f87f1cb24659 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:24.644744 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbf3a5-4e4d-4429-924b-f87f1cb24659 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:24.644843 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbf3a5-4e4d-4429-924b-f87f1cb24659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:24.662055 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-88bbf3a5-4e4d-4429-924b-f87f1cb24659 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:22:24.663231 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-88bbf3a5-4e4d-4429-924b-f87f1cb24659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:22:24.719285 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 595/1192] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:22:24 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:22:24.743737 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf0482-ce31-4388-975d-40ec632ae0e1 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:24.755690 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf0482-ce31-4388-975d-40ec632ae0e1 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:24.760585 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26286a8e-1e4a-4cf8-8515-3adaae9dbf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:24.761376 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26286a8e-1e4a-4cf8-8515-3adaae9dbf51 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:24.761659 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26286a8e-1e4a-4cf8-8515-3adaae9dbf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:24.761933 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26286a8e-1e4a-4cf8-8515-3adaae9dbf51 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:24.771923 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26286a8e-1e4a-4cf8-8515-3adaae9dbf51 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:22:24.778716 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-26286a8e-1e4a-4cf8-8515-3adaae9dbf51 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:22:24.779840 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 598/1193] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:22:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:22:24.785391 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbf3a5-4e4d-4429-924b-f87f1cb24659 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:24.794039 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbf3a5-4e4d-4429-924b-f87f1cb24659 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:24.798436 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765a173-92a9-44f8-8604-4b9d528ffb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:24.799066 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765a173-92a9-44f8-8604-4b9d528ffb8c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:24.799348 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765a173-92a9-44f8-8604-4b9d528ffb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:24.799620 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765a173-92a9-44f8-8604-4b9d528ffb8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:24.800356 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765a173-92a9-44f8-8604-4b9d528ffb8c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:22:24.800656 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765a173-92a9-44f8-8604-4b9d528ffb8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:24.802287 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765a173-92a9-44f8-8604-4b9d528ffb8c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:24.810997 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 596/1194] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:22:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:22:24.816239 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26286a8e-1e4a-4cf8-8515-3adaae9dbf51 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:24.826509 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26286a8e-1e4a-4cf8-8515-3adaae9dbf51 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:24.830975 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f9b84-4e80-4e83-b423-6413068c5976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:24.831775 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f9b84-4e80-4e83-b423-6413068c5976 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:24.832055 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f9b84-4e80-4e83-b423-6413068c5976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:24.832329 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f9b84-4e80-4e83-b423-6413068c5976 admin admin] PATH_INFO: `/v3/users/afc181a6b72a4b70bb076d330f30eca9` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:24.833532 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f9b84-4e80-4e83-b423-6413068c5976 admin admin] RBAC: Authorizing `identity:get_user(user_id=afc181a6b72a4b70bb076d330f30eca9)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:24.835638 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f9b84-4e80-4e83-b423-6413068c5976 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:24.837208 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 599/1195] 10.222.0.75 () {56 vars in 1198 bytes} [Wed Feb 16 05:22:24 2022] GET /identity/v3/users/afc181a6b72a4b70bb076d330f30eca9 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:22:24.842492 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765a173-92a9-44f8-8604-4b9d528ffb8c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:24.852066 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765a173-92a9-44f8-8604-4b9d528ffb8c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:24.857038 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304135a-b249-4bb6-be4d-1e710a48d27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:24.857677 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304135a-b249-4bb6-be4d-1e710a48d27f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:24.857961 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304135a-b249-4bb6-be4d-1e710a48d27f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:24.858234 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304135a-b249-4bb6-be4d-1e710a48d27f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:24.865801 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304135a-b249-4bb6-be4d-1e710a48d27f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:24.867525 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304135a-b249-4bb6-be4d-1e710a48d27f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:24.876842 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 597/1196] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:22:24 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:22:24.882202 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f9b84-4e80-4e83-b423-6413068c5976 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:24.891447 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f9b84-4e80-4e83-b423-6413068c5976 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:24.895748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0047514-706d-461e-99b6-5268e3b60e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:24.896542 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0047514-706d-461e-99b6-5268e3b60e6d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:24.896814 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0047514-706d-461e-99b6-5268e3b60e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:24.897081 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0047514-706d-461e-99b6-5268e3b60e6d admin admin] PATH_INFO: `/v3/projects/a13200ae57df4f15bca8288112036d34` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:24.898238 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0047514-706d-461e-99b6-5268e3b60e6d admin admin] RBAC: Authorizing `identity:get_project(project_id=a13200ae57df4f15bca8288112036d34)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:24.900228 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0047514-706d-461e-99b6-5268e3b60e6d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:24.901849 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 600/1197] 10.222.0.75 () {56 vars in 1207 bytes} [Wed Feb 16 05:22:24 2022] GET /identity/v3/projects/a13200ae57df4f15bca8288112036d34 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:22:24.907214 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304135a-b249-4bb6-be4d-1e710a48d27f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:22:24.916138 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304135a-b249-4bb6-be4d-1e710a48d27f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:22:24.920610 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98855a1e-2b04-4c1d-b2ee-a5e531b67a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:22:24.921206 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98855a1e-2b04-4c1d-b2ee-a5e531b67a1d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:22:24.921513 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98855a1e-2b04-4c1d-b2ee-a5e531b67a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:22:24.921787 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98855a1e-2b04-4c1d-b2ee-a5e531b67a1d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:22:24.922697 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98855a1e-2b04-4c1d-b2ee-a5e531b67a1d admin admin] RBAC: Adding query filter params (role.id=9ba4a5967ed243178927661616f08901, scope.project.id=a13200ae57df4f15bca8288112036d34, user.id=afc181a6b72a4b70bb076d330f30eca9) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:22:24.923003 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98855a1e-2b04-4c1d-b2ee-a5e531b67a1d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:22:24.925059 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98855a1e-2b04-4c1d-b2ee-a5e531b67a1d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:22:24.931735 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 598/1198] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:22:24 2022] GET /identity/v3/role_assignments?user.id=afc181a6b72a4b70bb076d330f30eca9&scope.project.id=a13200ae57df4f15bca8288112036d34&role.id=9ba4a5967ed243178927661616f08901 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:27.377309 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448f513-4686-4436-8aa2-6e78ab42e813 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:27.378006 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448f513-4686-4436-8aa2-6e78ab42e813 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:27.378006 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448f513-4686-4436-8aa2-6e78ab42e813 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:27.379902 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 601/1199] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:23:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:23:27.386604 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d0e21-9ff4-4242-9923-09c444431b79 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:27.387135 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d0e21-9ff4-4242-9923-09c444431b79 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:27.387308 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d0e21-9ff4-4242-9923-09c444431b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:27.407151 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-b53d0e21-9ff4-4242-9923-09c444431b79 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:23:27.408484 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b53d0e21-9ff4-4242-9923-09c444431b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:23:27.417790 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 599/1200] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:23:27 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:23:27.447896 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448f513-4686-4436-8aa2-6e78ab42e813 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:27.462162 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448f513-4686-4436-8aa2-6e78ab42e813 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:27.467665 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c784a-af5d-4f83-9a2d-41c28a75cfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:27.468533 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c784a-af5d-4f83-9a2d-41c28a75cfab admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:27.468823 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c784a-af5d-4f83-9a2d-41c28a75cfab admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:27.469088 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c784a-af5d-4f83-9a2d-41c28a75cfab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:27.481151 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c784a-af5d-4f83-9a2d-41c28a75cfab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:27.483354 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c784a-af5d-4f83-9a2d-41c28a75cfab admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:27.503020 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-685c784a-af5d-4f83-9a2d-41c28a75cfab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:23:27.504769 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 602/1201] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:23:27.511690 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d0e21-9ff4-4242-9923-09c444431b79 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:27.521916 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d0e21-9ff4-4242-9923-09c444431b79 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:27.528066 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e7796-e0cf-4f44-96d7-6a76cad8138b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:27.528777 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e7796-e0cf-4f44-96d7-6a76cad8138b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:27.529460 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e7796-e0cf-4f44-96d7-6a76cad8138b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:27.529772 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e7796-e0cf-4f44-96d7-6a76cad8138b admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:27.530619 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e7796-e0cf-4f44-96d7-6a76cad8138b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:27.530953 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e7796-e0cf-4f44-96d7-6a76cad8138b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:27.532770 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e7796-e0cf-4f44-96d7-6a76cad8138b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:27.546414 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 600/1202] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:27.552315 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c784a-af5d-4f83-9a2d-41c28a75cfab admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:27.565658 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c784a-af5d-4f83-9a2d-41c28a75cfab admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:27.571753 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508b7ff-6433-432d-b73e-05b0309896a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:27.572541 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508b7ff-6433-432d-b73e-05b0309896a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:27.572909 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508b7ff-6433-432d-b73e-05b0309896a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:27.573229 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508b7ff-6433-432d-b73e-05b0309896a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:27.574010 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508b7ff-6433-432d-b73e-05b0309896a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:27.576894 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508b7ff-6433-432d-b73e-05b0309896a1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:27.604429 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 603/1203] 10.222.0.75 () {60 vars in 1153 bytes} [Wed Feb 16 05:23:27 2022] POST /identity/v3/users => generated 251 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:23:30.297538 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbd2f2-0302-4d0c-94b5-6ada491601b8 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:30.298087 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbd2f2-0302-4d0c-94b5-6ada491601b8 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:30.298209 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbd2f2-0302-4d0c-94b5-6ada491601b8 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:30.300180 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 601/1204] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:23:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:23:30.306620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdce98-cc8a-4f76-be62-6c57a1195d23 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:30.307099 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdce98-cc8a-4f76-be62-6c57a1195d23 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:30.307182 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdce98-cc8a-4f76-be62-6c57a1195d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:30.325857 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d5cdce98-cc8a-4f76-be62-6c57a1195d23 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:23:30.327043 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d5cdce98-cc8a-4f76-be62-6c57a1195d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:23:30.335388 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 604/1205] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:23:30 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:23:30.359651 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbd2f2-0302-4d0c-94b5-6ada491601b8 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:30.372890 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbd2f2-0302-4d0c-94b5-6ada491601b8 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:30.377490 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e5262-06f2-4d5e-b595-7a63dde1786b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:30.378242 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e5262-06f2-4d5e-b595-7a63dde1786b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:30.378519 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e5262-06f2-4d5e-b595-7a63dde1786b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:30.378780 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e5262-06f2-4d5e-b595-7a63dde1786b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:30.389539 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e5262-06f2-4d5e-b595-7a63dde1786b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:23:30.396312 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-6f7e5262-06f2-4d5e-b595-7a63dde1786b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 05:23:30.397523 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 602/1206] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:23:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:30.403700 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdce98-cc8a-4f76-be62-6c57a1195d23 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:30.416168 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdce98-cc8a-4f76-be62-6c57a1195d23 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:30.421345 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27924b-603a-4c20-800b-5ca066e374fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:30.422008 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27924b-603a-4c20-800b-5ca066e374fe admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:30.422282 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27924b-603a-4c20-800b-5ca066e374fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:30.422590 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27924b-603a-4c20-800b-5ca066e374fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:30.423434 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27924b-603a-4c20-800b-5ca066e374fe admin admin] RBAC: Adding query filter params (name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:30.423755 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27924b-603a-4c20-800b-5ca066e374fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:30.425564 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27924b-603a-4c20-800b-5ca066e374fe admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:30.437306 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 605/1207] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Feb 16 05:23:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:30.442087 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e5262-06f2-4d5e-b595-7a63dde1786b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:30.452096 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e5262-06f2-4d5e-b595-7a63dde1786b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:30.456903 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abeae71-ec9d-45e0-a113-cd9d6e5f932f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:30.457788 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abeae71-ec9d-45e0-a113-cd9d6e5f932f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:30.458015 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abeae71-ec9d-45e0-a113-cd9d6e5f932f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:30.458266 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abeae71-ec9d-45e0-a113-cd9d6e5f932f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:30.473289 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abeae71-ec9d-45e0-a113-cd9d6e5f932f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:30.475121 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abeae71-ec9d-45e0-a113-cd9d6e5f932f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:30.494147 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-3abeae71-ec9d-45e0-a113-cd9d6e5f932f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:23:30.495681 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 603/1208] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:30.501874 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27924b-603a-4c20-800b-5ca066e374fe admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:30.512686 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27924b-603a-4c20-800b-5ca066e374fe admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:30.517946 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839ad73-af10-4cb6-8dec-ded882e219d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:30.518713 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839ad73-af10-4cb6-8dec-ded882e219d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:30.519076 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839ad73-af10-4cb6-8dec-ded882e219d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:30.519398 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839ad73-af10-4cb6-8dec-ded882e219d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:30.520208 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839ad73-af10-4cb6-8dec-ded882e219d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:30.520580 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839ad73-af10-4cb6-8dec-ded882e219d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:30.522303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839ad73-af10-4cb6-8dec-ded882e219d7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:30.536714 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 606/1209] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:30.543273 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abeae71-ec9d-45e0-a113-cd9d6e5f932f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:30.553740 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abeae71-ec9d-45e0-a113-cd9d6e5f932f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:30.559471 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98c092-e4ce-4ad6-a5a0-f352f019dc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:30.569388 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98c092-e4ce-4ad6-a5a0-f352f019dc24 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:30.569388 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98c092-e4ce-4ad6-a5a0-f352f019dc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:30.569388 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98c092-e4ce-4ad6-a5a0-f352f019dc24 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:30.569388 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98c092-e4ce-4ad6-a5a0-f352f019dc24 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:30.570692 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98c092-e4ce-4ad6-a5a0-f352f019dc24 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:30.588135 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-9b98c092-e4ce-4ad6-a5a0-f352f019dc24 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 05:23:30.589634 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 604/1210] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:23:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:30.595639 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839ad73-af10-4cb6-8dec-ded882e219d7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:30.609221 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839ad73-af10-4cb6-8dec-ded882e219d7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:30.614162 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa31aaa-162b-4253-9d6b-0edb7370648b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:30.614891 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa31aaa-162b-4253-9d6b-0edb7370648b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:30.615165 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa31aaa-162b-4253-9d6b-0edb7370648b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:30.615462 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa31aaa-162b-4253-9d6b-0edb7370648b admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:30.616401 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa31aaa-162b-4253-9d6b-0edb7370648b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:30.616779 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa31aaa-162b-4253-9d6b-0edb7370648b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:30.618796 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa31aaa-162b-4253-9d6b-0edb7370648b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:30.643721 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 607/1211] 10.222.0.75 () {56 vars in 1164 bytes} [Wed Feb 16 05:23:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:23:30.646075 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98c092-e4ce-4ad6-a5a0-f352f019dc24 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:30.657623 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98c092-e4ce-4ad6-a5a0-f352f019dc24 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:30.663052 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f343d-18f0-435d-9294-3dda8b31f544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:30.664320 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f343d-18f0-435d-9294-3dda8b31f544 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:30.664617 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f343d-18f0-435d-9294-3dda8b31f544 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:30.664926 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f343d-18f0-435d-9294-3dda8b31f544 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:30.678845 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f343d-18f0-435d-9294-3dda8b31f544 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:30.680613 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f343d-18f0-435d-9294-3dda8b31f544 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:30.689931 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 605/1212] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:23:30 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:23:30.695815 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa31aaa-162b-4253-9d6b-0edb7370648b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:30.705772 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa31aaa-162b-4253-9d6b-0edb7370648b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:30.719667 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986d59f-7d81-4e0e-95c2-f34797f6a100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:30.720922 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986d59f-7d81-4e0e-95c2-f34797f6a100 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:30.721503 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986d59f-7d81-4e0e-95c2-f34797f6a100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:30.721931 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986d59f-7d81-4e0e-95c2-f34797f6a100 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:30.735740 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986d59f-7d81-4e0e-95c2-f34797f6a100 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:30.737787 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986d59f-7d81-4e0e-95c2-f34797f6a100 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:30.756690 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-6986d59f-7d81-4e0e-95c2-f34797f6a100 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:23:30.758239 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 608/1213] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:30.764264 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f343d-18f0-435d-9294-3dda8b31f544 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:30.774376 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f343d-18f0-435d-9294-3dda8b31f544 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:30.779520 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e45e1-3a38-4f60-9192-c8e97f2c3831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:30.780259 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e45e1-3a38-4f60-9192-c8e97f2c3831 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:30.780566 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e45e1-3a38-4f60-9192-c8e97f2c3831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:30.780833 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e45e1-3a38-4f60-9192-c8e97f2c3831 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:30.781671 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e45e1-3a38-4f60-9192-c8e97f2c3831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:30.782706 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e45e1-3a38-4f60-9192-c8e97f2c3831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:30.784003 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e45e1-3a38-4f60-9192-c8e97f2c3831 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:30.797121 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 606/1214] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:30.804018 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986d59f-7d81-4e0e-95c2-f34797f6a100 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:30.814668 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986d59f-7d81-4e0e-95c2-f34797f6a100 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:30.820419 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f606c-5a46-4232-824b-8a03a62902bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:30.821306 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f606c-5a46-4232-824b-8a03a62902bb admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:30.821569 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f606c-5a46-4232-824b-8a03a62902bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:30.822432 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f606c-5a46-4232-824b-8a03a62902bb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:30.829394 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f606c-5a46-4232-824b-8a03a62902bb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:30.831368 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f606c-5a46-4232-824b-8a03a62902bb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:30.844973 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-da8f606c-5a46-4232-824b-8a03a62902bb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:23:30.846179 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 609/1215] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:23:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:30.852569 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e45e1-3a38-4f60-9192-c8e97f2c3831 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:30.863539 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e45e1-3a38-4f60-9192-c8e97f2c3831 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:30.868404 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ca979-e658-4627-84fb-b79cebdac24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:30.869048 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ca979-e658-4627-84fb-b79cebdac24e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:30.869363 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ca979-e658-4627-84fb-b79cebdac24e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:30.869634 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ca979-e658-4627-84fb-b79cebdac24e admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:30.870584 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ca979-e658-4627-84fb-b79cebdac24e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:30.870901 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ca979-e658-4627-84fb-b79cebdac24e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:30.872782 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ca979-e658-4627-84fb-b79cebdac24e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:30.885788 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 607/1216] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:23:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:30.891860 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f606c-5a46-4232-824b-8a03a62902bb admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:30.903649 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f606c-5a46-4232-824b-8a03a62902bb admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:30.908390 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b56389-d9a2-49cb-be78-fdfcc02381b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:30.909022 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b56389-d9a2-49cb-be78-fdfcc02381b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:30.909332 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b56389-d9a2-49cb-be78-fdfcc02381b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:30.909605 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b56389-d9a2-49cb-be78-fdfcc02381b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:30.910460 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b56389-d9a2-49cb-be78-fdfcc02381b4 admin admin] RBAC: Adding query filter params (role.id=0660c2b0286b42c78d66c437b4713a2f, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=cc233f62146a49099216c6236fb2ee2d) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:30.910754 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b56389-d9a2-49cb-be78-fdfcc02381b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:30.912593 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b56389-d9a2-49cb-be78-fdfcc02381b4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:30.918824 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 610/1217] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:23:30 2022] GET /identity/v3/role_assignments?user.id=cc233f62146a49099216c6236fb2ee2d&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=0660c2b0286b42c78d66c437b4713a2f => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:33.274015 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d6bf7-c793-406c-9137-238ee0cbbdf3 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:33.274571 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d6bf7-c793-406c-9137-238ee0cbbdf3 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:33.274571 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d6bf7-c793-406c-9137-238ee0cbbdf3 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:33.276690 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 608/1218] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:23:33.282237 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efff26-659f-4d4a-9408-dd031d0ee553 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:33.282716 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efff26-659f-4d4a-9408-dd031d0ee553 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:33.282820 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efff26-659f-4d4a-9408-dd031d0ee553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:33.300421 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-06efff26-659f-4d4a-9408-dd031d0ee553 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:23:33.301700 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-06efff26-659f-4d4a-9408-dd031d0ee553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:23:33.313298 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 611/1219] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:23:33 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:23:33.343506 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d6bf7-c793-406c-9137-238ee0cbbdf3 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:33.356728 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d6bf7-c793-406c-9137-238ee0cbbdf3 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:33.361591 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec57148-fae2-44fa-aaf1-1bf9ce69150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:33.362368 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec57148-fae2-44fa-aaf1-1bf9ce69150a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:33.362641 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec57148-fae2-44fa-aaf1-1bf9ce69150a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:33.362905 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec57148-fae2-44fa-aaf1-1bf9ce69150a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:33.374451 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec57148-fae2-44fa-aaf1-1bf9ce69150a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:23:33.381205 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-1ec57148-fae2-44fa-aaf1-1bf9ce69150a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 05:23:33.385326 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 609/1220] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:23:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:33.394725 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efff26-659f-4d4a-9408-dd031d0ee553 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:33.404901 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efff26-659f-4d4a-9408-dd031d0ee553 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:33.409774 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac83bf-a7f2-4c56-bafc-3e846146ffae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:33.410425 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac83bf-a7f2-4c56-bafc-3e846146ffae admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:33.410701 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac83bf-a7f2-4c56-bafc-3e846146ffae admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:33.410972 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac83bf-a7f2-4c56-bafc-3e846146ffae admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:33.411721 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac83bf-a7f2-4c56-bafc-3e846146ffae admin admin] RBAC: Adding query filter params (name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:33.412016 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac83bf-a7f2-4c56-bafc-3e846146ffae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:33.413679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac83bf-a7f2-4c56-bafc-3e846146ffae admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:33.422666 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 612/1221] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Feb 16 05:23:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:33.429919 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec57148-fae2-44fa-aaf1-1bf9ce69150a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:33.441121 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec57148-fae2-44fa-aaf1-1bf9ce69150a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:33.446159 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6b33a-c2cb-4cce-9215-ebb08a3b74ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:33.446919 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6b33a-c2cb-4cce-9215-ebb08a3b74ae admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:33.447191 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6b33a-c2cb-4cce-9215-ebb08a3b74ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:33.447463 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6b33a-c2cb-4cce-9215-ebb08a3b74ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:33.459970 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6b33a-c2cb-4cce-9215-ebb08a3b74ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:33.461925 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6b33a-c2cb-4cce-9215-ebb08a3b74ae admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:33.481017 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-61e6b33a-c2cb-4cce-9215-ebb08a3b74ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:23:33.482256 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 610/1222] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:23:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:33.488604 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac83bf-a7f2-4c56-bafc-3e846146ffae admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:33.501081 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac83bf-a7f2-4c56-bafc-3e846146ffae admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:33.508194 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e621d5-7825-4d18-a370-a516a3704d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:33.510107 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e621d5-7825-4d18-a370-a516a3704d37 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:33.510107 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e621d5-7825-4d18-a370-a516a3704d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:33.510107 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e621d5-7825-4d18-a370-a516a3704d37 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:33.510851 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e621d5-7825-4d18-a370-a516a3704d37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:33.511253 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e621d5-7825-4d18-a370-a516a3704d37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:33.513114 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e621d5-7825-4d18-a370-a516a3704d37 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:33.527113 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 613/1223] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:33.533548 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6b33a-c2cb-4cce-9215-ebb08a3b74ae admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:33.544119 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6b33a-c2cb-4cce-9215-ebb08a3b74ae admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:33.549386 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7241f0b-f680-4afa-9cda-770d2baa385c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:33.550445 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7241f0b-f680-4afa-9cda-770d2baa385c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:33.550723 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7241f0b-f680-4afa-9cda-770d2baa385c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:33.550990 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7241f0b-f680-4afa-9cda-770d2baa385c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:33.560206 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7241f0b-f680-4afa-9cda-770d2baa385c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:33.562540 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7241f0b-f680-4afa-9cda-770d2baa385c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:33.577592 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-d7241f0b-f680-4afa-9cda-770d2baa385c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 05:23:33.578752 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 611/1224] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:23:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:33.585309 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e621d5-7825-4d18-a370-a516a3704d37 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:33.596446 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e621d5-7825-4d18-a370-a516a3704d37 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:33.602403 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199bd49-bf26-434a-88b4-83823688550f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:33.603296 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199bd49-bf26-434a-88b4-83823688550f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:33.603631 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199bd49-bf26-434a-88b4-83823688550f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:33.603904 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199bd49-bf26-434a-88b4-83823688550f admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:33.604924 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199bd49-bf26-434a-88b4-83823688550f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:33.605311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199bd49-bf26-434a-88b4-83823688550f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:33.607847 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199bd49-bf26-434a-88b4-83823688550f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:33.629757 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 614/1225] 10.222.0.75 () {56 vars in 1164 bytes} [Wed Feb 16 05:23:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:33.635873 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7241f0b-f680-4afa-9cda-770d2baa385c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:33.646791 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7241f0b-f680-4afa-9cda-770d2baa385c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:33.651742 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5baa86-b5c4-42d5-b668-ab4386318783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:33.652534 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5baa86-b5c4-42d5-b668-ab4386318783 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:33.652797 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5baa86-b5c4-42d5-b668-ab4386318783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:33.653086 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5baa86-b5c4-42d5-b668-ab4386318783 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:33.666490 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5baa86-b5c4-42d5-b668-ab4386318783 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:33.667692 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5baa86-b5c4-42d5-b668-ab4386318783 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:33.691319 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-4f5baa86-b5c4-42d5-b668-ab4386318783 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:23:33.693287 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 612/1226] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:23:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:33.699223 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199bd49-bf26-434a-88b4-83823688550f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:33.709562 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199bd49-bf26-434a-88b4-83823688550f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:33.715099 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9afbd-203f-4e8d-9c4d-189ad1882b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:33.715262 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9afbd-203f-4e8d-9c4d-189ad1882b89 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:33.715660 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9afbd-203f-4e8d-9c4d-189ad1882b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:33.716023 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9afbd-203f-4e8d-9c4d-189ad1882b89 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:33.716857 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9afbd-203f-4e8d-9c4d-189ad1882b89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:33.717278 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9afbd-203f-4e8d-9c4d-189ad1882b89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:33.720328 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9afbd-203f-4e8d-9c4d-189ad1882b89 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:33.732201 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 615/1227] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:33.737675 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5baa86-b5c4-42d5-b668-ab4386318783 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:33.749660 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5baa86-b5c4-42d5-b668-ab4386318783 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:33.754645 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f1024-8111-40de-9916-1a777df312f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:33.755639 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f1024-8111-40de-9916-1a777df312f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:33.756114 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f1024-8111-40de-9916-1a777df312f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:33.756627 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f1024-8111-40de-9916-1a777df312f4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:33.764740 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f1024-8111-40de-9916-1a777df312f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:33.767042 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f1024-8111-40de-9916-1a777df312f4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:33.781530 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-1a5f1024-8111-40de-9916-1a777df312f4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:23:33.782985 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 613/1228] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:23:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:23:33.788594 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9afbd-203f-4e8d-9c4d-189ad1882b89 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:33.798024 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9afbd-203f-4e8d-9c4d-189ad1882b89 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:33.802554 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30ff8d-f7c0-4dd1-b0fc-38ae4916dab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:33.803575 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30ff8d-f7c0-4dd1-b0fc-38ae4916dab3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:33.804363 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30ff8d-f7c0-4dd1-b0fc-38ae4916dab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:33.804638 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30ff8d-f7c0-4dd1-b0fc-38ae4916dab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:33.805602 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30ff8d-f7c0-4dd1-b0fc-38ae4916dab3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:33.805905 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30ff8d-f7c0-4dd1-b0fc-38ae4916dab3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:33.808027 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f30ff8d-f7c0-4dd1-b0fc-38ae4916dab3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:33.822389 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 616/1229] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:23:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:33.829070 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f1024-8111-40de-9916-1a777df312f4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:33.841251 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f1024-8111-40de-9916-1a777df312f4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:33.847298 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20b42ce-b546-430e-b342-8f2b1eca95d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:33.848685 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b42ce-b546-430e-b342-8f2b1eca95d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:33.849202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b42ce-b546-430e-b342-8f2b1eca95d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:33.849785 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b42ce-b546-430e-b342-8f2b1eca95d0 admin admin] PATH_INFO: `/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/cc233f62146a49099216c6236fb2ee2d/roles/0660c2b0286b42c78d66c437b4713a2f` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:33.867121 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b42ce-b546-430e-b342-8f2b1eca95d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4d0b5a3f7d4542a47a26e623500b4f, user_id=cc233f62146a49099216c6236fb2ee2d, role_id=0660c2b0286b42c78d66c437b4713a2f)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:33.870699 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20b42ce-b546-430e-b342-8f2b1eca95d0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:33.884839 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 614/1230] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:23:33 2022] PUT /identity/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/cc233f62146a49099216c6236fb2ee2d/roles/0660c2b0286b42c78d66c437b4713a2f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:23:36.216358 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168962f0-f61e-4738-95b0-97caf9c29fab None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:36.216907 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168962f0-f61e-4738-95b0-97caf9c29fab None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:36.216907 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168962f0-f61e-4738-95b0-97caf9c29fab None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:36.218721 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 617/1231] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:23:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:23:36.224956 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8b511-b408-4f00-85dd-4eeaf6a7d625 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:36.225994 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8b511-b408-4f00-85dd-4eeaf6a7d625 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:36.226148 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8b511-b408-4f00-85dd-4eeaf6a7d625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:36.246115 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-60e8b511-b408-4f00-85dd-4eeaf6a7d625 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:23:36.247528 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-60e8b511-b408-4f00-85dd-4eeaf6a7d625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:23:36.310468 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 615/1232] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:23:36 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:23:36.334035 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168962f0-f61e-4738-95b0-97caf9c29fab None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:36.348101 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168962f0-f61e-4738-95b0-97caf9c29fab None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:36.353220 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e362b-4634-44b0-9415-e607624e3e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:36.354022 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e362b-4634-44b0-9415-e607624e3e92 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:36.354297 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e362b-4634-44b0-9415-e607624e3e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:36.354574 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e362b-4634-44b0-9415-e607624e3e92 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:36.365907 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e362b-4634-44b0-9415-e607624e3e92 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:23:36.374243 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-cd6e362b-4634-44b0-9415-e607624e3e92 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 16 05:23:36.375561 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 618/1233] 10.222.0.75 () {56 vars in 1123 bytes} [Wed Feb 16 05:23:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:36.382212 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8b511-b408-4f00-85dd-4eeaf6a7d625 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:36.391893 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8b511-b408-4f00-85dd-4eeaf6a7d625 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:36.397018 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514a399-f7a2-43c5-9384-2aea379c683a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:36.397766 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514a399-f7a2-43c5-9384-2aea379c683a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:36.398092 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514a399-f7a2-43c5-9384-2aea379c683a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:36.398366 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514a399-f7a2-43c5-9384-2aea379c683a admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:36.399226 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514a399-f7a2-43c5-9384-2aea379c683a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:36.399531 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514a399-f7a2-43c5-9384-2aea379c683a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:36.401307 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514a399-f7a2-43c5-9384-2aea379c683a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:36.410166 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 616/1234] 10.222.0.75 () {56 vars in 1124 bytes} [Wed Feb 16 05:23:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:36.416302 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e362b-4634-44b0-9415-e607624e3e92 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:36.426533 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e362b-4634-44b0-9415-e607624e3e92 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:36.432513 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fb8ba-0b4e-4989-a9f9-607b440a14f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:36.433304 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fb8ba-0b4e-4989-a9f9-607b440a14f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:36.433583 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fb8ba-0b4e-4989-a9f9-607b440a14f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:36.433848 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fb8ba-0b4e-4989-a9f9-607b440a14f3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:36.444278 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fb8ba-0b4e-4989-a9f9-607b440a14f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:36.446151 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fb8ba-0b4e-4989-a9f9-607b440a14f3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:36.463756 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-e72fb8ba-0b4e-4989-a9f9-607b440a14f3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:23:36.464949 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 619/1235] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:36.470918 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514a399-f7a2-43c5-9384-2aea379c683a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:36.481689 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514a399-f7a2-43c5-9384-2aea379c683a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:36.486909 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d5b7b-82ea-4910-905f-57924f0ed5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:36.487610 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d5b7b-82ea-4910-905f-57924f0ed5dd admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:36.487860 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d5b7b-82ea-4910-905f-57924f0ed5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:36.488130 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d5b7b-82ea-4910-905f-57924f0ed5dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:36.488861 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d5b7b-82ea-4910-905f-57924f0ed5dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:36.489164 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d5b7b-82ea-4910-905f-57924f0ed5dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:36.490821 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d5b7b-82ea-4910-905f-57924f0ed5dd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:36.506035 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 617/1236] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:36.511824 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fb8ba-0b4e-4989-a9f9-607b440a14f3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:36.521571 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fb8ba-0b4e-4989-a9f9-607b440a14f3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:36.527050 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83e463-c1b7-4c11-80d3-89d78b01c64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:36.527915 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83e463-c1b7-4c11-80d3-89d78b01c64d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:36.528256 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83e463-c1b7-4c11-80d3-89d78b01c64d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:36.528624 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83e463-c1b7-4c11-80d3-89d78b01c64d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:36.536430 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83e463-c1b7-4c11-80d3-89d78b01c64d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:36.539072 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83e463-c1b7-4c11-80d3-89d78b01c64d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:36.553050 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-8b83e463-c1b7-4c11-80d3-89d78b01c64d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 05:23:36.554760 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 620/1237] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:23:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:36.560298 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d5b7b-82ea-4910-905f-57924f0ed5dd admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:36.569956 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d5b7b-82ea-4910-905f-57924f0ed5dd admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:36.574394 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf637f93-54da-4466-a237-7b070276c328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:36.575052 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf637f93-54da-4466-a237-7b070276c328 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:36.575311 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf637f93-54da-4466-a237-7b070276c328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:36.575580 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf637f93-54da-4466-a237-7b070276c328 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:36.576412 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf637f93-54da-4466-a237-7b070276c328 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:36.576713 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf637f93-54da-4466-a237-7b070276c328 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:36.578606 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf637f93-54da-4466-a237-7b070276c328 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:36.596267 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 618/1238] 10.222.0.75 () {56 vars in 1164 bytes} [Wed Feb 16 05:23:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:36.602589 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83e463-c1b7-4c11-80d3-89d78b01c64d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:36.612723 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83e463-c1b7-4c11-80d3-89d78b01c64d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:36.617451 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460e7c4-4ffc-496b-b57c-df4f16e453ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:36.618077 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460e7c4-4ffc-496b-b57c-df4f16e453ff admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:36.618354 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460e7c4-4ffc-496b-b57c-df4f16e453ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:36.618626 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460e7c4-4ffc-496b-b57c-df4f16e453ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:36.627531 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460e7c4-4ffc-496b-b57c-df4f16e453ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:36.629638 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460e7c4-4ffc-496b-b57c-df4f16e453ff admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:36.640358 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 621/1239] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:23:36 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:23:36.646495 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf637f93-54da-4466-a237-7b070276c328 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:36.657369 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf637f93-54da-4466-a237-7b070276c328 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:36.663595 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34f24c-bca4-415e-a0f2-de5bb0583681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:36.664730 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34f24c-bca4-415e-a0f2-de5bb0583681 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:36.668288 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34f24c-bca4-415e-a0f2-de5bb0583681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:36.668288 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34f24c-bca4-415e-a0f2-de5bb0583681 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:36.677176 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34f24c-bca4-415e-a0f2-de5bb0583681 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:36.679370 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34f24c-bca4-415e-a0f2-de5bb0583681 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:36.695747 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-fb34f24c-bca4-415e-a0f2-de5bb0583681 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:23:36.696913 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 619/1240] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:36.707249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460e7c4-4ffc-496b-b57c-df4f16e453ff admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:36.712667 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460e7c4-4ffc-496b-b57c-df4f16e453ff admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:36.717959 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2caa6-070d-44c1-957c-db5049979a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:36.718598 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2caa6-070d-44c1-957c-db5049979a7f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:36.718883 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2caa6-070d-44c1-957c-db5049979a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:36.719198 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2caa6-070d-44c1-957c-db5049979a7f admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:36.720008 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2caa6-070d-44c1-957c-db5049979a7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:36.725371 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2caa6-070d-44c1-957c-db5049979a7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:36.725371 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2caa6-070d-44c1-957c-db5049979a7f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:36.734703 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 622/1241] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:36.740452 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34f24c-bca4-415e-a0f2-de5bb0583681 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:36.751221 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34f24c-bca4-415e-a0f2-de5bb0583681 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:36.756201 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382875a4-27e9-4b72-adf7-257d7e342539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:36.756992 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382875a4-27e9-4b72-adf7-257d7e342539 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:36.757322 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382875a4-27e9-4b72-adf7-257d7e342539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:36.757596 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382875a4-27e9-4b72-adf7-257d7e342539 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:36.765003 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382875a4-27e9-4b72-adf7-257d7e342539 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:36.767172 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382875a4-27e9-4b72-adf7-257d7e342539 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:36.781683 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-382875a4-27e9-4b72-adf7-257d7e342539 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:23:36.783031 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 620/1242] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:23:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:36.790033 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2caa6-070d-44c1-957c-db5049979a7f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:36.800729 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2caa6-070d-44c1-957c-db5049979a7f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:36.806057 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4210eb-6af6-4eaa-87cf-b0854a469109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:36.806707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4210eb-6af6-4eaa-87cf-b0854a469109 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:36.806983 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4210eb-6af6-4eaa-87cf-b0854a469109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:36.807254 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4210eb-6af6-4eaa-87cf-b0854a469109 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:36.808167 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4210eb-6af6-4eaa-87cf-b0854a469109 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:36.808546 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4210eb-6af6-4eaa-87cf-b0854a469109 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:36.810619 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4210eb-6af6-4eaa-87cf-b0854a469109 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:36.824803 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 623/1243] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:23:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:36.831432 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382875a4-27e9-4b72-adf7-257d7e342539 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:36.844022 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382875a4-27e9-4b72-adf7-257d7e342539 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:36.848987 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61116a97-d114-4ee5-aa15-a863bd670cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:36.849631 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61116a97-d114-4ee5-aa15-a863bd670cbe admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:36.849908 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61116a97-d114-4ee5-aa15-a863bd670cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:36.850240 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61116a97-d114-4ee5-aa15-a863bd670cbe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:36.851295 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61116a97-d114-4ee5-aa15-a863bd670cbe admin admin] RBAC: Adding query filter params (role.id=0660c2b0286b42c78d66c437b4713a2f, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=cc233f62146a49099216c6236fb2ee2d) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:36.851655 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61116a97-d114-4ee5-aa15-a863bd670cbe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:36.853815 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61116a97-d114-4ee5-aa15-a863bd670cbe admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:36.860352 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 621/1244] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:23:36 2022] GET /identity/v3/role_assignments?user.id=cc233f62146a49099216c6236fb2ee2d&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=0660c2b0286b42c78d66c437b4713a2f => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:39.313707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163727cd-d104-459d-a7a6-42ad0a6f0780 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:39.314265 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163727cd-d104-459d-a7a6-42ad0a6f0780 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:39.314265 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163727cd-d104-459d-a7a6-42ad0a6f0780 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:39.316096 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 624/1245] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:23:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:23:39.322275 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21b89d-dd56-4e8f-ae3b-31d50fa86e77 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:39.322759 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21b89d-dd56-4e8f-ae3b-31d50fa86e77 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:39.322866 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21b89d-dd56-4e8f-ae3b-31d50fa86e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:39.340574 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-3f21b89d-dd56-4e8f-ae3b-31d50fa86e77 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:23:39.341788 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3f21b89d-dd56-4e8f-ae3b-31d50fa86e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:23:39.349664 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 622/1246] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:23:39 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:23:39.374598 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163727cd-d104-459d-a7a6-42ad0a6f0780 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:39.387267 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163727cd-d104-459d-a7a6-42ad0a6f0780 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:39.392093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f321d-c394-4cf8-aa82-33e6446f7c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:39.392867 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f321d-c394-4cf8-aa82-33e6446f7c54 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:39.393148 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f321d-c394-4cf8-aa82-33e6446f7c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:39.393449 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f321d-c394-4cf8-aa82-33e6446f7c54 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:39.405634 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f321d-c394-4cf8-aa82-33e6446f7c54 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:23:39.412447 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-1f6f321d-c394-4cf8-aa82-33e6446f7c54 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:23:39.414293 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 625/1247] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:23:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:39.423248 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21b89d-dd56-4e8f-ae3b-31d50fa86e77 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:39.434278 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21b89d-dd56-4e8f-ae3b-31d50fa86e77 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:39.439011 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12d3bf-9993-42d1-9c0c-746252a30918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:39.439659 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12d3bf-9993-42d1-9c0c-746252a30918 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:39.439937 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12d3bf-9993-42d1-9c0c-746252a30918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:39.440204 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12d3bf-9993-42d1-9c0c-746252a30918 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:39.440949 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12d3bf-9993-42d1-9c0c-746252a30918 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:39.441339 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12d3bf-9993-42d1-9c0c-746252a30918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:39.442905 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12d3bf-9993-42d1-9c0c-746252a30918 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:39.452007 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 623/1248] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:23:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:23:39.457949 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f321d-c394-4cf8-aa82-33e6446f7c54 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:39.469829 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f321d-c394-4cf8-aa82-33e6446f7c54 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:39.474528 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b04675-9756-45e0-aff3-94ba82842b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:39.475298 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b04675-9756-45e0-aff3-94ba82842b71 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:39.476511 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b04675-9756-45e0-aff3-94ba82842b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:39.476821 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b04675-9756-45e0-aff3-94ba82842b71 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:39.488377 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b04675-9756-45e0-aff3-94ba82842b71 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:39.490714 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b04675-9756-45e0-aff3-94ba82842b71 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:39.508226 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-81b04675-9756-45e0-aff3-94ba82842b71 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:23:39.509788 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 626/1249] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:23:39.516198 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12d3bf-9993-42d1-9c0c-746252a30918 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:39.527247 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12d3bf-9993-42d1-9c0c-746252a30918 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:39.532823 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d80d6-b122-4470-98b3-419d13e8a5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:39.533810 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d80d6-b122-4470-98b3-419d13e8a5df admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:39.534134 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d80d6-b122-4470-98b3-419d13e8a5df admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:39.534628 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d80d6-b122-4470-98b3-419d13e8a5df admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:39.535612 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d80d6-b122-4470-98b3-419d13e8a5df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:39.536079 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d80d6-b122-4470-98b3-419d13e8a5df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:39.538681 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d80d6-b122-4470-98b3-419d13e8a5df admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:39.554022 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 624/1250] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:39.559658 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b04675-9756-45e0-aff3-94ba82842b71 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:39.570597 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b04675-9756-45e0-aff3-94ba82842b71 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:39.575041 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c716c5-da11-4f63-9282-32913955e348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:39.575819 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c716c5-da11-4f63-9282-32913955e348 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:39.576098 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c716c5-da11-4f63-9282-32913955e348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:39.576369 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c716c5-da11-4f63-9282-32913955e348 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:39.583617 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c716c5-da11-4f63-9282-32913955e348 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:39.586157 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c716c5-da11-4f63-9282-32913955e348 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:39.601897 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-76c716c5-da11-4f63-9282-32913955e348 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 05:23:39.603052 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 627/1251] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:23:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 16 05:23:39.609225 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d80d6-b122-4470-98b3-419d13e8a5df admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:39.621425 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d80d6-b122-4470-98b3-419d13e8a5df admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:39.627348 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee68cf1-9f45-4d3f-82bb-fdb31f1534cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:39.628228 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee68cf1-9f45-4d3f-82bb-fdb31f1534cf admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:39.628557 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee68cf1-9f45-4d3f-82bb-fdb31f1534cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:39.628888 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee68cf1-9f45-4d3f-82bb-fdb31f1534cf admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:39.629925 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee68cf1-9f45-4d3f-82bb-fdb31f1534cf admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:39.630280 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee68cf1-9f45-4d3f-82bb-fdb31f1534cf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:39.632649 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee68cf1-9f45-4d3f-82bb-fdb31f1534cf admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:39.659825 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 625/1252] 10.222.0.75 () {56 vars in 1164 bytes} [Wed Feb 16 05:23:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:39.661397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c716c5-da11-4f63-9282-32913955e348 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:39.672759 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c716c5-da11-4f63-9282-32913955e348 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:39.677424 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904782d-13bc-481d-a09a-409e2092dfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:39.678061 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904782d-13bc-481d-a09a-409e2092dfde admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:39.678628 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904782d-13bc-481d-a09a-409e2092dfde admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:39.678911 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904782d-13bc-481d-a09a-409e2092dfde admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:39.687062 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904782d-13bc-481d-a09a-409e2092dfde admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:39.688716 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904782d-13bc-481d-a09a-409e2092dfde admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:39.697522 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 628/1253] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:23:39 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:23:39.703403 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee68cf1-9f45-4d3f-82bb-fdb31f1534cf admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:39.715341 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee68cf1-9f45-4d3f-82bb-fdb31f1534cf admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:39.720728 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c9dda-d56f-4b3a-b480-77780a4a5720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:39.721697 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c9dda-d56f-4b3a-b480-77780a4a5720 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:39.722110 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c9dda-d56f-4b3a-b480-77780a4a5720 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:39.722589 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c9dda-d56f-4b3a-b480-77780a4a5720 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:39.735328 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c9dda-d56f-4b3a-b480-77780a4a5720 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:39.737753 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c9dda-d56f-4b3a-b480-77780a4a5720 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:39.757450 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-075c9dda-d56f-4b3a-b480-77780a4a5720 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:23:39.759021 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 626/1254] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:39.765908 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904782d-13bc-481d-a09a-409e2092dfde admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:39.777025 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904782d-13bc-481d-a09a-409e2092dfde admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:39.782940 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14430f-01ec-42f9-9ea6-963707351e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:39.783601 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14430f-01ec-42f9-9ea6-963707351e48 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:39.783889 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14430f-01ec-42f9-9ea6-963707351e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:39.784165 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14430f-01ec-42f9-9ea6-963707351e48 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:39.784890 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14430f-01ec-42f9-9ea6-963707351e48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:39.785197 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14430f-01ec-42f9-9ea6-963707351e48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:39.786975 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14430f-01ec-42f9-9ea6-963707351e48 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:39.801510 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 629/1255] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:39.809043 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c9dda-d56f-4b3a-b480-77780a4a5720 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:39.820566 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c9dda-d56f-4b3a-b480-77780a4a5720 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:39.828412 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0811b-6061-47da-a429-6bbc6d4a07a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:39.829160 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0811b-6061-47da-a429-6bbc6d4a07a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:39.829489 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0811b-6061-47da-a429-6bbc6d4a07a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:39.829775 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0811b-6061-47da-a429-6bbc6d4a07a5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:39.837689 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0811b-6061-47da-a429-6bbc6d4a07a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:39.839795 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0811b-6061-47da-a429-6bbc6d4a07a5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:39.852858 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-d7a0811b-6061-47da-a429-6bbc6d4a07a5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:23:39.854229 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 627/1256] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:23:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:39.860079 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14430f-01ec-42f9-9ea6-963707351e48 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:39.870141 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14430f-01ec-42f9-9ea6-963707351e48 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:39.874717 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9685107-0cf8-4cbe-948b-453c2137fe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:39.875352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9685107-0cf8-4cbe-948b-453c2137fe9e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:39.875630 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9685107-0cf8-4cbe-948b-453c2137fe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:39.875912 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9685107-0cf8-4cbe-948b-453c2137fe9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:39.876670 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9685107-0cf8-4cbe-948b-453c2137fe9e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:39.877021 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9685107-0cf8-4cbe-948b-453c2137fe9e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:39.879038 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9685107-0cf8-4cbe-948b-453c2137fe9e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:39.892517 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 630/1257] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:23:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:39.899442 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0811b-6061-47da-a429-6bbc6d4a07a5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:39.911021 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0811b-6061-47da-a429-6bbc6d4a07a5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:39.916395 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bac102-2849-455a-99d5-ffa02e059f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:39.917017 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bac102-2849-455a-99d5-ffa02e059f22 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:39.917323 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bac102-2849-455a-99d5-ffa02e059f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:39.917597 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bac102-2849-455a-99d5-ffa02e059f22 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:39.918446 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bac102-2849-455a-99d5-ffa02e059f22 admin admin] RBAC: Adding query filter params (role.id=9ba4a5967ed243178927661616f08901, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=cc233f62146a49099216c6236fb2ee2d) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:39.918856 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bac102-2849-455a-99d5-ffa02e059f22 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:39.920777 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bac102-2849-455a-99d5-ffa02e059f22 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:39.927723 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 628/1258] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:23:39 2022] GET /identity/v3/role_assignments?user.id=cc233f62146a49099216c6236fb2ee2d&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=9ba4a5967ed243178927661616f08901 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:42.385360 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8295b-6a89-4266-b3d4-e9d907798526 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:42.385937 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8295b-6a89-4266-b3d4-e9d907798526 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:42.385937 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8295b-6a89-4266-b3d4-e9d907798526 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:42.387825 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 631/1259] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:23:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:23:42.394009 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cb6d1-af47-403e-a9ad-a00841dab8e5 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:42.394454 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cb6d1-af47-403e-a9ad-a00841dab8e5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:42.394632 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cb6d1-af47-403e-a9ad-a00841dab8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:42.412296 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-b67cb6d1-af47-403e-a9ad-a00841dab8e5 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:23:42.413706 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b67cb6d1-af47-403e-a9ad-a00841dab8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:23:42.422492 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 629/1260] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:23:42 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:23:42.448427 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8295b-6a89-4266-b3d4-e9d907798526 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:42.461547 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8295b-6a89-4266-b3d4-e9d907798526 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:42.466565 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a18da-0f25-494b-b381-1c7a624ceb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:42.467342 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a18da-0f25-494b-b381-1c7a624ceb7c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:42.467647 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a18da-0f25-494b-b381-1c7a624ceb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:42.467916 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a18da-0f25-494b-b381-1c7a624ceb7c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:42.479186 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a18da-0f25-494b-b381-1c7a624ceb7c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:23:42.485966 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-543a18da-0f25-494b-b381-1c7a624ceb7c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:23:42.487155 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 632/1261] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:23:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:42.493649 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cb6d1-af47-403e-a9ad-a00841dab8e5 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:42.503477 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cb6d1-af47-403e-a9ad-a00841dab8e5 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:42.508990 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e4743-5a0f-46b5-b570-5ccb6c4bbd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:42.509824 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e4743-5a0f-46b5-b570-5ccb6c4bbd08 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:42.510169 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e4743-5a0f-46b5-b570-5ccb6c4bbd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:42.510541 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e4743-5a0f-46b5-b570-5ccb6c4bbd08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:42.511390 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e4743-5a0f-46b5-b570-5ccb6c4bbd08 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:42.511696 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e4743-5a0f-46b5-b570-5ccb6c4bbd08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:42.513478 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e4743-5a0f-46b5-b570-5ccb6c4bbd08 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:42.522571 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 630/1262] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:23:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:42.528876 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a18da-0f25-494b-b381-1c7a624ceb7c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:42.540923 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a18da-0f25-494b-b381-1c7a624ceb7c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:42.545814 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a7d49-5b85-4667-9cbc-e2f02d5b7c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:42.546582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a7d49-5b85-4667-9cbc-e2f02d5b7c9d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:42.546867 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a7d49-5b85-4667-9cbc-e2f02d5b7c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:42.547137 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a7d49-5b85-4667-9cbc-e2f02d5b7c9d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:42.560750 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a7d49-5b85-4667-9cbc-e2f02d5b7c9d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:42.562757 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a7d49-5b85-4667-9cbc-e2f02d5b7c9d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:42.582793 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-d19a7d49-5b85-4667-9cbc-e2f02d5b7c9d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:23:42.584148 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 633/1263] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:42.591419 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e4743-5a0f-46b5-b570-5ccb6c4bbd08 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:42.602325 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e4743-5a0f-46b5-b570-5ccb6c4bbd08 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:42.607028 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52db65-504e-4ec2-bb73-03560abb5894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:42.607670 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52db65-504e-4ec2-bb73-03560abb5894 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:42.607946 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52db65-504e-4ec2-bb73-03560abb5894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:42.608211 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52db65-504e-4ec2-bb73-03560abb5894 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:42.608929 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52db65-504e-4ec2-bb73-03560abb5894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:42.609250 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52db65-504e-4ec2-bb73-03560abb5894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:42.610859 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee52db65-504e-4ec2-bb73-03560abb5894 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:42.626071 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 631/1264] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:42.632971 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a7d49-5b85-4667-9cbc-e2f02d5b7c9d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:42.643949 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a7d49-5b85-4667-9cbc-e2f02d5b7c9d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:42.650438 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677b059-e6eb-468f-aca2-9ff609a8b4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:42.651281 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677b059-e6eb-468f-aca2-9ff609a8b4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:42.651710 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677b059-e6eb-468f-aca2-9ff609a8b4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:42.652117 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677b059-e6eb-468f-aca2-9ff609a8b4a2 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:42.661078 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677b059-e6eb-468f-aca2-9ff609a8b4a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:42.663193 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677b059-e6eb-468f-aca2-9ff609a8b4a2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:42.682231 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-f677b059-e6eb-468f-aca2-9ff609a8b4a2 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 05:23:42.683865 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 634/1265] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:23:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:42.690802 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52db65-504e-4ec2-bb73-03560abb5894 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:42.703266 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52db65-504e-4ec2-bb73-03560abb5894 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:42.708246 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab2add-522e-4109-adcb-23499af54b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:42.708897 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab2add-522e-4109-adcb-23499af54b21 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:42.709169 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab2add-522e-4109-adcb-23499af54b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:42.709462 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab2add-522e-4109-adcb-23499af54b21 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:42.710905 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab2add-522e-4109-adcb-23499af54b21 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:42.711204 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab2add-522e-4109-adcb-23499af54b21 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:42.713070 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab2add-522e-4109-adcb-23499af54b21 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:42.732481 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 632/1266] 10.222.0.75 () {56 vars in 1164 bytes} [Wed Feb 16 05:23:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:42.738253 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677b059-e6eb-468f-aca2-9ff609a8b4a2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:42.750003 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677b059-e6eb-468f-aca2-9ff609a8b4a2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:42.755342 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55fcd6-1575-4c9d-843b-5bc3fcd183b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:42.756352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55fcd6-1575-4c9d-843b-5bc3fcd183b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:42.757323 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55fcd6-1575-4c9d-843b-5bc3fcd183b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:42.757623 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55fcd6-1575-4c9d-843b-5bc3fcd183b7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:42.769250 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55fcd6-1575-4c9d-843b-5bc3fcd183b7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:42.771228 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55fcd6-1575-4c9d-843b-5bc3fcd183b7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:42.789993 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-8c55fcd6-1575-4c9d-843b-5bc3fcd183b7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:23:42.791267 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 635/1267] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:42.797388 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab2add-522e-4109-adcb-23499af54b21 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:42.808347 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab2add-522e-4109-adcb-23499af54b21 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:42.813383 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e196c7-abad-42d1-86ee-8cf55f849818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:42.814044 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e196c7-abad-42d1-86ee-8cf55f849818 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:42.814372 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e196c7-abad-42d1-86ee-8cf55f849818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:42.814680 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e196c7-abad-42d1-86ee-8cf55f849818 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:42.815520 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e196c7-abad-42d1-86ee-8cf55f849818 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:42.815822 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e196c7-abad-42d1-86ee-8cf55f849818 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:42.817641 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e196c7-abad-42d1-86ee-8cf55f849818 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:42.829955 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 633/1268] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:42.836461 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55fcd6-1575-4c9d-843b-5bc3fcd183b7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:42.846786 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55fcd6-1575-4c9d-843b-5bc3fcd183b7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:42.853000 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f13992-5cfa-40e3-856e-3bad7f5638cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:42.853890 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f13992-5cfa-40e3-856e-3bad7f5638cf admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:42.854222 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f13992-5cfa-40e3-856e-3bad7f5638cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:42.854522 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f13992-5cfa-40e3-856e-3bad7f5638cf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:42.862119 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f13992-5cfa-40e3-856e-3bad7f5638cf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:42.864460 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f13992-5cfa-40e3-856e-3bad7f5638cf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:42.880023 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-61f13992-5cfa-40e3-856e-3bad7f5638cf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:23:42.881406 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 636/1269] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:23:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:42.887993 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e196c7-abad-42d1-86ee-8cf55f849818 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:42.899002 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e196c7-abad-42d1-86ee-8cf55f849818 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:42.904022 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ad978-ee7b-46bc-9017-8662cf3c5b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:42.904682 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ad978-ee7b-46bc-9017-8662cf3c5b2c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:42.905047 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ad978-ee7b-46bc-9017-8662cf3c5b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:42.905356 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ad978-ee7b-46bc-9017-8662cf3c5b2c admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:42.906303 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ad978-ee7b-46bc-9017-8662cf3c5b2c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:42.906613 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ad978-ee7b-46bc-9017-8662cf3c5b2c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:42.908482 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ad978-ee7b-46bc-9017-8662cf3c5b2c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:42.922121 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 634/1270] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:23:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:42.928053 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f13992-5cfa-40e3-856e-3bad7f5638cf admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:42.939164 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f13992-5cfa-40e3-856e-3bad7f5638cf admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:42.943924 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2562fd-5206-4155-bf9c-94789001d374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:42.945435 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2562fd-5206-4155-bf9c-94789001d374 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:42.945728 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2562fd-5206-4155-bf9c-94789001d374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:42.945978 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2562fd-5206-4155-bf9c-94789001d374 admin admin] PATH_INFO: `/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/cc233f62146a49099216c6236fb2ee2d/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:42.947965 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2562fd-5206-4155-bf9c-94789001d374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c4d0b5a3f7d4542a47a26e623500b4f, user_id=cc233f62146a49099216c6236fb2ee2d, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:42.950621 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2562fd-5206-4155-bf9c-94789001d374 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:42.963107 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 637/1271] 10.222.0.75 () {58 vars in 1460 bytes} [Wed Feb 16 05:23:42 2022] PUT /identity/v3/projects/6c4d0b5a3f7d4542a47a26e623500b4f/users/cc233f62146a49099216c6236fb2ee2d/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:23:45.494517 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96c460-398d-4522-b4e2-a31ae9100047 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:45.495160 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96c460-398d-4522-b4e2-a31ae9100047 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:45.495160 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96c460-398d-4522-b4e2-a31ae9100047 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:45.496802 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 635/1272] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:23:45.502383 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcb053-3d84-4bf9-ace8-9f5ee2d5fce7 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:45.502877 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcb053-3d84-4bf9-ace8-9f5ee2d5fce7 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:45.502982 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcb053-3d84-4bf9-ace8-9f5ee2d5fce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:45.521297 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d9bcb053-3d84-4bf9-ace8-9f5ee2d5fce7 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:23:45.523281 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d9bcb053-3d84-4bf9-ace8-9f5ee2d5fce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:23:45.585287 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 638/1273] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:23:45 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:23:45.609458 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96c460-398d-4522-b4e2-a31ae9100047 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:45.622296 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96c460-398d-4522-b4e2-a31ae9100047 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:45.628503 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fea1c-44af-4ddc-b719-143ee6f885a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:45.629502 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fea1c-44af-4ddc-b719-143ee6f885a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:45.629791 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fea1c-44af-4ddc-b719-143ee6f885a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:45.630174 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fea1c-44af-4ddc-b719-143ee6f885a2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:45.643416 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4fea1c-44af-4ddc-b719-143ee6f885a2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 16 05:23:45.651901 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-7b4fea1c-44af-4ddc-b719-143ee6f885a2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 16 05:23:45.653238 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 636/1274] 10.222.0.75 () {56 vars in 1117 bytes} [Wed Feb 16 05:23:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:45.660722 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcb053-3d84-4bf9-ace8-9f5ee2d5fce7 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:45.672782 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcb053-3d84-4bf9-ace8-9f5ee2d5fce7 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:45.679170 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3892f-08d8-4edd-9e58-f30c0284f538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:45.679898 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3892f-08d8-4edd-9e58-f30c0284f538 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:45.680250 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3892f-08d8-4edd-9e58-f30c0284f538 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:45.680582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3892f-08d8-4edd-9e58-f30c0284f538 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:45.681566 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3892f-08d8-4edd-9e58-f30c0284f538 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:45.681872 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3892f-08d8-4edd-9e58-f30c0284f538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:45.683476 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e3892f-08d8-4edd-9e58-f30c0284f538 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:45.694395 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 639/1275] 10.222.0.75 () {56 vars in 1120 bytes} [Wed Feb 16 05:23:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:45.700711 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fea1c-44af-4ddc-b719-143ee6f885a2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:45.711177 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fea1c-44af-4ddc-b719-143ee6f885a2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:45.718268 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaa4b1-d624-466c-85ce-2742baa39011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:45.719040 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaa4b1-d624-466c-85ce-2742baa39011 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:45.719373 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaa4b1-d624-466c-85ce-2742baa39011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:45.719618 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccaa4b1-d624-466c-85ce-2742baa39011 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:45.731233 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccaa4b1-d624-466c-85ce-2742baa39011 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:45.733092 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccaa4b1-d624-466c-85ce-2742baa39011 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:45.752268 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-8ccaa4b1-d624-466c-85ce-2742baa39011 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:23:45.753412 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 637/1276] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:23:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:45.759335 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3892f-08d8-4edd-9e58-f30c0284f538 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:45.769001 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e3892f-08d8-4edd-9e58-f30c0284f538 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:45.773647 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7bf87-2a61-498d-826e-2f80e799b5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:45.774285 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7bf87-2a61-498d-826e-2f80e799b5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:45.774566 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7bf87-2a61-498d-826e-2f80e799b5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:45.774840 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7bf87-2a61-498d-826e-2f80e799b5d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:45.775560 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7bf87-2a61-498d-826e-2f80e799b5d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:45.775867 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7bf87-2a61-498d-826e-2f80e799b5d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:45.777494 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb7bf87-2a61-498d-826e-2f80e799b5d2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:45.789917 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 640/1277] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:45.795537 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaa4b1-d624-466c-85ce-2742baa39011 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:45.806144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccaa4b1-d624-466c-85ce-2742baa39011 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:45.810741 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a85405-ed8d-41f3-a3a4-cebc42085b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:45.811517 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a85405-ed8d-41f3-a3a4-cebc42085b8f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:45.811796 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a85405-ed8d-41f3-a3a4-cebc42085b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:45.812067 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a85405-ed8d-41f3-a3a4-cebc42085b8f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:45.820951 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a85405-ed8d-41f3-a3a4-cebc42085b8f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:45.822997 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a85405-ed8d-41f3-a3a4-cebc42085b8f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:45.836725 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-c7a85405-ed8d-41f3-a3a4-cebc42085b8f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 16 05:23:45.838179 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 638/1278] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:23:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:45.843880 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7bf87-2a61-498d-826e-2f80e799b5d2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:45.855057 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7bf87-2a61-498d-826e-2f80e799b5d2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:45.859633 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7274d-135b-4660-9b42-1dbae4758ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:45.860278 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7274d-135b-4660-9b42-1dbae4758ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:45.860552 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7274d-135b-4660-9b42-1dbae4758ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:45.860817 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7274d-135b-4660-9b42-1dbae4758ad9 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:45.861685 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7274d-135b-4660-9b42-1dbae4758ad9 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:45.861985 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7274d-135b-4660-9b42-1dbae4758ad9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:45.863813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7274d-135b-4660-9b42-1dbae4758ad9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:45.881063 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 641/1279] 10.222.0.75 () {56 vars in 1164 bytes} [Wed Feb 16 05:23:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:45.886800 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a85405-ed8d-41f3-a3a4-cebc42085b8f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:45.896461 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a85405-ed8d-41f3-a3a4-cebc42085b8f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:45.901424 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f283af9-9e17-4f13-98b1-09ebd95e0557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:45.902038 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f283af9-9e17-4f13-98b1-09ebd95e0557 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:45.902313 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f283af9-9e17-4f13-98b1-09ebd95e0557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:45.902580 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f283af9-9e17-4f13-98b1-09ebd95e0557 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:45.909983 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f283af9-9e17-4f13-98b1-09ebd95e0557 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:45.911717 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f283af9-9e17-4f13-98b1-09ebd95e0557 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:45.920755 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 639/1280] 10.222.0.75 () {58 vars in 1324 bytes} [Wed Feb 16 05:23:45 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:23:45.926235 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7274d-135b-4660-9b42-1dbae4758ad9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:45.935967 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7274d-135b-4660-9b42-1dbae4758ad9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:45.940436 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85f3c5-5c94-4145-9208-7390a04774bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:45.941195 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85f3c5-5c94-4145-9208-7390a04774bd admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:45.941508 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85f3c5-5c94-4145-9208-7390a04774bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:45.941782 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c85f3c5-5c94-4145-9208-7390a04774bd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:45.951979 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85f3c5-5c94-4145-9208-7390a04774bd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:45.953854 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c85f3c5-5c94-4145-9208-7390a04774bd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:45.970718 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-1c85f3c5-5c94-4145-9208-7390a04774bd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 16 05:23:45.971842 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 642/1281] 10.222.0.75 () {56 vars in 1129 bytes} [Wed Feb 16 05:23:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:45.977988 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f283af9-9e17-4f13-98b1-09ebd95e0557 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:45.986527 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f283af9-9e17-4f13-98b1-09ebd95e0557 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:45.990989 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d63df-aeeb-4ccd-a5f7-7491744ce939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:45.991609 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d63df-aeeb-4ccd-a5f7-7491744ce939 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:45.991884 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d63df-aeeb-4ccd-a5f7-7491744ce939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:45.992151 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d63df-aeeb-4ccd-a5f7-7491744ce939 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:45.992852 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d63df-aeeb-4ccd-a5f7-7491744ce939 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:45.993149 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d63df-aeeb-4ccd-a5f7-7491744ce939 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:45.994742 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d63df-aeeb-4ccd-a5f7-7491744ce939 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:46.006205 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 640/1282] 10.222.0.75 () {56 vars in 1130 bytes} [Wed Feb 16 05:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:46.011647 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85f3c5-5c94-4145-9208-7390a04774bd admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:46.020968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c85f3c5-5c94-4145-9208-7390a04774bd admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:46.026107 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac48973-5e87-4952-b37f-1080b519cb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:46.026855 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac48973-5e87-4952-b37f-1080b519cb63 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:46.027133 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac48973-5e87-4952-b37f-1080b519cb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:46.027400 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac48973-5e87-4952-b37f-1080b519cb63 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:46.034127 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac48973-5e87-4952-b37f-1080b519cb63 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:46.036045 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac48973-5e87-4952-b37f-1080b519cb63 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:46.049233 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING keystone.server.flask.application [None req-2ac48973-5e87-4952-b37f-1080b519cb63 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 16 05:23:46.050352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 643/1283] 10.222.0.75 () {56 vars in 1132 bytes} [Wed Feb 16 05:23:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:46.056006 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d63df-aeeb-4ccd-a5f7-7491744ce939 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:46.065378 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d63df-aeeb-4ccd-a5f7-7491744ce939 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:46.069803 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cfc44-4b0f-4c97-be92-071058632c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:46.070413 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cfc44-4b0f-4c97-be92-071058632c7b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:46.070690 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cfc44-4b0f-4c97-be92-071058632c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:46.070956 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cfc44-4b0f-4c97-be92-071058632c7b admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:46.071721 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cfc44-4b0f-4c97-be92-071058632c7b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:46.072044 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cfc44-4b0f-4c97-be92-071058632c7b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:46.073959 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cfc44-4b0f-4c97-be92-071058632c7b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:46.086069 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 641/1284] 10.222.0.75 () {56 vars in 1169 bytes} [Wed Feb 16 05:23:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:23:46.091443 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac48973-5e87-4952-b37f-1080b519cb63 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:46.101841 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac48973-5e87-4952-b37f-1080b519cb63 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:46.106241 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151465f-8532-41d5-a228-ecf7163773ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:46.106834 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151465f-8532-41d5-a228-ecf7163773ab admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:46.107110 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151465f-8532-41d5-a228-ecf7163773ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:46.107377 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151465f-8532-41d5-a228-ecf7163773ab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:46.108183 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151465f-8532-41d5-a228-ecf7163773ab admin admin] RBAC: Adding query filter params (role.id=9ba4a5967ed243178927661616f08901, scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f, user.id=cc233f62146a49099216c6236fb2ee2d) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:46.108482 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151465f-8532-41d5-a228-ecf7163773ab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:46.110306 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151465f-8532-41d5-a228-ecf7163773ab admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:46.115802 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 644/1285] 10.222.0.75 () {56 vars in 1395 bytes} [Wed Feb 16 05:23:46 2022] GET /identity/v3/role_assignments?user.id=cc233f62146a49099216c6236fb2ee2d&scope.project.id=6c4d0b5a3f7d4542a47a26e623500b4f&role.id=9ba4a5967ed243178927661616f08901 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:23:48.440902 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c942caa-59db-4fee-9bdd-b111dc99131e None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:48.441476 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c942caa-59db-4fee-9bdd-b111dc99131e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:48.441476 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c942caa-59db-4fee-9bdd-b111dc99131e None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:48.443268 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 642/1286] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:23:48.448885 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a04d8c-e908-453b-9592-3da713cc170e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:48.449275 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a04d8c-e908-453b-9592-3da713cc170e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:48.449465 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a04d8c-e908-453b-9592-3da713cc170e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:48.466320 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-01a04d8c-e908-453b-9592-3da713cc170e None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:23:48.467505 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-01a04d8c-e908-453b-9592-3da713cc170e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:23:48.475698 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 645/1287] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:23:48 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:23:48.498104 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c942caa-59db-4fee-9bdd-b111dc99131e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:48.510044 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c942caa-59db-4fee-9bdd-b111dc99131e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:48.514361 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3529c-e1ba-45c6-bf89-c616b4227e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:48.515119 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3529c-e1ba-45c6-bf89-c616b4227e03 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:48.515395 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3529c-e1ba-45c6-bf89-c616b4227e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:48.515662 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3529c-e1ba-45c6-bf89-c616b4227e03 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:48.516302 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3529c-e1ba-45c6-bf89-c616b4227e03 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:48.517976 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3529c-e1ba-45c6-bf89-c616b4227e03 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:48.528670 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-f7a3529c-e1ba-45c6-bf89-c616b4227e03 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 16 05:23:48.529789 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 643/1288] 10.222.0.75 () {56 vars in 1138 bytes} [Wed Feb 16 05:23:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:48.535180 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a04d8c-e908-453b-9592-3da713cc170e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:48.544334 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a04d8c-e908-453b-9592-3da713cc170e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:48.548754 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5cc76-903b-46ed-965e-97c71ae10fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:48.549415 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5cc76-903b-46ed-965e-97c71ae10fea admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:48.549694 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5cc76-903b-46ed-965e-97c71ae10fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:48.549962 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5cc76-903b-46ed-965e-97c71ae10fea admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:48.550648 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5cc76-903b-46ed-965e-97c71ae10fea admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:48.550969 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5cc76-903b-46ed-965e-97c71ae10fea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:48.552523 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5cc76-903b-46ed-965e-97c71ae10fea admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:48.558013 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 646/1289] 10.222.0.75 () {56 vars in 1137 bytes} [Wed Feb 16 05:23:48 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:48.563302 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3529c-e1ba-45c6-bf89-c616b4227e03 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:48.572545 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3529c-e1ba-45c6-bf89-c616b4227e03 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:48.576977 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026dde41-727f-4042-9fe6-04ad064a40b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:48.577613 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dde41-727f-4042-9fe6-04ad064a40b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:48.577896 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dde41-727f-4042-9fe6-04ad064a40b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:48.578170 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dde41-727f-4042-9fe6-04ad064a40b2 admin admin] PATH_INFO: `/v3/services` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:48.578888 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026dde41-727f-4042-9fe6-04ad064a40b2 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:48.579190 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026dde41-727f-4042-9fe6-04ad064a40b2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:48.580732 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026dde41-727f-4042-9fe6-04ad064a40b2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:48.584980 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 644/1290] 10.222.0.75 () {56 vars in 1137 bytes} [Wed Feb 16 05:23:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:50.843097 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302bab8-d6d1-4da9-bf7c-43e9e3a9fe7b None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:50.843606 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302bab8-d6d1-4da9-bf7c-43e9e3a9fe7b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:50.843726 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302bab8-d6d1-4da9-bf7c-43e9e3a9fe7b None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:50.845441 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 647/1291] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:23:50.850978 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63516ab-5193-4b80-88ad-b0e3a51ef6b5 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:50.851381 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63516ab-5193-4b80-88ad-b0e3a51ef6b5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:50.851509 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63516ab-5193-4b80-88ad-b0e3a51ef6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:50.869339 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-b63516ab-5193-4b80-88ad-b0e3a51ef6b5 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:23:50.870494 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b63516ab-5193-4b80-88ad-b0e3a51ef6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:23:50.877896 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 645/1292] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:23:50 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:23:50.899970 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302bab8-d6d1-4da9-bf7c-43e9e3a9fe7b None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:50.911783 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302bab8-d6d1-4da9-bf7c-43e9e3a9fe7b None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:50.916540 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1495f-bebf-45e3-b4cd-c7ec70b7cfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:50.917161 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1495f-bebf-45e3-b4cd-c7ec70b7cfa7 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:50.917461 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1495f-bebf-45e3-b4cd-c7ec70b7cfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:50.917731 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1495f-bebf-45e3-b4cd-c7ec70b7cfa7 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:50.918444 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1495f-bebf-45e3-b4cd-c7ec70b7cfa7 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:50.920006 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1495f-bebf-45e3-b4cd-c7ec70b7cfa7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:50.933361 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 648/1293] 10.222.0.75 () {60 vars in 1162 bytes} [Wed Feb 16 05:23:50 2022] POST /identity/v3/services => generated 246 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:23:53.221696 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248daaa5-0e59-406f-8b73-0d8f5f2a3aa1 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:53.222255 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248daaa5-0e59-406f-8b73-0d8f5f2a3aa1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:53.222255 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248daaa5-0e59-406f-8b73-0d8f5f2a3aa1 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:53.223985 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 646/1294] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:23:53.229093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfe517-a14a-41c4-89f9-939a79fa6238 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:53.229512 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfe517-a14a-41c4-89f9-939a79fa6238 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:53.229686 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfe517-a14a-41c4-89f9-939a79fa6238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:53.247024 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-edcfe517-a14a-41c4-89f9-939a79fa6238 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:23:53.248198 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-edcfe517-a14a-41c4-89f9-939a79fa6238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:23:53.265642 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 649/1295] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:23:53 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:23:53.289159 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248daaa5-0e59-406f-8b73-0d8f5f2a3aa1 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:53.301243 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248daaa5-0e59-406f-8b73-0d8f5f2a3aa1 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:53.306347 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39fab2-2a3d-48f2-a157-62e0f3b96ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:53.307106 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39fab2-2a3d-48f2-a157-62e0f3b96ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:53.307381 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39fab2-2a3d-48f2-a157-62e0f3b96ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:53.307646 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39fab2-2a3d-48f2-a157-62e0f3b96ad0 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:53.308286 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39fab2-2a3d-48f2-a157-62e0f3b96ad0 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:53.309934 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39fab2-2a3d-48f2-a157-62e0f3b96ad0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:53.321129 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-4a39fab2-2a3d-48f2-a157-62e0f3b96ad0 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 16 05:23:53.322284 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 647/1296] 10.222.0.75 () {56 vars in 1138 bytes} [Wed Feb 16 05:23:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:53.328131 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfe517-a14a-41c4-89f9-939a79fa6238 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:53.336799 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfe517-a14a-41c4-89f9-939a79fa6238 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:53.341323 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bfd82-a0e0-4d5c-ac15-5b63b9cd8d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:53.341952 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bfd82-a0e0-4d5c-ac15-5b63b9cd8d50 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:53.342231 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bfd82-a0e0-4d5c-ac15-5b63b9cd8d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:53.342510 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781bfd82-a0e0-4d5c-ac15-5b63b9cd8d50 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:53.343200 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781bfd82-a0e0-4d5c-ac15-5b63b9cd8d50 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:53.343503 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781bfd82-a0e0-4d5c-ac15-5b63b9cd8d50 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:53.345072 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781bfd82-a0e0-4d5c-ac15-5b63b9cd8d50 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:53.350046 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 650/1297] 10.222.0.75 () {56 vars in 1137 bytes} [Wed Feb 16 05:23:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:53.355366 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39fab2-2a3d-48f2-a157-62e0f3b96ad0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:53.364621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39fab2-2a3d-48f2-a157-62e0f3b96ad0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:53.369567 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0b25c-b875-407c-9a06-bbc65785ff87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:53.370166 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0b25c-b875-407c-9a06-bbc65785ff87 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:53.370444 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0b25c-b875-407c-9a06-bbc65785ff87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:53.370715 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0b25c-b875-407c-9a06-bbc65785ff87 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:53.371481 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0b25c-b875-407c-9a06-bbc65785ff87 admin admin] RBAC: Adding query filter params (interface=public, service_id=d61a3237a91945c1bbf36bef458c6372, region_id=RegionOne) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:53.371786 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0b25c-b875-407c-9a06-bbc65785ff87 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:53.373368 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0b25c-b875-407c-9a06-bbc65785ff87 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:53.378159 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 648/1298] 10.222.0.75 () {56 vars in 1272 bytes} [Wed Feb 16 05:23:53 2022] GET /identity/v3/endpoints?service_id=d61a3237a91945c1bbf36bef458c6372&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:53.383876 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bfd82-a0e0-4d5c-ac15-5b63b9cd8d50 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:53.392903 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781bfd82-a0e0-4d5c-ac15-5b63b9cd8d50 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:53.397464 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e6f36a-6b89-4332-9531-ee3ce899afd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:53.398070 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6f36a-6b89-4332-9531-ee3ce899afd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:53.398351 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6f36a-6b89-4332-9531-ee3ce899afd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:53.398627 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6f36a-6b89-4332-9531-ee3ce899afd9 admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:53.399280 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6f36a-6b89-4332-9531-ee3ce899afd9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:53.400803 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e6f36a-6b89-4332-9531-ee3ce899afd9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:53.407287 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 651/1299] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Feb 16 05:23:53 2022] GET /identity/v3/services => generated 2191 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:23:55.733802 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c52676-4536-471a-8e2d-1af44027c4b7 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:55.734304 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c52676-4536-471a-8e2d-1af44027c4b7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:55.734415 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c52676-4536-471a-8e2d-1af44027c4b7 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:55.736095 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 649/1300] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:23:55.741808 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414180f3-bef5-4ab6-9781-dbb3d520ffbf None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:55.742228 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414180f3-bef5-4ab6-9781-dbb3d520ffbf None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:55.742355 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414180f3-bef5-4ab6-9781-dbb3d520ffbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:55.760123 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-414180f3-bef5-4ab6-9781-dbb3d520ffbf None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:23:55.761322 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-414180f3-bef5-4ab6-9781-dbb3d520ffbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:23:55.768779 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 652/1301] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:23:55 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:23:55.791074 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c52676-4536-471a-8e2d-1af44027c4b7 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:55.803747 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c52676-4536-471a-8e2d-1af44027c4b7 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:55.808118 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cdb36-2c08-4bd4-8eaa-b2106ca6e4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:55.808872 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cdb36-2c08-4bd4-8eaa-b2106ca6e4bb admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:55.809150 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cdb36-2c08-4bd4-8eaa-b2106ca6e4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:55.809450 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cdb36-2c08-4bd4-8eaa-b2106ca6e4bb admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:55.810095 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cdb36-2c08-4bd4-8eaa-b2106ca6e4bb admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:55.811692 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cdb36-2c08-4bd4-8eaa-b2106ca6e4bb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:55.823020 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING keystone.server.flask.application [None req-705cdb36-2c08-4bd4-8eaa-b2106ca6e4bb admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 16 05:23:55.824105 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 650/1302] 10.222.0.75 () {56 vars in 1138 bytes} [Wed Feb 16 05:23:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 16 05:23:55.829505 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414180f3-bef5-4ab6-9781-dbb3d520ffbf None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:55.838178 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414180f3-bef5-4ab6-9781-dbb3d520ffbf None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:55.842621 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81494206-3dc8-45fd-a85c-6c23414d92fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:55.843248 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81494206-3dc8-45fd-a85c-6c23414d92fd admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:55.843524 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81494206-3dc8-45fd-a85c-6c23414d92fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:55.843794 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81494206-3dc8-45fd-a85c-6c23414d92fd admin admin] PATH_INFO: `/v3/services` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:55.844485 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81494206-3dc8-45fd-a85c-6c23414d92fd admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:23:55.844787 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81494206-3dc8-45fd-a85c-6c23414d92fd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:55.846387 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81494206-3dc8-45fd-a85c-6c23414d92fd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:55.851262 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 653/1303] 10.222.0.75 () {56 vars in 1137 bytes} [Wed Feb 16 05:23:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:23:55.856370 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cdb36-2c08-4bd4-8eaa-b2106ca6e4bb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:23:55.866692 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cdb36-2c08-4bd4-8eaa-b2106ca6e4bb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:23:55.871169 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d6634-9732-4633-a498-938cafb420f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:23:55.871746 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d6634-9732-4633-a498-938cafb420f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:23:55.872025 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d6634-9732-4633-a498-938cafb420f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:23:55.872297 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d6634-9732-4633-a498-938cafb420f7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:23:55.873012 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d6634-9732-4633-a498-938cafb420f7 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:23:55.874599 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d6634-9732-4633-a498-938cafb420f7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:23:55.892199 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 651/1304] 10.222.0.75 () {60 vars in 1165 bytes} [Wed Feb 16 05:23:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:24:59.044961 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a5676-3353-452a-94d0-55de0b2f267e None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:24:59.045481 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a5676-3353-452a-94d0-55de0b2f267e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:24:59.045583 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a5676-3353-452a-94d0-55de0b2f267e None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:24:59.047629 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 654/1305] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:24:59.053907 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb173b-63c9-4acf-aad0-a1dc799b4f28 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:24:59.055535 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb173b-63c9-4acf-aad0-a1dc799b4f28 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:24:59.056820 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb173b-63c9-4acf-aad0-a1dc799b4f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:24:59.159995 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-70fb173b-63c9-4acf-aad0-a1dc799b4f28 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:24:59.162099 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-70fb173b-63c9-4acf-aad0-a1dc799b4f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:24:59.285667 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 652/1306] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:24:59.295143 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a5676-3353-452a-94d0-55de0b2f267e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:24:59.296851 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-de0a5676-3353-452a-94d0-55de0b2f267e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:24:59.516651 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a5676-3353-452a-94d0-55de0b2f267e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:24:59.630969 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf3a77e-b0c6-4e11-a232-b66e1164ce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:24:59.631891 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3a77e-b0c6-4e11-a232-b66e1164ce9e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:24:59.632312 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3a77e-b0c6-4e11-a232-b66e1164ce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:24:59.632722 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3a77e-b0c6-4e11-a232-b66e1164ce9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:24:59.633864 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3a77e-b0c6-4e11-a232-b66e1164ce9e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:24:59.636425 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf3a77e-b0c6-4e11-a232-b66e1164ce9e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:24:59.657700 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 655/1307] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Feb 16 05:24:59 2022] GET /identity/v3/projects => generated 2553 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:25:02.061482 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c8804-7914-4c1f-b30b-443a31967296 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:02.061998 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c8804-7914-4c1f-b30b-443a31967296 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:02.062073 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c8804-7914-4c1f-b30b-443a31967296 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:02.063824 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 653/1308] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:25:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 05:25:02.069648 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb26038-4c40-4496-b650-4cfb219dde1f None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:02.070299 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb26038-4c40-4496-b650-4cfb219dde1f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:02.070299 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb26038-4c40-4496-b650-4cfb219dde1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:02.158323 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-acb26038-4c40-4496-b650-4cfb219dde1f None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:25:02.159552 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-acb26038-4c40-4496-b650-4cfb219dde1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:02.252966 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 656/1309] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:25:02.304808 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec92dce-0c9b-42d2-9645-45d1db01dfe9 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:02.305090 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec92dce-0c9b-42d2-9645-45d1db01dfe9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:02.305401 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec92dce-0c9b-42d2-9645-45d1db01dfe9 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:02.307202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 654/1310] 10.222.0.75 () {54 vars in 964 bytes} [Wed Feb 16 05:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:25:02.313492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7047f9d-242e-4186-bd5a-a9acf9df742e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:02.313777 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7047f9d-242e-4186-bd5a-a9acf9df742e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:02.314051 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7047f9d-242e-4186-bd5a-a9acf9df742e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:02.388296 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-e7047f9d-242e-4186-bd5a-a9acf9df742e None None] MFA Rules not processed for user `fd4eac62484c47988657d2a730f2d056`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:25:02.389520 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e7047f9d-242e-4186-bd5a-a9acf9df742e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:02.461411 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 657/1311] 10.222.0.75 () {58 vars in 1061 bytes} [Wed Feb 16 05:25:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:25:02.470526 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec92dce-0c9b-42d2-9645-45d1db01dfe9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:25:02.472205 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-1ec92dce-0c9b-42d2-9645-45d1db01dfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:02.575298 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec92dce-0c9b-42d2-9645-45d1db01dfe9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:25:02.646859 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a6b66-3436-46d0-a065-6e34b6516a2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:25:02.647585 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a6b66-3436-46d0-a065-6e34b6516a2e service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:02.647962 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a6b66-3436-46d0-a065-6e34b6516a2e service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:02.648306 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a6b66-3436-46d0-a065-6e34b6516a2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:02.650017 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-342a6b66-3436-46d0-a065-6e34b6516a2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:02.772228 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a6b66-3436-46d0-a065-6e34b6516a2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:25:02.773742 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a6b66-3436-46d0-a065-6e34b6516a2e service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:25:02.791517 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 655/1312] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:25:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:25:05.371224 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83d01c-2f83-4ff2-a743-5d7f1f9e6bf7 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:05.371654 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83d01c-2f83-4ff2-a743-5d7f1f9e6bf7 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:05.371826 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83d01c-2f83-4ff2-a743-5d7f1f9e6bf7 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:05.373564 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 658/1313] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:25:05.378653 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb38c9-8e9f-46cc-ab7f-b462d2f10f86 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:05.379017 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb38c9-8e9f-46cc-ab7f-b462d2f10f86 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:05.379199 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb38c9-8e9f-46cc-ab7f-b462d2f10f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:05.443063 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-fbeb38c9-8e9f-46cc-ab7f-b462d2f10f86 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:25:05.444243 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fbeb38c9-8e9f-46cc-ab7f-b462d2f10f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:05.534575 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 656/1314] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:25:05.573876 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83d01c-2f83-4ff2-a743-5d7f1f9e6bf7 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:25:05.575394 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2f83d01c-2f83-4ff2-a743-5d7f1f9e6bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:05.673970 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83d01c-2f83-4ff2-a743-5d7f1f9e6bf7 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:25:05.744575 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f164bb-c3a4-40a6-b8b1-f0c5a47c9a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:25:05.745222 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f164bb-c3a4-40a6-b8b1-f0c5a47c9a33 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:05.745550 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f164bb-c3a4-40a6-b8b1-f0c5a47c9a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:05.745824 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f164bb-c3a4-40a6-b8b1-f0c5a47c9a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:05.747466 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-03f164bb-c3a4-40a6-b8b1-f0c5a47c9a33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:05.851315 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f164bb-c3a4-40a6-b8b1-f0c5a47c9a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:25:05.852735 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f164bb-c3a4-40a6-b8b1-f0c5a47c9a33 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:25:05.869702 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 659/1315] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:25:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:25:08.455095 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cc77e-46fd-4170-9c14-c077a5301906 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:08.455619 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cc77e-46fd-4170-9c14-c077a5301906 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:08.455619 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cc77e-46fd-4170-9c14-c077a5301906 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:08.457429 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 657/1316] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:25:08.463176 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307c39d-7b92-43c6-8b63-43da40c436e3 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:08.463612 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307c39d-7b92-43c6-8b63-43da40c436e3 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:08.463729 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307c39d-7b92-43c6-8b63-43da40c436e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:08.526386 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-e307c39d-7b92-43c6-8b63-43da40c436e3 None None] MFA Rules not processed for user `0b70b6c41753412b8476b0e0d01f68b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:25:08.527599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e307c39d-7b92-43c6-8b63-43da40c436e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:08.620009 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 660/1317] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:25:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:25:08.661235 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cc77e-46fd-4170-9c14-c077a5301906 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:25:08.662764 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4b2cc77e-46fd-4170-9c14-c077a5301906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:08.760664 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cc77e-46fd-4170-9c14-c077a5301906 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:25:08.828939 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dc7ba-2d65-41ad-a6c9-a48e58c4ccfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:25:08.829597 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dc7ba-2d65-41ad-a6c9-a48e58c4ccfc service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:08.829874 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dc7ba-2d65-41ad-a6c9-a48e58c4ccfc service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:08.830142 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dc7ba-2d65-41ad-a6c9-a48e58c4ccfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:08.831747 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-953dc7ba-2d65-41ad-a6c9-a48e58c4ccfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:08.933895 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953dc7ba-2d65-41ad-a6c9-a48e58c4ccfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:25:08.935318 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953dc7ba-2d65-41ad-a6c9-a48e58c4ccfc service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:25:08.952684 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 658/1318] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:25:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:25:11.797747 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c090c0-1e79-4e87-8f0f-f3d00d295a29 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:11.798265 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c090c0-1e79-4e87-8f0f-f3d00d295a29 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:11.798372 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c090c0-1e79-4e87-8f0f-f3d00d295a29 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:11.800071 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 661/1319] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:25:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:25:11.805439 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb883b-838a-4d64-9298-9ca05822d4a6 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:11.805854 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb883b-838a-4d64-9298-9ca05822d4a6 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:11.805966 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afb883b-838a-4d64-9298-9ca05822d4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:11.867408 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-0afb883b-838a-4d64-9298-9ca05822d4a6 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:25:11.868587 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0afb883b-838a-4d64-9298-9ca05822d4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:11.960425 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 659/1320] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:25:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:25:11.998339 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c090c0-1e79-4e87-8f0f-f3d00d295a29 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:25:11.999899 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f7c090c0-1e79-4e87-8f0f-f3d00d295a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:12.097943 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c090c0-1e79-4e87-8f0f-f3d00d295a29 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:25:12.166888 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a09a0f-89f6-4175-a177-f9daf831acce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:25:12.167514 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a09a0f-89f6-4175-a177-f9daf831acce service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:12.167795 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a09a0f-89f6-4175-a177-f9daf831acce service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:12.168152 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a09a0f-89f6-4175-a177-f9daf831acce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:12.169782 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d7a09a0f-89f6-4175-a177-f9daf831acce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:12.275088 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a09a0f-89f6-4175-a177-f9daf831acce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:25:12.276437 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a09a0f-89f6-4175-a177-f9daf831acce service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:25:12.293453 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 662/1321] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:25:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:25:15.233209 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532ca72-da42-4727-8865-3bcebc5a6e73 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:15.233766 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532ca72-da42-4727-8865-3bcebc5a6e73 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:15.233766 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532ca72-da42-4727-8865-3bcebc5a6e73 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:15.235620 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 660/1322] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:25:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:25:15.241016 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31018ab5-ce9b-4304-93e6-15497975bcd0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:15.241478 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31018ab5-ce9b-4304-93e6-15497975bcd0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:15.241605 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31018ab5-ce9b-4304-93e6-15497975bcd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:15.305051 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-31018ab5-ce9b-4304-93e6-15497975bcd0 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:25:15.306277 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-31018ab5-ce9b-4304-93e6-15497975bcd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:15.399488 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 663/1323] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:25:15.434851 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532ca72-da42-4727-8865-3bcebc5a6e73 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:25:15.436446 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e532ca72-da42-4727-8865-3bcebc5a6e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:15.536681 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532ca72-da42-4727-8865-3bcebc5a6e73 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:25:15.607497 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585a3a5-c21c-46dc-95a8-0af1466bce50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:25:15.608131 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585a3a5-c21c-46dc-95a8-0af1466bce50 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:15.608406 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585a3a5-c21c-46dc-95a8-0af1466bce50 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:15.608675 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585a3a5-c21c-46dc-95a8-0af1466bce50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:15.610418 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6585a3a5-c21c-46dc-95a8-0af1466bce50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:15.717575 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585a3a5-c21c-46dc-95a8-0af1466bce50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:25:15.719064 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585a3a5-c21c-46dc-95a8-0af1466bce50 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:25:15.736560 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 661/1324] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:25:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:25:18.155270 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9658c-9cdf-47d8-90d6-15849f8f043d None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:18.155845 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9658c-9cdf-47d8-90d6-15849f8f043d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:18.155845 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9658c-9cdf-47d8-90d6-15849f8f043d None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:18.157597 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 664/1325] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:25:18.162765 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd55aae-91af-465e-9889-c3437ab3a2d1 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:18.163176 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd55aae-91af-465e-9889-c3437ab3a2d1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:18.163306 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd55aae-91af-465e-9889-c3437ab3a2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:18.226178 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-0bd55aae-91af-465e-9889-c3437ab3a2d1 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:25:18.227362 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0bd55aae-91af-465e-9889-c3437ab3a2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:18.320746 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 662/1326] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:25:18.357933 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9658c-9cdf-47d8-90d6-15849f8f043d None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:25:18.359472 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8ea9658c-9cdf-47d8-90d6-15849f8f043d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:18.458719 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9658c-9cdf-47d8-90d6-15849f8f043d None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:25:18.531283 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e0d9a-d76f-4ae8-ac08-6b40cfcd138d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:25:18.531923 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e0d9a-d76f-4ae8-ac08-6b40cfcd138d service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:18.532211 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e0d9a-d76f-4ae8-ac08-6b40cfcd138d service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:18.532520 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e0d9a-d76f-4ae8-ac08-6b40cfcd138d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:18.534175 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e14e0d9a-d76f-4ae8-ac08-6b40cfcd138d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:18.638560 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e0d9a-d76f-4ae8-ac08-6b40cfcd138d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:25:18.640025 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e0d9a-d76f-4ae8-ac08-6b40cfcd138d service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:25:18.657669 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 665/1327] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:25:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:25:20.989498 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c93002-fa78-4a8f-8c01-b2e7c5a75fa7 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:20.990022 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c93002-fa78-4a8f-8c01-b2e7c5a75fa7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:20.990022 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c93002-fa78-4a8f-8c01-b2e7c5a75fa7 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:20.991866 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 663/1328] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:25:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:25:20.996992 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbd97b-5d49-4695-bc52-68a68b3b445a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:20.997454 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbd97b-5d49-4695-bc52-68a68b3b445a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:20.997568 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbd97b-5d49-4695-bc52-68a68b3b445a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:21.061151 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-57fbd97b-5d49-4695-bc52-68a68b3b445a None None] MFA Rules not processed for user `0b70b6c41753412b8476b0e0d01f68b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:25:21.062361 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-57fbd97b-5d49-4695-bc52-68a68b3b445a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:21.157723 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 666/1329] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:25:20 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:25:21.195004 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c93002-fa78-4a8f-8c01-b2e7c5a75fa7 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:25:21.196594 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-56c93002-fa78-4a8f-8c01-b2e7c5a75fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:21.296339 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c93002-fa78-4a8f-8c01-b2e7c5a75fa7 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:25:21.367257 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb1a5a-906e-42ca-9a07-9d9e0db14c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:25:21.367901 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb1a5a-906e-42ca-9a07-9d9e0db14c83 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:21.368185 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb1a5a-906e-42ca-9a07-9d9e0db14c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:21.368453 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb1a5a-906e-42ca-9a07-9d9e0db14c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:21.370119 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-81bb1a5a-906e-42ca-9a07-9d9e0db14c83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:21.475006 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb1a5a-906e-42ca-9a07-9d9e0db14c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:25:21.476470 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb1a5a-906e-42ca-9a07-9d9e0db14c83 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:25:21.494254 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 664/1330] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:25:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:25:24.032553 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ff5df-ecc7-48c9-a4eb-be1efc2534fd None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:24.033086 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ff5df-ecc7-48c9-a4eb-be1efc2534fd None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:24.033086 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ff5df-ecc7-48c9-a4eb-be1efc2534fd None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:24.034907 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 667/1331] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:25:24.040160 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65fa7b-bf5e-4e25-b44f-6a91de5bc46b None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:24.040567 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65fa7b-bf5e-4e25-b44f-6a91de5bc46b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:24.040707 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65fa7b-bf5e-4e25-b44f-6a91de5bc46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:24.106234 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-6b65fa7b-bf5e-4e25-b44f-6a91de5bc46b None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:25:24.107366 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6b65fa7b-bf5e-4e25-b44f-6a91de5bc46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:24.205120 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 665/1332] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:25:24.241856 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ff5df-ecc7-48c9-a4eb-be1efc2534fd None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:25:24.243375 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-df3ff5df-ecc7-48c9-a4eb-be1efc2534fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:24.344869 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ff5df-ecc7-48c9-a4eb-be1efc2534fd None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:25:24.416954 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c8ebd5-ccd8-4991-9bd3-ed86488ca034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:25:24.417636 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8ebd5-ccd8-4991-9bd3-ed86488ca034 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:24.417922 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8ebd5-ccd8-4991-9bd3-ed86488ca034 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:24.418191 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c8ebd5-ccd8-4991-9bd3-ed86488ca034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:24.419851 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-88c8ebd5-ccd8-4991-9bd3-ed86488ca034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:24.538463 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8ebd5-ccd8-4991-9bd3-ed86488ca034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:25:24.539931 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c8ebd5-ccd8-4991-9bd3-ed86488ca034 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:25:24.558755 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 668/1333] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:25:26.901274 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe596e-060d-4543-afe9-dd3899648f52 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:26.901831 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe596e-060d-4543-afe9-dd3899648f52 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:26.901928 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe596e-060d-4543-afe9-dd3899648f52 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:26.903647 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 666/1334] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:25:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:25:26.908809 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968908c-8f69-47d2-8496-4e640d78e659 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:26.909232 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968908c-8f69-47d2-8496-4e640d78e659 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:26.909382 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968908c-8f69-47d2-8496-4e640d78e659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:26.972010 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-e968908c-8f69-47d2-8496-4e640d78e659 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:25:26.973722 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e968908c-8f69-47d2-8496-4e640d78e659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:27.065542 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 669/1335] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:25:27.122503 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e4ff5-ed9e-4e95-babc-162bf92e2ab5 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:27.122787 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e4ff5-ed9e-4e95-babc-162bf92e2ab5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:27.123056 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e4ff5-ed9e-4e95-babc-162bf92e2ab5 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:27.124814 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 667/1336] 10.222.0.75 () {54 vars in 964 bytes} [Wed Feb 16 05:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:25:27.131260 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef4866-35e4-4dc7-9dff-0ba9fe065f07 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:27.131547 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef4866-35e4-4dc7-9dff-0ba9fe065f07 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:27.131826 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef4866-35e4-4dc7-9dff-0ba9fe065f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:27.203463 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-edef4866-35e4-4dc7-9dff-0ba9fe065f07 None None] MFA Rules not processed for user `fd4eac62484c47988657d2a730f2d056`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:25:27.204656 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-edef4866-35e4-4dc7-9dff-0ba9fe065f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:27.276564 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 670/1337] 10.222.0.75 () {58 vars in 1061 bytes} [Wed Feb 16 05:25:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:25:27.285896 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e4ff5-ed9e-4e95-babc-162bf92e2ab5 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:25:27.287387 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-821e4ff5-ed9e-4e95-babc-162bf92e2ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:27.385245 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e4ff5-ed9e-4e95-babc-162bf92e2ab5 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:25:27.457652 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec7e94-0ab8-40b0-a649-a817946a4086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:25:27.458293 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec7e94-0ab8-40b0-a649-a817946a4086 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:27.458582 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec7e94-0ab8-40b0-a649-a817946a4086 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:27.458858 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec7e94-0ab8-40b0-a649-a817946a4086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:27.460493 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-03ec7e94-0ab8-40b0-a649-a817946a4086 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:27.567345 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec7e94-0ab8-40b0-a649-a817946a4086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:25:27.568799 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec7e94-0ab8-40b0-a649-a817946a4086 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:25:27.586569 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 668/1338] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:25:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:25:30.720091 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aa5e5-c48b-49a9-879e-e6ca581497c3 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:30.720598 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aa5e5-c48b-49a9-879e-e6ca581497c3 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:30.720708 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018aa5e5-c48b-49a9-879e-e6ca581497c3 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:30.722431 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 671/1339] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:25:30.728069 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bac904-7cbe-4a44-a855-aa1d9020279d None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:30.728490 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bac904-7cbe-4a44-a855-aa1d9020279d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:30.728596 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bac904-7cbe-4a44-a855-aa1d9020279d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:30.796520 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-d1bac904-7cbe-4a44-a855-aa1d9020279d None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:25:30.797717 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d1bac904-7cbe-4a44-a855-aa1d9020279d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:30.898703 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 669/1340] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:25:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:25:30.934931 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018aa5e5-c48b-49a9-879e-e6ca581497c3 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:25:30.937014 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-018aa5e5-c48b-49a9-879e-e6ca581497c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:31.026438 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018aa5e5-c48b-49a9-879e-e6ca581497c3 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:25:31.029918 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d6dc66-f6cf-4abd-9ff4-487c9ff98539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:25:31.030545 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6dc66-f6cf-4abd-9ff4-487c9ff98539 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:31.030821 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6dc66-f6cf-4abd-9ff4-487c9ff98539 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:31.031091 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d6dc66-f6cf-4abd-9ff4-487c9ff98539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:31.040061 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6dc66-f6cf-4abd-9ff4-487c9ff98539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:25:31.041502 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d6dc66-f6cf-4abd-9ff4-487c9ff98539 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:25:31.050379 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 672/1341] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:25:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:25:35.473821 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4667f7d-7fb0-4791-9f9a-a2f7d63328e4 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:35.474364 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4667f7d-7fb0-4791-9f9a-a2f7d63328e4 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:35.474364 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4667f7d-7fb0-4791-9f9a-a2f7d63328e4 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:35.476125 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 670/1342] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:25:35.481425 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1ee3e-a208-4603-91af-2d55c96d5387 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:35.481847 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1ee3e-a208-4603-91af-2d55c96d5387 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:35.481980 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1ee3e-a208-4603-91af-2d55c96d5387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:35.510472 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-e9b1ee3e-a208-4603-91af-2d55c96d5387 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:25:35.511710 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e9b1ee3e-a208-4603-91af-2d55c96d5387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:35.585778 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 673/1343] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:25:35.627818 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4667f7d-7fb0-4791-9f9a-a2f7d63328e4 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:25:35.638759 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4667f7d-7fb0-4791-9f9a-a2f7d63328e4 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:25:35.642751 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cef646-834d-42cf-a352-4443ef603512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:25:35.643526 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cef646-834d-42cf-a352-4443ef603512 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:35.643834 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cef646-834d-42cf-a352-4443ef603512 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:35.644181 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cef646-834d-42cf-a352-4443ef603512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:35.654194 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cef646-834d-42cf-a352-4443ef603512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:25:35.655637 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cef646-834d-42cf-a352-4443ef603512 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:25:35.668437 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 671/1344] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:25:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:25:38.567054 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31251304-5b32-4161-8c7c-7dc0cf4d112a None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:38.567442 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31251304-5b32-4161-8c7c-7dc0cf4d112a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:38.567614 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31251304-5b32-4161-8c7c-7dc0cf4d112a None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:38.569422 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 674/1345] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:25:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 05:25:38.574523 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c3ef5-969a-4e9b-a106-f8eade8aabb5 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:38.574942 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c3ef5-969a-4e9b-a106-f8eade8aabb5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:38.575077 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c3ef5-969a-4e9b-a106-f8eade8aabb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:38.592197 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-575c3ef5-969a-4e9b-a106-f8eade8aabb5 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:25:38.593395 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-575c3ef5-969a-4e9b-a106-f8eade8aabb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:38.601540 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 672/1346] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:25:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:25:38.637839 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31251304-5b32-4161-8c7c-7dc0cf4d112a None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:25:38.649390 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31251304-5b32-4161-8c7c-7dc0cf4d112a None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:25:38.653357 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886ae4a-67a0-4b87-aa63-5aaa90d0fe08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:25:38.653985 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886ae4a-67a0-4b87-aa63-5aaa90d0fe08 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:38.654270 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886ae4a-67a0-4b87-aa63-5aaa90d0fe08 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:38.654541 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886ae4a-67a0-4b87-aa63-5aaa90d0fe08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:38.665944 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886ae4a-67a0-4b87-aa63-5aaa90d0fe08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:25:38.667445 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886ae4a-67a0-4b87-aa63-5aaa90d0fe08 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:25:38.679366 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 675/1347] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:25:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:25:42.901595 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3303f13-bce5-4e54-8f86-762ae59348cc None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:42.902265 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3303f13-bce5-4e54-8f86-762ae59348cc None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:42.902265 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3303f13-bce5-4e54-8f86-762ae59348cc None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:42.904489 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 673/1348] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:25:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:25:42.910962 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc4ec9-2415-46ef-a550-d3a954a3f47d None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:42.911398 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc4ec9-2415-46ef-a550-d3a954a3f47d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:42.911492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc4ec9-2415-46ef-a550-d3a954a3f47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:42.929684 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4afc4ec9-2415-46ef-a550-d3a954a3f47d None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:25:42.930858 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4afc4ec9-2415-46ef-a550-d3a954a3f47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:42.938813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 676/1349] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:25:42.976975 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3303f13-bce5-4e54-8f86-762ae59348cc None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:25:42.987425 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3303f13-bce5-4e54-8f86-762ae59348cc None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:25:42.990914 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296a4b4-397e-4e26-b8e5-c4a713df927e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:25:42.991533 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296a4b4-397e-4e26-b8e5-c4a713df927e service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:42.991811 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296a4b4-397e-4e26-b8e5-c4a713df927e service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:42.992368 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296a4b4-397e-4e26-b8e5-c4a713df927e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:43.001025 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296a4b4-397e-4e26-b8e5-c4a713df927e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:25:43.002503 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296a4b4-397e-4e26-b8e5-c4a713df927e service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:25:43.012122 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 674/1350] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:25:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:25:48.373908 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a738c16-48cd-4d0f-b688-c14ae1b32f25 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:48.374461 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a738c16-48cd-4d0f-b688-c14ae1b32f25 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:48.374461 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a738c16-48cd-4d0f-b688-c14ae1b32f25 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:48.384545 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 677/1351] 10.222.0.75 () {54 vars in 921 bytes} [Wed Feb 16 05:25:48 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:25:48.401616 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dac46-ff60-4059-af3a-48457b8c22d5 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:48.402128 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dac46-ff60-4059-af3a-48457b8c22d5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:48.402283 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dac46-ff60-4059-af3a-48457b8c22d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:48.480422 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-7a8dac46-ff60-4059-af3a-48457b8c22d5 None None] MFA Rules not processed for user `cc233f62146a49099216c6236fb2ee2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:25:48.482144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7a8dac46-ff60-4059-af3a-48457b8c22d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:48.575304 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 675/1352] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Feb 16 05:25:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:25:52.824620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff76e3-e345-420d-aa91-aca60bb2f517 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:52.825455 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff76e3-e345-420d-aa91-aca60bb2f517 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:52.825950 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff76e3-e345-420d-aa91-aca60bb2f517 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:52.827841 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 678/1353] 10.222.0.75 () {54 vars in 921 bytes} [Wed Feb 16 05:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:25:52.833202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9746b4-a2d4-4793-bd07-e603330129bc None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:52.833662 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9746b4-a2d4-4793-bd07-e603330129bc None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:52.833769 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9746b4-a2d4-4793-bd07-e603330129bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:52.853108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ab9746b4-a2d4-4793-bd07-e603330129bc None None] MFA Rules not processed for user `cc233f62146a49099216c6236fb2ee2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:25:52.854928 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ab9746b4-a2d4-4793-bd07-e603330129bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:52.864730 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 676/1354] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Feb 16 05:25:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:25:54.606279 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189912c1-0520-4a7d-a68d-346862b6a93e None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:54.606819 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189912c1-0520-4a7d-a68d-346862b6a93e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:54.606819 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189912c1-0520-4a7d-a68d-346862b6a93e None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:54.608569 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 679/1355] 10.222.0.75 () {54 vars in 921 bytes} [Wed Feb 16 05:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:25:54.613558 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172802e-5367-4aed-8765-c0b965cbdbb1 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:54.613964 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172802e-5367-4aed-8765-c0b965cbdbb1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:54.614242 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172802e-5367-4aed-8765-c0b965cbdbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:54.632287 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-d172802e-5367-4aed-8765-c0b965cbdbb1 None None] MFA Rules not processed for user `cc233f62146a49099216c6236fb2ee2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:25:54.633512 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d172802e-5367-4aed-8765-c0b965cbdbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:54.641982 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 677/1356] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Feb 16 05:25:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:25:58.369126 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc855f2-ade3-46e3-800f-7256073b84d4 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:58.369655 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc855f2-ade3-46e3-800f-7256073b84d4 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:58.369655 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc855f2-ade3-46e3-800f-7256073b84d4 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:58.371526 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 680/1357] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:25:58.376523 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730d384-0f06-4f6a-b1c4-7a9c34944f03 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:58.376920 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730d384-0f06-4f6a-b1c4-7a9c34944f03 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:58.377073 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730d384-0f06-4f6a-b1c4-7a9c34944f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:58.398612 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-e730d384-0f06-4f6a-b1c4-7a9c34944f03 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:25:58.400154 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e730d384-0f06-4f6a-b1c4-7a9c34944f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:58.409698 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 678/1358] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:25:58.457577 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadfa14-6da6-4d60-a626-892d370a34b7 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:58.457877 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadfa14-6da6-4d60-a626-892d370a34b7 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:58.458217 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadfa14-6da6-4d60-a626-892d370a34b7 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:58.460150 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 681/1359] 10.222.0.75 () {54 vars in 961 bytes} [Wed Feb 16 05:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:25:58.465607 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d53c86-454f-4a68-b4ee-515e86217c12 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:58.465965 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d53c86-454f-4a68-b4ee-515e86217c12 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:58.466312 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d53c86-454f-4a68-b4ee-515e86217c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:58.512892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-83d53c86-454f-4a68-b4ee-515e86217c12 None None] MFA Rules not processed for user `6522d231532a48ad8dbc9c9e79a021dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:25:58.514198 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-83d53c86-454f-4a68-b4ee-515e86217c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:25:58.613597 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 679/1360] 10.222.0.75 () {58 vars in 1058 bytes} [Wed Feb 16 05:25:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:25:58.618102 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadfa14-6da6-4d60-a626-892d370a34b7 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:25:58.634996 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadfa14-6da6-4d60-a626-892d370a34b7 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:25:58.640734 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5fa66-a4cb-4890-8f6e-ad9eda3ba70d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:25:58.641461 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5fa66-a4cb-4890-8f6e-ad9eda3ba70d service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:25:58.641743 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5fa66-a4cb-4890-8f6e-ad9eda3ba70d service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:25:58.642016 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5fa66-a4cb-4890-8f6e-ad9eda3ba70d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:25:58.652768 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5fa66-a4cb-4890-8f6e-ad9eda3ba70d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:25:58.654530 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5fa66-a4cb-4890-8f6e-ad9eda3ba70d service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:25:58.671271 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 682/1361] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:01.198023 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853c0f1-9486-463a-8db8-cfdc863bfe2e None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:01.198535 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853c0f1-9486-463a-8db8-cfdc863bfe2e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:01.198535 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853c0f1-9486-463a-8db8-cfdc863bfe2e None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:01.200246 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 680/1362] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:01.205534 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a149805-f7b6-42ee-89e6-13890c3f0e2e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:01.206493 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a149805-f7b6-42ee-89e6-13890c3f0e2e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:01.206639 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a149805-f7b6-42ee-89e6-13890c3f0e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:01.224280 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-3a149805-f7b6-42ee-89e6-13890c3f0e2e None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:01.225624 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3a149805-f7b6-42ee-89e6-13890c3f0e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:01.234269 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 683/1363] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:01.278534 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853c0f1-9486-463a-8db8-cfdc863bfe2e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:26:01.293581 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853c0f1-9486-463a-8db8-cfdc863bfe2e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:26:01.300146 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5710c79-c1e2-4076-ad50-57dfdd11d200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:26:01.301111 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5710c79-c1e2-4076-ad50-57dfdd11d200 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:01.301491 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5710c79-c1e2-4076-ad50-57dfdd11d200 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:01.301839 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5710c79-c1e2-4076-ad50-57dfdd11d200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:01.310414 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5710c79-c1e2-4076-ad50-57dfdd11d200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:26:01.312091 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5710c79-c1e2-4076-ad50-57dfdd11d200 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:26:01.322285 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 681/1364] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:03.894223 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e273191-0204-4f5f-b660-77dec3d2de02 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:03.894779 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e273191-0204-4f5f-b660-77dec3d2de02 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:03.894779 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e273191-0204-4f5f-b660-77dec3d2de02 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:03.896477 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 684/1365] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:03.901564 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79407780-713d-45dd-a6c5-3d39bfd9f7d3 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:03.901949 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79407780-713d-45dd-a6c5-3d39bfd9f7d3 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:03.902112 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79407780-713d-45dd-a6c5-3d39bfd9f7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:03.919980 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-79407780-713d-45dd-a6c5-3d39bfd9f7d3 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:03.921202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-79407780-713d-45dd-a6c5-3d39bfd9f7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:03.929662 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 682/1366] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:03.973795 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2964e-2151-4066-a164-fcaa95ebb8d9 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:03.974085 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2964e-2151-4066-a164-fcaa95ebb8d9 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:03.974356 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce2964e-2151-4066-a164-fcaa95ebb8d9 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:03.976135 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 685/1367] 10.222.0.75 () {54 vars in 961 bytes} [Wed Feb 16 05:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:03.981416 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c837a78-4d85-486d-90fb-2f377ec29227 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:03.981710 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c837a78-4d85-486d-90fb-2f377ec29227 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:03.981986 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c837a78-4d85-486d-90fb-2f377ec29227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:04.001572 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-0c837a78-4d85-486d-90fb-2f377ec29227 None None] MFA Rules not processed for user `6522d231532a48ad8dbc9c9e79a021dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:04.002803 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0c837a78-4d85-486d-90fb-2f377ec29227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:04.012045 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 683/1368] 10.222.0.75 () {58 vars in 1058 bytes} [Wed Feb 16 05:26:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:26:04.019610 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2964e-2151-4066-a164-fcaa95ebb8d9 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:26:04.033684 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce2964e-2151-4066-a164-fcaa95ebb8d9 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:26:04.039803 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb866af6-6d49-4c01-9fc2-31c590ca4b91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:26:04.040431 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb866af6-6d49-4c01-9fc2-31c590ca4b91 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:04.040712 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb866af6-6d49-4c01-9fc2-31c590ca4b91 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:04.040988 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb866af6-6d49-4c01-9fc2-31c590ca4b91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:04.051420 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb866af6-6d49-4c01-9fc2-31c590ca4b91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:26:04.054347 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb866af6-6d49-4c01-9fc2-31c590ca4b91 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:26:04.064581 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 686/1369] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:26:06.466648 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11e1ab-a3b2-4727-adac-223312f8a0c8 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:06.467202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11e1ab-a3b2-4727-adac-223312f8a0c8 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:06.467202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf11e1ab-a3b2-4727-adac-223312f8a0c8 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:06.468929 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 684/1370] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:06.475028 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a0cc8-499d-49a2-a1cc-0f8fa9606168 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:06.475445 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a0cc8-499d-49a2-a1cc-0f8fa9606168 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:06.475562 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a0cc8-499d-49a2-a1cc-0f8fa9606168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:06.493578 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-504a0cc8-499d-49a2-a1cc-0f8fa9606168 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:06.494758 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-504a0cc8-499d-49a2-a1cc-0f8fa9606168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:06.502708 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 687/1371] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:06.548053 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11e1ab-a3b2-4727-adac-223312f8a0c8 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:26:06.563396 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf11e1ab-a3b2-4727-adac-223312f8a0c8 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:26:06.569692 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cd3a5-5b7a-4303-8c69-c19a5326b889 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:26:06.570347 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cd3a5-5b7a-4303-8c69-c19a5326b889 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:06.570624 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cd3a5-5b7a-4303-8c69-c19a5326b889 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:06.570889 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cd3a5-5b7a-4303-8c69-c19a5326b889 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:06.580143 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cd3a5-5b7a-4303-8c69-c19a5326b889 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:26:06.582336 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cd3a5-5b7a-4303-8c69-c19a5326b889 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:26:06.592795 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 685/1372] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:26:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:06.628461 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fe070-e5cb-43a5-9c15-0beb463484ab None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:06.629007 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fe070-e5cb-43a5-9c15-0beb463484ab None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:06.629481 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fe070-e5cb-43a5-9c15-0beb463484ab None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:06.631537 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 688/1373] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:26:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:06.636828 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2bb67-7f84-463f-b362-ca87efb02d92 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:06.637099 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2bb67-7f84-463f-b362-ca87efb02d92 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:06.637415 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2bb67-7f84-463f-b362-ca87efb02d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:06.662029 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-45b2bb67-7f84-463f-b362-ca87efb02d92 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:06.663301 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-45b2bb67-7f84-463f-b362-ca87efb02d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:06.672011 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 686/1374] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:06.942350 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46bc0b-48db-4b8b-8632-22b4d6366aa2 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:06.942644 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46bc0b-48db-4b8b-8632-22b4d6366aa2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:06.942916 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46bc0b-48db-4b8b-8632-22b4d6366aa2 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:06.944680 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 689/1375] 10.222.0.75 () {54 vars in 963 bytes} [Wed Feb 16 05:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:06.950224 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f858d-b4e2-424c-8834-4d7d8451e8fe None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:06.950512 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f858d-b4e2-424c-8834-4d7d8451e8fe None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:06.950908 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f858d-b4e2-424c-8834-4d7d8451e8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:07.002892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-763f858d-b4e2-424c-8834-4d7d8451e8fe None None] MFA Rules not processed for user `ff019ca0eef8455ba680191b8ae1fdba`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:07.004202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-763f858d-b4e2-424c-8834-4d7d8451e8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:07.068988 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 687/1376] 10.222.0.75 () {58 vars in 1060 bytes} [Wed Feb 16 05:26:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:07.077179 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46bc0b-48db-4b8b-8632-22b4d6366aa2 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:26:07.088504 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46bc0b-48db-4b8b-8632-22b4d6366aa2 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:26:07.092197 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39025fd-e952-4c5d-86b6-7cb5504c3104 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:26:07.092814 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39025fd-e952-4c5d-86b6-7cb5504c3104 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:07.093093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39025fd-e952-4c5d-86b6-7cb5504c3104 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:07.093398 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39025fd-e952-4c5d-86b6-7cb5504c3104 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:07.102708 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39025fd-e952-4c5d-86b6-7cb5504c3104 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:26:07.104139 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39025fd-e952-4c5d-86b6-7cb5504c3104 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:26:07.114082 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 690/1377] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:26:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:26:08.917213 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c242cee-f684-475a-b4a1-3028ed0a219e None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:08.917740 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c242cee-f684-475a-b4a1-3028ed0a219e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:08.917861 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c242cee-f684-475a-b4a1-3028ed0a219e None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:08.919697 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 688/1378] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:08.926054 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102cbca-111d-4c0f-9181-256bcc3984ea None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:08.926054 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102cbca-111d-4c0f-9181-256bcc3984ea None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:08.926503 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102cbca-111d-4c0f-9181-256bcc3984ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:08.944937 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2102cbca-111d-4c0f-9181-256bcc3984ea None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:08.946176 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2102cbca-111d-4c0f-9181-256bcc3984ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:08.954135 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 691/1379] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:08.997993 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c242cee-f684-475a-b4a1-3028ed0a219e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:26:09.012902 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c242cee-f684-475a-b4a1-3028ed0a219e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:26:09.018724 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6858b8e5-c680-444b-90ec-27a5d9925cf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:26:09.019364 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858b8e5-c680-444b-90ec-27a5d9925cf8 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:09.019646 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858b8e5-c680-444b-90ec-27a5d9925cf8 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:09.019918 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6858b8e5-c680-444b-90ec-27a5d9925cf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:09.028617 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858b8e5-c680-444b-90ec-27a5d9925cf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:26:09.030233 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6858b8e5-c680-444b-90ec-27a5d9925cf8 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:26:09.039798 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 689/1380] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:26:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:11.388113 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b86cf-976e-415b-a05e-7e9842ee0e47 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:11.388693 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b86cf-976e-415b-a05e-7e9842ee0e47 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:11.388693 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b86cf-976e-415b-a05e-7e9842ee0e47 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:11.393615 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 692/1381] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:26:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:11.395747 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe59883-6ba8-4097-845c-2bf9e835d7d7 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:11.396144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe59883-6ba8-4097-845c-2bf9e835d7d7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:11.396299 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe59883-6ba8-4097-845c-2bf9e835d7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:11.414955 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-8fe59883-6ba8-4097-845c-2bf9e835d7d7 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:11.416275 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8fe59883-6ba8-4097-845c-2bf9e835d7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:11.424818 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 690/1382] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:11.468432 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b86cf-976e-415b-a05e-7e9842ee0e47 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:26:11.482904 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b86cf-976e-415b-a05e-7e9842ee0e47 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:26:11.488862 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cd16b-5207-423f-9be1-5939308cde06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:26:11.489692 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cd16b-5207-423f-9be1-5939308cde06 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:11.489970 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cd16b-5207-423f-9be1-5939308cde06 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:11.490385 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cd16b-5207-423f-9be1-5939308cde06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:11.498572 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cd16b-5207-423f-9be1-5939308cde06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:26:11.500134 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cd16b-5207-423f-9be1-5939308cde06 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:26:11.509559 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 693/1383] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:26:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:13.916182 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa016c-dff8-47a8-bdca-4db154183a35 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:13.916703 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa016c-dff8-47a8-bdca-4db154183a35 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:13.916703 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa016c-dff8-47a8-bdca-4db154183a35 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:13.918619 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 691/1384] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:13.924136 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38517d-b6a1-4030-aa55-1fb3c2a34d84 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:13.924585 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38517d-b6a1-4030-aa55-1fb3c2a34d84 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:13.924676 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d38517d-b6a1-4030-aa55-1fb3c2a34d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:13.943448 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-7d38517d-b6a1-4030-aa55-1fb3c2a34d84 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:13.944663 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7d38517d-b6a1-4030-aa55-1fb3c2a34d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:13.952960 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 694/1385] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:13.994699 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa016c-dff8-47a8-bdca-4db154183a35 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:26:14.009437 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa016c-dff8-47a8-bdca-4db154183a35 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:26:14.014874 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956b457-a52d-4446-a0e4-4b0a9fd6f6a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:26:14.015501 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b457-a52d-4446-a0e4-4b0a9fd6f6a1 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:14.015780 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b457-a52d-4446-a0e4-4b0a9fd6f6a1 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:14.016052 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b457-a52d-4446-a0e4-4b0a9fd6f6a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:14.024094 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956b457-a52d-4446-a0e4-4b0a9fd6f6a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:26:14.025710 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956b457-a52d-4446-a0e4-4b0a9fd6f6a1 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:26:14.037417 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 692/1386] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:16.438982 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fb02d-3c96-41af-b9d4-bbe0d32f2bd1 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:16.439553 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fb02d-3c96-41af-b9d4-bbe0d32f2bd1 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:16.439553 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fb02d-3c96-41af-b9d4-bbe0d32f2bd1 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:16.441923 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 695/1387] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:26:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:16.447250 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e2886-4a65-4557-b07a-89cabde8df9f None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:16.447793 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e2886-4a65-4557-b07a-89cabde8df9f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:16.447903 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e2886-4a65-4557-b07a-89cabde8df9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:16.466081 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ef1e2886-4a65-4557-b07a-89cabde8df9f None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:16.467311 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ef1e2886-4a65-4557-b07a-89cabde8df9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:16.475255 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 693/1388] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:16.520278 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fb02d-3c96-41af-b9d4-bbe0d32f2bd1 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:26:16.534448 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fb02d-3c96-41af-b9d4-bbe0d32f2bd1 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:26:16.539956 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca0315-fa15-4925-bae9-360cb7708221 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:26:16.540585 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca0315-fa15-4925-bae9-360cb7708221 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:16.540866 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca0315-fa15-4925-bae9-360cb7708221 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:16.541138 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca0315-fa15-4925-bae9-360cb7708221 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:16.550246 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca0315-fa15-4925-bae9-360cb7708221 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:26:16.551822 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca0315-fa15-4925-bae9-360cb7708221 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:26:16.561096 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 696/1389] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:26:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:19.474052 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123d96c-f655-4e44-96f0-b73bb2325a78 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:19.474630 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123d96c-f655-4e44-96f0-b73bb2325a78 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:19.474731 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123d96c-f655-4e44-96f0-b73bb2325a78 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:19.476987 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 694/1390] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:26:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:19.483583 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3031af-7687-4893-9d3c-3dcc17664a9a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:19.484032 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3031af-7687-4893-9d3c-3dcc17664a9a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:19.484184 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3031af-7687-4893-9d3c-3dcc17664a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:19.503881 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0d3031af-7687-4893-9d3c-3dcc17664a9a None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:19.505136 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0d3031af-7687-4893-9d3c-3dcc17664a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:19.513394 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 697/1391] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:19.566506 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123d96c-f655-4e44-96f0-b73bb2325a78 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:26:19.581512 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123d96c-f655-4e44-96f0-b73bb2325a78 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:26:19.587182 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc8d1b-b35d-45a9-97d4-fd6fd66f3255 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:26:19.587836 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc8d1b-b35d-45a9-97d4-fd6fd66f3255 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:19.588136 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc8d1b-b35d-45a9-97d4-fd6fd66f3255 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:19.588420 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc8d1b-b35d-45a9-97d4-fd6fd66f3255 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:19.597510 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc8d1b-b35d-45a9-97d4-fd6fd66f3255 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:26:19.599173 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc8d1b-b35d-45a9-97d4-fd6fd66f3255 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:26:19.608960 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 695/1392] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:21.977446 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbde839-949f-4519-9cb9-62e7bb6601ad None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:21.978356 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbde839-949f-4519-9cb9-62e7bb6601ad None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:21.978806 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbde839-949f-4519-9cb9-62e7bb6601ad None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:21.980921 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 698/1393] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:26:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:21.987985 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca573fd-bbcf-4a4c-ad64-15fc7897f985 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:21.988572 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca573fd-bbcf-4a4c-ad64-15fc7897f985 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:21.988572 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca573fd-bbcf-4a4c-ad64-15fc7897f985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:22.009667 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-8ca573fd-bbcf-4a4c-ad64-15fc7897f985 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:22.010897 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8ca573fd-bbcf-4a4c-ad64-15fc7897f985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:22.019741 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 696/1394] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:22.063971 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbde839-949f-4519-9cb9-62e7bb6601ad None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:26:22.078033 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbde839-949f-4519-9cb9-62e7bb6601ad None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:26:22.083505 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8019d00-bc30-45ec-874f-efa78b1825e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:26:22.084134 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8019d00-bc30-45ec-874f-efa78b1825e1 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:22.084414 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8019d00-bc30-45ec-874f-efa78b1825e1 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:22.084684 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8019d00-bc30-45ec-874f-efa78b1825e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:22.093248 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8019d00-bc30-45ec-874f-efa78b1825e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:26:22.094872 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8019d00-bc30-45ec-874f-efa78b1825e1 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:26:22.105121 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 699/1395] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:26:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:22.347782 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375c6bd-54df-4065-9dd1-200149753b60 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:22.348076 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375c6bd-54df-4065-9dd1-200149753b60 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:22.348355 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8375c6bd-54df-4065-9dd1-200149753b60 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:22.350218 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 697/1396] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:22.355508 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e704657-4f30-4520-909c-f9cc0618ed43 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:22.355800 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e704657-4f30-4520-909c-f9cc0618ed43 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:22.356076 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e704657-4f30-4520-909c-f9cc0618ed43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:22.374021 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-1e704657-4f30-4520-909c-f9cc0618ed43 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:22.375189 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1e704657-4f30-4520-909c-f9cc0618ed43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:22.383389 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 700/1397] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:26:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:22.439011 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e480fb-a802-4d25-9fe8-242e331acdac None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:22.439299 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e480fb-a802-4d25-9fe8-242e331acdac None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:22.440142 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e480fb-a802-4d25-9fe8-242e331acdac None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:22.441915 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 698/1398] 10.222.0.75 () {54 vars in 962 bytes} [Wed Feb 16 05:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:22.446781 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea59a41-c624-4753-9c56-799ab7e9816b None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:22.447134 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea59a41-c624-4753-9c56-799ab7e9816b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:22.447423 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea59a41-c624-4753-9c56-799ab7e9816b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:22.494481 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-cea59a41-c624-4753-9c56-799ab7e9816b None None] MFA Rules not processed for user `ba8e4a7763524f4190c5cd66e27b5910`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:22.495652 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cea59a41-c624-4753-9c56-799ab7e9816b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:22.556339 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 701/1399] 10.222.0.75 () {58 vars in 1059 bytes} [Wed Feb 16 05:26:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:22.563791 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e480fb-a802-4d25-9fe8-242e331acdac None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:26:22.574506 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e480fb-a802-4d25-9fe8-242e331acdac None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:26:22.577947 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122ed33-2a3d-4cc5-9183-50b2de76695e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8e4a7763524f4190c5cd66e27b5910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:26:22.578585 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122ed33-2a3d-4cc5-9183-50b2de76695e service glance] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:22.578858 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122ed33-2a3d-4cc5-9183-50b2de76695e service glance] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:22.579128 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122ed33-2a3d-4cc5-9183-50b2de76695e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:22.587656 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122ed33-2a3d-4cc5-9183-50b2de76695e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:26:22.589067 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122ed33-2a3d-4cc5-9183-50b2de76695e service glance] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:26:22.598777 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 699/1400] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:26:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:23.019446 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e206c-eb12-46b6-8027-511579adc5ca None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:23.019978 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e206c-eb12-46b6-8027-511579adc5ca None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:23.019978 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e206c-eb12-46b6-8027-511579adc5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:23.069316 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-9e2e206c-eb12-46b6-8027-511579adc5ca None None] MFA Rules not processed for user `4d22345d2e2646cc99c74a2f9692b648`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:23.070576 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9e2e206c-eb12-46b6-8027-511579adc5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:23.139313 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 702/1401] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Feb 16 05:26:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:23.184745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acdc7e-3e33-43aa-8a77-11617248faac None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:23.185417 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acdc7e-3e33-43aa-8a77-11617248faac None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:23.185677 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acdc7e-3e33-43aa-8a77-11617248faac None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:23.188275 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 700/1402] 10.222.0.75 () {54 vars in 942 bytes} [Wed Feb 16 05:26:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:23.195659 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23a5b2-7804-485e-a395-71684d98fe56 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:23.195946 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23a5b2-7804-485e-a395-71684d98fe56 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:23.196221 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23a5b2-7804-485e-a395-71684d98fe56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:23.246572 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-3f23a5b2-7804-485e-a395-71684d98fe56 None None] MFA Rules not processed for user `92eb49cac0c94e73a70361831dd789b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:23.247774 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3f23a5b2-7804-485e-a395-71684d98fe56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:23.320235 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 703/1403] 10.222.0.75 () {58 vars in 1039 bytes} [Wed Feb 16 05:26:23 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:23.329516 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acdc7e-3e33-43aa-8a77-11617248faac None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:26:23.343044 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acdc7e-3e33-43aa-8a77-11617248faac None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:26:23.348914 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbc8ea-f89f-4097-895a-88d2d764e82f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eb49cac0c94e73a70361831dd789b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:26:23.349653 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbc8ea-f89f-4097-895a-88d2d764e82f service swift] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:23.349931 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbc8ea-f89f-4097-895a-88d2d764e82f service swift] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:23.350202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbc8ea-f89f-4097-895a-88d2d764e82f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:23.358538 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbc8ea-f89f-4097-895a-88d2d764e82f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:26:23.360115 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbc8ea-f89f-4097-895a-88d2d764e82f service swift] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:26:23.367897 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 701/1404] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Feb 16 05:26:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:26:24.483350 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909ec2c-892c-4adc-9252-622c1de91afd None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:24.483905 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909ec2c-892c-4adc-9252-622c1de91afd None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:24.483905 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909ec2c-892c-4adc-9252-622c1de91afd None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:24.485701 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 704/1405] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:24.491919 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d8167-a7b0-489e-82f1-f23c26bbdb67 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:24.492827 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d8167-a7b0-489e-82f1-f23c26bbdb67 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:24.493330 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d8167-a7b0-489e-82f1-f23c26bbdb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:24.514931 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f04d8167-a7b0-489e-82f1-f23c26bbdb67 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:24.516229 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f04d8167-a7b0-489e-82f1-f23c26bbdb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:24.524487 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 702/1406] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:26:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:24.570019 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909ec2c-892c-4adc-9252-622c1de91afd None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:26:24.588493 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909ec2c-892c-4adc-9252-622c1de91afd None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:26:24.593978 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ced2b2-b858-45ce-9465-bdf7969bd29a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:26:24.594717 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ced2b2-b858-45ce-9465-bdf7969bd29a service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:24.595061 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ced2b2-b858-45ce-9465-bdf7969bd29a service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:24.595402 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ced2b2-b858-45ce-9465-bdf7969bd29a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:24.605215 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ced2b2-b858-45ce-9465-bdf7969bd29a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:26:24.606836 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ced2b2-b858-45ce-9465-bdf7969bd29a service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:26:24.616425 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 705/1407] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:26:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:27.000341 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d2f44-7089-4896-b958-92702d5eadd9 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:27.000860 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d2f44-7089-4896-b958-92702d5eadd9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:27.000860 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d2f44-7089-4896-b958-92702d5eadd9 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:27.005567 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 703/1408] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:26:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:27.008252 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d25202-d328-4e9d-8c3d-4cacb951aa6f None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:27.008641 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d25202-d328-4e9d-8c3d-4cacb951aa6f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:27.008818 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d25202-d328-4e9d-8c3d-4cacb951aa6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:27.026757 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-81d25202-d328-4e9d-8c3d-4cacb951aa6f None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:27.027973 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-81d25202-d328-4e9d-8c3d-4cacb951aa6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:27.036230 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 706/1409] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:27.084418 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d2f44-7089-4896-b958-92702d5eadd9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:26:27.100879 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d2f44-7089-4896-b958-92702d5eadd9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:26:27.106684 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03556619-9eba-4751-8a66-cdd560f582aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:26:27.107406 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03556619-9eba-4751-8a66-cdd560f582aa service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:27.107782 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03556619-9eba-4751-8a66-cdd560f582aa service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:27.108126 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03556619-9eba-4751-8a66-cdd560f582aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:27.119038 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03556619-9eba-4751-8a66-cdd560f582aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:26:27.120668 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03556619-9eba-4751-8a66-cdd560f582aa service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:26:27.131442 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 704/1410] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:26:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:46.331598 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a62d54-61f6-49bf-a2fd-8095fed4e46b None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:46.341397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a62d54-61f6-49bf-a2fd-8095fed4e46b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:46.341397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a62d54-61f6-49bf-a2fd-8095fed4e46b None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:46.341397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 707/1411] 10.222.0.75 () {54 vars in 918 bytes} [Wed Feb 16 05:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:46.341676 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcabe11-bc52-446c-afd9-85a0e9ed20bd None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:46.341676 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcabe11-bc52-446c-afd9-85a0e9ed20bd None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:46.341676 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcabe11-bc52-446c-afd9-85a0e9ed20bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:46.357215 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ebcabe11-bc52-446c-afd9-85a0e9ed20bd None None] MFA Rules not processed for user `cc233f62146a49099216c6236fb2ee2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:46.358419 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ebcabe11-bc52-446c-afd9-85a0e9ed20bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:46.367272 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 705/1412] 10.222.0.75 () {58 vars in 1015 bytes} [Wed Feb 16 05:26:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:46.381659 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234fa45-9505-40d1-b5fa-cfbb7e043051 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:46.381937 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234fa45-9505-40d1-b5fa-cfbb7e043051 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:46.382207 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8234fa45-9505-40d1-b5fa-cfbb7e043051 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:46.383928 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 708/1413] 10.222.0.75 () {54 vars in 918 bytes} [Wed Feb 16 05:26:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:46.388523 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7077ea-c1fe-4548-8f0d-12c611334088 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:46.388811 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7077ea-c1fe-4548-8f0d-12c611334088 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:46.389086 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7077ea-c1fe-4548-8f0d-12c611334088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:46.406752 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-2f7077ea-c1fe-4548-8f0d-12c611334088 None None] MFA Rules not processed for user `6522d231532a48ad8dbc9c9e79a021dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:46.407931 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2f7077ea-c1fe-4548-8f0d-12c611334088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:46.416828 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 706/1414] 10.222.0.75 () {58 vars in 1015 bytes} [Wed Feb 16 05:26:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:49.142701 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b09ae-c71f-40d7-97c8-831faad8679c None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:49.143233 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b09ae-c71f-40d7-97c8-831faad8679c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:49.143327 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b09ae-c71f-40d7-97c8-831faad8679c None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:49.145015 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 709/1415] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 05:26:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:49.150339 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f433d78-18f9-4e7f-8b61-85d0255618cb None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:49.150776 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f433d78-18f9-4e7f-8b61-85d0255618cb None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:49.150923 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f433d78-18f9-4e7f-8b61-85d0255618cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:49.168460 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-3f433d78-18f9-4e7f-8b61-85d0255618cb None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:49.169929 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3f433d78-18f9-4e7f-8b61-85d0255618cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:49.177900 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 707/1416] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 05:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:49.219426 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b09ae-c71f-40d7-97c8-831faad8679c None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:26:49.233298 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b09ae-c71f-40d7-97c8-831faad8679c None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:26:49.239282 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81e211-76f8-40f8-be7d-6e721cacab3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:26:49.239901 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81e211-76f8-40f8-be7d-6e721cacab3f service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:49.240176 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81e211-76f8-40f8-be7d-6e721cacab3f service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:49.240441 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81e211-76f8-40f8-be7d-6e721cacab3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:49.248339 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81e211-76f8-40f8-be7d-6e721cacab3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:26:49.249927 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81e211-76f8-40f8-be7d-6e721cacab3f service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:26:49.259554 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 710/1417] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:26:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:50.603577 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463c6c2-7200-42d6-8b5d-20a4b2f04acb None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:50.604164 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463c6c2-7200-42d6-8b5d-20a4b2f04acb None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:50.604164 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463c6c2-7200-42d6-8b5d-20a4b2f04acb None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:50.605958 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 708/1418] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 05:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:50.610821 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6d61e-6569-4e62-ada0-f17275eb0bde None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:50.611751 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6d61e-6569-4e62-ada0-f17275eb0bde None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:50.611999 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6d61e-6569-4e62-ada0-f17275eb0bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:50.629682 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-8ae6d61e-6569-4e62-ada0-f17275eb0bde None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:50.630961 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8ae6d61e-6569-4e62-ada0-f17275eb0bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:50.639320 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 711/1419] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 05:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:50.832489 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463c6c2-7200-42d6-8b5d-20a4b2f04acb None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:26:50.847433 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463c6c2-7200-42d6-8b5d-20a4b2f04acb None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:26:50.852826 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267200ae-4611-4735-b015-7c9ffb53750b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:26:50.853482 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267200ae-4611-4735-b015-7c9ffb53750b service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:50.853817 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267200ae-4611-4735-b015-7c9ffb53750b service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:50.854044 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267200ae-4611-4735-b015-7c9ffb53750b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:50.861987 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267200ae-4611-4735-b015-7c9ffb53750b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:26:50.863574 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267200ae-4611-4735-b015-7c9ffb53750b service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:26:50.872757 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 709/1420] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:26:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:52.229273 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26207c07-4fab-4681-80d6-2bb1133419fa None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:52.229814 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26207c07-4fab-4681-80d6-2bb1133419fa None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:52.229931 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26207c07-4fab-4681-80d6-2bb1133419fa None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:52.231622 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 712/1421] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 05:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:52.237062 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2edfe-6ea7-4847-8c32-a5dd7688c78e None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:52.237516 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2edfe-6ea7-4847-8c32-a5dd7688c78e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:52.237632 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2edfe-6ea7-4847-8c32-a5dd7688c78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:52.256670 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-2cb2edfe-6ea7-4847-8c32-a5dd7688c78e None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:52.257883 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2cb2edfe-6ea7-4847-8c32-a5dd7688c78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:52.265788 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 710/1422] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 05:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:52.415710 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26207c07-4fab-4681-80d6-2bb1133419fa None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:26:52.430332 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26207c07-4fab-4681-80d6-2bb1133419fa None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:26:52.435510 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb05dd1-41ec-4409-b8a1-42b582272ed1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:26:52.436132 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb05dd1-41ec-4409-b8a1-42b582272ed1 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:52.436409 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb05dd1-41ec-4409-b8a1-42b582272ed1 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:52.436680 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb05dd1-41ec-4409-b8a1-42b582272ed1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:52.445068 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb05dd1-41ec-4409-b8a1-42b582272ed1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:26:52.446667 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb05dd1-41ec-4409-b8a1-42b582272ed1 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:26:52.455682 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 713/1423] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:53.744895 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03da8e-2847-4328-bd30-5b9de42b5ce2 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:53.745494 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03da8e-2847-4328-bd30-5b9de42b5ce2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:53.745494 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03da8e-2847-4328-bd30-5b9de42b5ce2 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:53.747207 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 711/1424] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 05:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:53.752821 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56641da6-d5bc-4e4a-acdc-c79d8c31956a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:53.753249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56641da6-d5bc-4e4a-acdc-c79d8c31956a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:53.753564 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56641da6-d5bc-4e4a-acdc-c79d8c31956a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:53.772668 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-56641da6-d5bc-4e4a-acdc-c79d8c31956a None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:53.773873 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-56641da6-d5bc-4e4a-acdc-c79d8c31956a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:53.781473 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 714/1425] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 05:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:53.931471 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03da8e-2847-4328-bd30-5b9de42b5ce2 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:26:53.946061 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03da8e-2847-4328-bd30-5b9de42b5ce2 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:26:53.951352 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aaee39-a3b5-4784-847a-78450028d434 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:26:53.951968 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaee39-a3b5-4784-847a-78450028d434 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:53.952263 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaee39-a3b5-4784-847a-78450028d434 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:53.952538 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aaee39-a3b5-4784-847a-78450028d434 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:53.960656 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aaee39-a3b5-4784-847a-78450028d434 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:26:53.962288 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aaee39-a3b5-4784-847a-78450028d434 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:26:53.971684 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 712/1426] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:26:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:55.257236 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c4a36-5cba-4551-8a0c-ba3f7ae21d71 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:55.257792 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c4a36-5cba-4551-8a0c-ba3f7ae21d71 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:55.257792 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c4a36-5cba-4551-8a0c-ba3f7ae21d71 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:55.259597 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 715/1427] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 05:26:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:55.264629 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee90bd-4655-4175-81e1-7213a085ff1f None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:55.265059 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee90bd-4655-4175-81e1-7213a085ff1f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:55.265163 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee90bd-4655-4175-81e1-7213a085ff1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:55.283886 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-57ee90bd-4655-4175-81e1-7213a085ff1f None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:55.285050 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-57ee90bd-4655-4175-81e1-7213a085ff1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:55.292665 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 713/1428] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 05:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:55.440792 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c4a36-5cba-4551-8a0c-ba3f7ae21d71 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:26:55.455529 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c4a36-5cba-4551-8a0c-ba3f7ae21d71 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:26:55.460927 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d10505-66fe-49a8-8f33-586b6c1cfacb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:26:55.461580 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d10505-66fe-49a8-8f33-586b6c1cfacb service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:55.461865 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d10505-66fe-49a8-8f33-586b6c1cfacb service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:55.462141 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d10505-66fe-49a8-8f33-586b6c1cfacb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:55.470717 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d10505-66fe-49a8-8f33-586b6c1cfacb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:26:55.472304 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d10505-66fe-49a8-8f33-586b6c1cfacb service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:26:55.481450 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 716/1429] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:26:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:56.718294 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3e2ff-3475-4771-bb44-fc98a66bcc8c None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:56.719653 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3e2ff-3475-4771-bb44-fc98a66bcc8c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:56.719944 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3e2ff-3475-4771-bb44-fc98a66bcc8c None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:56.722344 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 714/1430] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 05:26:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:56.727398 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d2b4b-069d-44c9-a73c-ab935a9b72b0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:56.727792 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d2b4b-069d-44c9-a73c-ab935a9b72b0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:56.727955 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d2b4b-069d-44c9-a73c-ab935a9b72b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:56.745635 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-7f1d2b4b-069d-44c9-a73c-ab935a9b72b0 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:56.746828 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7f1d2b4b-069d-44c9-a73c-ab935a9b72b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:56.754589 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 717/1431] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 05:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:56.905940 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3e2ff-3475-4771-bb44-fc98a66bcc8c None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:26:56.920671 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3e2ff-3475-4771-bb44-fc98a66bcc8c None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:26:56.926282 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d29ee9-69b4-4599-b5c3-0a358835da6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:26:56.926898 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d29ee9-69b4-4599-b5c3-0a358835da6a service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:56.927174 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d29ee9-69b4-4599-b5c3-0a358835da6a service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:56.927443 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d29ee9-69b4-4599-b5c3-0a358835da6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:56.935483 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d29ee9-69b4-4599-b5c3-0a358835da6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:26:56.937126 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d29ee9-69b4-4599-b5c3-0a358835da6a service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:26:56.946264 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 715/1432] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:26:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:58.188078 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27f18d-4ad8-4454-a7d8-7dd629782b3a None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:58.188643 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27f18d-4ad8-4454-a7d8-7dd629782b3a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:58.188643 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27f18d-4ad8-4454-a7d8-7dd629782b3a None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:58.190924 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 718/1433] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 05:26:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:58.195859 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b4fcb-7eec-4551-847d-c44709dba0d3 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:58.196253 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b4fcb-7eec-4551-847d-c44709dba0d3 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:58.196408 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b4fcb-7eec-4551-847d-c44709dba0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:58.214620 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-7c5b4fcb-7eec-4551-847d-c44709dba0d3 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:58.215817 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7c5b4fcb-7eec-4551-847d-c44709dba0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:58.223490 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 716/1434] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 05:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:26:58.373437 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27f18d-4ad8-4454-a7d8-7dd629782b3a None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:26:58.388723 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27f18d-4ad8-4454-a7d8-7dd629782b3a None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:26:58.394187 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf04e42-baee-4499-b27b-3dadb1414d15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:26:58.394848 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf04e42-baee-4499-b27b-3dadb1414d15 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:58.395127 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf04e42-baee-4499-b27b-3dadb1414d15 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:58.395397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf04e42-baee-4499-b27b-3dadb1414d15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:58.403486 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf04e42-baee-4499-b27b-3dadb1414d15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:26:58.406309 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf04e42-baee-4499-b27b-3dadb1414d15 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:26:58.417957 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 719/1435] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:26:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:26:59.860808 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa75d1-d0e1-4c8d-bce8-6deacb56424d None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:59.861418 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa75d1-d0e1-4c8d-bce8-6deacb56424d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:59.861418 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa75d1-d0e1-4c8d-bce8-6deacb56424d None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:59.863115 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 717/1436] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 05:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:26:59.867968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a12a6a-71fb-45f6-b7df-25aa0ebed58f None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:26:59.868409 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a12a6a-71fb-45f6-b7df-25aa0ebed58f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:26:59.868532 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a12a6a-71fb-45f6-b7df-25aa0ebed58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:26:59.886958 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-b2a12a6a-71fb-45f6-b7df-25aa0ebed58f None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:26:59.888151 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b2a12a6a-71fb-45f6-b7df-25aa0ebed58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:26:59.896446 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 720/1437] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 05:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:27:00.046812 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa75d1-d0e1-4c8d-bce8-6deacb56424d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:27:00.061223 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa75d1-d0e1-4c8d-bce8-6deacb56424d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:27:00.067195 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714c85e-e51e-4b71-98a1-6982dc5a8ed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:27:00.067838 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714c85e-e51e-4b71-98a1-6982dc5a8ed5 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:00.068120 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714c85e-e51e-4b71-98a1-6982dc5a8ed5 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:00.068393 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714c85e-e51e-4b71-98a1-6982dc5a8ed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:00.077328 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714c85e-e51e-4b71-98a1-6982dc5a8ed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:27:00.081348 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714c85e-e51e-4b71-98a1-6982dc5a8ed5 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:27:00.093295 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 718/1438] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:27:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:27:01.336244 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1e319-b7be-4021-9e97-63821e22abe5 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:01.336831 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1e319-b7be-4021-9e97-63821e22abe5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:01.336831 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1e319-b7be-4021-9e97-63821e22abe5 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:01.338614 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 721/1439] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 05:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:27:01.343609 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb87ea-ffce-446f-ad5b-5e856b94dc95 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:01.344036 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb87ea-ffce-446f-ad5b-5e856b94dc95 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:01.344164 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb87ea-ffce-446f-ad5b-5e856b94dc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:01.362905 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-40cb87ea-ffce-446f-ad5b-5e856b94dc95 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:27:01.364086 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-40cb87ea-ffce-446f-ad5b-5e856b94dc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:27:01.371847 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 719/1440] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 05:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:27:01.528333 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1e319-b7be-4021-9e97-63821e22abe5 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:27:01.542394 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1e319-b7be-4021-9e97-63821e22abe5 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:27:01.547703 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a66ba6-0e3b-4db1-b012-b589c3a04b27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:27:01.548864 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a66ba6-0e3b-4db1-b012-b589c3a04b27 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:01.549144 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a66ba6-0e3b-4db1-b012-b589c3a04b27 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:01.549446 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a66ba6-0e3b-4db1-b012-b589c3a04b27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:01.557556 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a66ba6-0e3b-4db1-b012-b589c3a04b27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:27:01.559122 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a66ba6-0e3b-4db1-b012-b589c3a04b27 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:27:01.568795 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 722/1441] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:27:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:27:03.771944 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73214c8d-374d-4c01-9750-4d0078ef62de None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:03.772543 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73214c8d-374d-4c01-9750-4d0078ef62de None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:03.772543 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73214c8d-374d-4c01-9750-4d0078ef62de None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:03.774190 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 720/1442] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 05:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:27:03.779361 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f142d2-a5b9-4a28-9d0e-02ae60cff802 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:03.779802 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f142d2-a5b9-4a28-9d0e-02ae60cff802 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:03.779909 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f142d2-a5b9-4a28-9d0e-02ae60cff802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:03.797883 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-07f142d2-a5b9-4a28-9d0e-02ae60cff802 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:27:03.799051 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-07f142d2-a5b9-4a28-9d0e-02ae60cff802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:27:03.806840 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 723/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 05:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:27:03.845549 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73214c8d-374d-4c01-9750-4d0078ef62de None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:27:03.855982 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73214c8d-374d-4c01-9750-4d0078ef62de None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:27:03.859496 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef16471-6de4-4728-8bd6-28d85bc36bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:27:03.860111 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef16471-6de4-4728-8bd6-28d85bc36bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:03.860392 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef16471-6de4-4728-8bd6-28d85bc36bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:03.860719 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef16471-6de4-4728-8bd6-28d85bc36bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:03.869402 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef16471-6de4-4728-8bd6-28d85bc36bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:27:03.870837 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef16471-6de4-4728-8bd6-28d85bc36bd2 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:27:03.880531 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 721/1444] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:27:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:27:06.373223 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30537e81-343d-4219-8f62-309b31eed731 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:06.373822 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30537e81-343d-4219-8f62-309b31eed731 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:06.373822 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30537e81-343d-4219-8f62-309b31eed731 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:06.375574 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 724/1445] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 05:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:27:06.380880 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715891f8-6ec9-4d1e-95a8-fb8e6486790a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:06.381313 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715891f8-6ec9-4d1e-95a8-fb8e6486790a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:06.381524 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715891f8-6ec9-4d1e-95a8-fb8e6486790a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:06.398884 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-715891f8-6ec9-4d1e-95a8-fb8e6486790a None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:27:06.400052 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-715891f8-6ec9-4d1e-95a8-fb8e6486790a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:27:06.408116 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 722/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 05:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:27:06.445891 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30537e81-343d-4219-8f62-309b31eed731 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:27:06.456738 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30537e81-343d-4219-8f62-309b31eed731 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:27:06.461127 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b888e0-73ff-4dfb-9015-ed5448c37ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:27:06.461774 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b888e0-73ff-4dfb-9015-ed5448c37ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:06.462050 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b888e0-73ff-4dfb-9015-ed5448c37ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:06.462321 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b888e0-73ff-4dfb-9015-ed5448c37ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:06.473694 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b888e0-73ff-4dfb-9015-ed5448c37ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:27:06.474256 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b888e0-73ff-4dfb-9015-ed5448c37ce1 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:27:06.484605 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 725/1447] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:27:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:27:09.069962 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216384f-a6d9-479a-ad0f-cbfe31aa1962 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:09.070546 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216384f-a6d9-479a-ad0f-cbfe31aa1962 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:09.070546 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e216384f-a6d9-479a-ad0f-cbfe31aa1962 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:09.072274 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 723/1448] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 05:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:27:09.077449 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3c94f-679e-4684-bef6-dd83c7c1ed99 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:09.077844 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3c94f-679e-4684-bef6-dd83c7c1ed99 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:09.077999 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3c94f-679e-4684-bef6-dd83c7c1ed99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:09.096059 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-f8f3c94f-679e-4684-bef6-dd83c7c1ed99 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:27:09.097242 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f8f3c94f-679e-4684-bef6-dd83c7c1ed99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:27:09.104932 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 726/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 05:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:27:09.142755 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216384f-a6d9-479a-ad0f-cbfe31aa1962 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:27:09.153194 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e216384f-a6d9-479a-ad0f-cbfe31aa1962 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:27:09.156793 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f40f7-7731-43a7-a015-bae3701f8148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:27:09.157947 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f40f7-7731-43a7-a015-bae3701f8148 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:09.158223 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f40f7-7731-43a7-a015-bae3701f8148 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:09.158490 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f40f7-7731-43a7-a015-bae3701f8148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:09.167218 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f40f7-7731-43a7-a015-bae3701f8148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:27:09.168650 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f40f7-7731-43a7-a015-bae3701f8148 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:27:09.178649 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 724/1450] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:27:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:27:11.540591 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267672a-6755-4e35-aca7-d3eafabe5f4b None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:11.541162 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267672a-6755-4e35-aca7-d3eafabe5f4b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:11.541162 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267672a-6755-4e35-aca7-d3eafabe5f4b None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:11.542932 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 727/1451] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 05:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:27:11.548115 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84282007-9d83-4c88-af25-b783106891e9 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:11.548545 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84282007-9d83-4c88-af25-b783106891e9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:11.548651 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84282007-9d83-4c88-af25-b783106891e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:11.566827 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-84282007-9d83-4c88-af25-b783106891e9 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:27:11.568002 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-84282007-9d83-4c88-af25-b783106891e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:27:11.575682 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 725/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 05:27:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:27:11.613878 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267672a-6755-4e35-aca7-d3eafabe5f4b None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:27:11.624248 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267672a-6755-4e35-aca7-d3eafabe5f4b None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:27:11.628353 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc5980-57ba-4f07-9911-626d062b5840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:27:11.628968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc5980-57ba-4f07-9911-626d062b5840 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:11.629246 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc5980-57ba-4f07-9911-626d062b5840 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:11.629618 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc5980-57ba-4f07-9911-626d062b5840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:11.638294 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc5980-57ba-4f07-9911-626d062b5840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:27:11.639715 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc5980-57ba-4f07-9911-626d062b5840 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:27:11.649514 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 728/1453] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:27:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:27:13.967829 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc5ac3-2135-47a0-8a02-14a86fa7ab19 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:13.968384 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc5ac3-2135-47a0-8a02-14a86fa7ab19 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:13.968384 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc5ac3-2135-47a0-8a02-14a86fa7ab19 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:13.970764 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 726/1454] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 05:27:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:27:13.975900 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1055b1-416b-46cd-9e76-9b55507a22f1 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:13.976344 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1055b1-416b-46cd-9e76-9b55507a22f1 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:13.976450 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1055b1-416b-46cd-9e76-9b55507a22f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:13.994122 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-dc1055b1-416b-46cd-9e76-9b55507a22f1 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:27:13.995299 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-dc1055b1-416b-46cd-9e76-9b55507a22f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:27:14.002968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 729/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 05:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:27:14.041340 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc5ac3-2135-47a0-8a02-14a86fa7ab19 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:27:14.051971 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc5ac3-2135-47a0-8a02-14a86fa7ab19 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:27:14.055762 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e041520-d6ca-4215-aa77-58247ea70b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:27:14.056377 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e041520-d6ca-4215-aa77-58247ea70b71 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:14.056656 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e041520-d6ca-4215-aa77-58247ea70b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:14.056925 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e041520-d6ca-4215-aa77-58247ea70b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:14.065609 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e041520-d6ca-4215-aa77-58247ea70b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:27:14.067039 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e041520-d6ca-4215-aa77-58247ea70b71 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:27:14.076153 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 727/1456] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:27:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:27:16.430372 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cd8a4-8853-45d9-9ef4-c24a767c370f None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:16.430932 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cd8a4-8853-45d9-9ef4-c24a767c370f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:16.430932 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cd8a4-8853-45d9-9ef4-c24a767c370f None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:16.432751 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 730/1457] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 05:27:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:27:16.437974 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a4a82-af37-46a8-b84d-b13f0266f784 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:16.438420 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a4a82-af37-46a8-b84d-b13f0266f784 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:16.438607 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a4a82-af37-46a8-b84d-b13f0266f784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:16.456492 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-237a4a82-af37-46a8-b84d-b13f0266f784 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:27:16.457720 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-237a4a82-af37-46a8-b84d-b13f0266f784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:27:16.465444 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 728/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 05:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:27:16.503303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cd8a4-8853-45d9-9ef4-c24a767c370f None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:27:16.504965 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-640cd8a4-8853-45d9-9ef4-c24a767c370f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:27:16.518236 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cd8a4-8853-45d9-9ef4-c24a767c370f None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:27:16.521766 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199d071-1544-45eb-89cf-58e09a1a13af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:27:16.522395 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199d071-1544-45eb-89cf-58e09a1a13af service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:16.522669 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199d071-1544-45eb-89cf-58e09a1a13af service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:16.522940 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199d071-1544-45eb-89cf-58e09a1a13af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:16.531570 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199d071-1544-45eb-89cf-58e09a1a13af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:27:16.533574 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199d071-1544-45eb-89cf-58e09a1a13af service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:27:16.542602 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 731/1459] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:27:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:27:18.918427 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7418240-c42c-4722-8fba-3ae4f6040cad None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:18.918969 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7418240-c42c-4722-8fba-3ae4f6040cad None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:18.918969 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7418240-c42c-4722-8fba-3ae4f6040cad None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:18.920794 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 729/1460] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 05:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:27:18.926836 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ffc53-3083-4a48-866a-1e452b1ff605 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:18.927236 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ffc53-3083-4a48-866a-1e452b1ff605 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:18.927388 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ffc53-3083-4a48-866a-1e452b1ff605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:18.945204 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-907ffc53-3083-4a48-866a-1e452b1ff605 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:27:18.946421 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-907ffc53-3083-4a48-866a-1e452b1ff605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:27:18.954642 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 732/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 05:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:27:18.991430 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7418240-c42c-4722-8fba-3ae4f6040cad None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:27:19.002443 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7418240-c42c-4722-8fba-3ae4f6040cad None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:27:19.005972 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3a4bb-8999-4654-b741-63b5a739a7b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:27:19.006590 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3a4bb-8999-4654-b741-63b5a739a7b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:19.006871 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3a4bb-8999-4654-b741-63b5a739a7b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:19.007145 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3a4bb-8999-4654-b741-63b5a739a7b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:19.015766 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3a4bb-8999-4654-b741-63b5a739a7b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:27:19.017855 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3a4bb-8999-4654-b741-63b5a739a7b4 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:27:19.027001 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 730/1462] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:27:21.333932 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9fe15-c22c-4b1c-8fd7-60a5b23c53f6 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:21.334497 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9fe15-c22c-4b1c-8fd7-60a5b23c53f6 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:21.334497 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9fe15-c22c-4b1c-8fd7-60a5b23c53f6 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:21.336278 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 733/1463] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 05:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:27:21.341512 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df356623-9544-4474-b263-88f13d31f0fd None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:21.341967 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df356623-9544-4474-b263-88f13d31f0fd None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:21.342073 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df356623-9544-4474-b263-88f13d31f0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:21.359999 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-df356623-9544-4474-b263-88f13d31f0fd None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:27:21.361841 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-df356623-9544-4474-b263-88f13d31f0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:27:21.369496 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 731/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 05:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:27:21.405720 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9fe15-c22c-4b1c-8fd7-60a5b23c53f6 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:27:21.416866 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9fe15-c22c-4b1c-8fd7-60a5b23c53f6 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:27:21.420294 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250e1c2-9bbb-49c7-ae68-cc7fd354fd61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:27:21.420911 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250e1c2-9bbb-49c7-ae68-cc7fd354fd61 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:21.421186 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250e1c2-9bbb-49c7-ae68-cc7fd354fd61 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:21.421490 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250e1c2-9bbb-49c7-ae68-cc7fd354fd61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:21.431016 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250e1c2-9bbb-49c7-ae68-cc7fd354fd61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:27:21.432431 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250e1c2-9bbb-49c7-ae68-cc7fd354fd61 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:27:21.441810 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 734/1465] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:27:23.801833 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da25fa-f98a-4f2b-a7c0-e4bfcba32774 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:23.802349 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da25fa-f98a-4f2b-a7c0-e4bfcba32774 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:23.802457 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da25fa-f98a-4f2b-a7c0-e4bfcba32774 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:23.804219 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 732/1466] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 05:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:27:23.809385 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7f5bd-25e8-4d1e-b474-7b2961078c3c None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:23.809791 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7f5bd-25e8-4d1e-b474-7b2961078c3c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:23.809951 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7f5bd-25e8-4d1e-b474-7b2961078c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:23.827910 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-49d7f5bd-25e8-4d1e-b474-7b2961078c3c None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:27:23.829151 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-49d7f5bd-25e8-4d1e-b474-7b2961078c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:27:23.840765 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 735/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 05:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:27:23.877785 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da25fa-f98a-4f2b-a7c0-e4bfcba32774 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:27:23.888128 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da25fa-f98a-4f2b-a7c0-e4bfcba32774 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:27:23.891589 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8bc82-764e-4ef1-addf-10e79cceab7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:27:23.892199 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8bc82-764e-4ef1-addf-10e79cceab7f service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:23.892473 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8bc82-764e-4ef1-addf-10e79cceab7f service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:23.892740 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8bc82-764e-4ef1-addf-10e79cceab7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:23.901225 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8bc82-764e-4ef1-addf-10e79cceab7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:27:23.902711 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8bc82-764e-4ef1-addf-10e79cceab7f service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:27:23.911678 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 733/1468] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:27:26.194340 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad5b11-10bc-4b3a-86a5-5ee063492841 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:26.194883 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad5b11-10bc-4b3a-86a5-5ee063492841 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:26.194883 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad5b11-10bc-4b3a-86a5-5ee063492841 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:26.196694 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 736/1469] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 05:27:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:27:26.201854 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f80592-b7f6-4bef-81f2-87fded0ee186 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:26.202334 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f80592-b7f6-4bef-81f2-87fded0ee186 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:26.202437 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f80592-b7f6-4bef-81f2-87fded0ee186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:26.220667 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-98f80592-b7f6-4bef-81f2-87fded0ee186 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:27:26.221854 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-98f80592-b7f6-4bef-81f2-87fded0ee186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:27:26.229405 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 734/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 05:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:27:26.263968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad5b11-10bc-4b3a-86a5-5ee063492841 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:27:26.275101 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad5b11-10bc-4b3a-86a5-5ee063492841 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:27:26.278681 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f38d66-4244-4cfe-bcd5-73d75bc683dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:27:26.279299 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f38d66-4244-4cfe-bcd5-73d75bc683dc service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:26.279579 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f38d66-4244-4cfe-bcd5-73d75bc683dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:26.279850 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f38d66-4244-4cfe-bcd5-73d75bc683dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:26.289062 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f38d66-4244-4cfe-bcd5-73d75bc683dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:27:26.290518 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f38d66-4244-4cfe-bcd5-73d75bc683dc service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:27:26.299648 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 737/1471] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:27:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:27:46.865131 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e52593-ce6c-436d-854c-e2e25e67dd37 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:46.865757 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e52593-ce6c-436d-854c-e2e25e67dd37 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:46.865757 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e52593-ce6c-436d-854c-e2e25e67dd37 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:46.867462 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 735/1472] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:27:46.872611 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc28a72-3b97-4360-8764-9f9bab3b0c96 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:46.873016 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc28a72-3b97-4360-8764-9f9bab3b0c96 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:46.873198 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc28a72-3b97-4360-8764-9f9bab3b0c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:46.890782 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-adc28a72-3b97-4360-8764-9f9bab3b0c96 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:27:46.892004 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-adc28a72-3b97-4360-8764-9f9bab3b0c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:27:46.899690 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 738/1473] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:27:46.945968 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788be47-0428-41b1-b5df-876c579aeec8 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:46.946253 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788be47-0428-41b1-b5df-876c579aeec8 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:46.946527 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788be47-0428-41b1-b5df-876c579aeec8 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:46.948266 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 736/1474] 10.222.0.75 () {54 vars in 962 bytes} [Wed Feb 16 05:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:27:46.953031 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e0a08-8fab-4bcb-96ad-2c3f94519be6 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:46.953349 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e0a08-8fab-4bcb-96ad-2c3f94519be6 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:46.954132 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e0a08-8fab-4bcb-96ad-2c3f94519be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:46.972306 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-8c1e0a08-8fab-4bcb-96ad-2c3f94519be6 None None] MFA Rules not processed for user `ba8e4a7763524f4190c5cd66e27b5910`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:27:46.973555 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8c1e0a08-8fab-4bcb-96ad-2c3f94519be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:27:46.979835 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 739/1475] 10.222.0.75 () {58 vars in 1059 bytes} [Wed Feb 16 05:27:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:27:46.986639 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788be47-0428-41b1-b5df-876c579aeec8 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:27:46.996947 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788be47-0428-41b1-b5df-876c579aeec8 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:27:47.000432 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db81af-679f-49ea-a960-7a7668332447 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8e4a7763524f4190c5cd66e27b5910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:27:47.001045 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db81af-679f-49ea-a960-7a7668332447 service glance] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:47.001354 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db81af-679f-49ea-a960-7a7668332447 service glance] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:47.001628 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db81af-679f-49ea-a960-7a7668332447 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:47.010222 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db81af-679f-49ea-a960-7a7668332447 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:27:47.011656 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db81af-679f-49ea-a960-7a7668332447 service glance] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:27:47.021231 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 737/1476] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:27:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:27:49.388175 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee36d3e-77ee-4385-b728-7ed938acfa8c None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:49.388747 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee36d3e-77ee-4385-b728-7ed938acfa8c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:49.388747 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee36d3e-77ee-4385-b728-7ed938acfa8c None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:49.390511 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 740/1477] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:27:49.395679 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b97a6-25dc-4896-8d56-02d6e9b8f3aa None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:49.396075 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b97a6-25dc-4896-8d56-02d6e9b8f3aa None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:49.396208 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b97a6-25dc-4896-8d56-02d6e9b8f3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:49.413655 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c57b97a6-25dc-4896-8d56-02d6e9b8f3aa None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:27:49.414841 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c57b97a6-25dc-4896-8d56-02d6e9b8f3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:27:49.423049 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 738/1478] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:27:49.446511 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee36d3e-77ee-4385-b728-7ed938acfa8c None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:27:49.459244 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee36d3e-77ee-4385-b728-7ed938acfa8c None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:27:49.463711 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333bb23-078f-47cb-adf1-cce7568a006e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:27:49.464344 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333bb23-078f-47cb-adf1-cce7568a006e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:49.464625 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333bb23-078f-47cb-adf1-cce7568a006e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:49.464902 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333bb23-078f-47cb-adf1-cce7568a006e admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:49.465670 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333bb23-078f-47cb-adf1-cce7568a006e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:27:49.467523 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333bb23-078f-47cb-adf1-cce7568a006e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:27:49.480843 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 741/1479] 10.222.0.75 () {56 vars in 1108 bytes} [Wed Feb 16 05:27:49 2022] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:27:51.787285 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50add7-8cb4-4c9e-84e7-839440a308f2 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:51.787843 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50add7-8cb4-4c9e-84e7-839440a308f2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:51.787843 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50add7-8cb4-4c9e-84e7-839440a308f2 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:51.789664 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 739/1480] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:27:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:27:51.794839 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378ab88-c17e-45b1-bf5c-4859f85f81b1 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:51.795260 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378ab88-c17e-45b1-bf5c-4859f85f81b1 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:51.795389 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378ab88-c17e-45b1-bf5c-4859f85f81b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:51.814211 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2378ab88-c17e-45b1-bf5c-4859f85f81b1 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:27:51.815398 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2378ab88-c17e-45b1-bf5c-4859f85f81b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:27:51.823039 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 742/1481] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:27:51.864375 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50add7-8cb4-4c9e-84e7-839440a308f2 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:27:51.878359 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50add7-8cb4-4c9e-84e7-839440a308f2 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:27:51.883736 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799e285-85dc-46d2-b72c-c3ae017fb603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:27:51.884355 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799e285-85dc-46d2-b72c-c3ae017fb603 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:51.884633 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799e285-85dc-46d2-b72c-c3ae017fb603 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:51.884905 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799e285-85dc-46d2-b72c-c3ae017fb603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:51.892837 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799e285-85dc-46d2-b72c-c3ae017fb603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:27:51.894462 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799e285-85dc-46d2-b72c-c3ae017fb603 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:27:51.903580 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 740/1482] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:27:54.345065 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb095ce5-3df5-4163-a4c6-942b29f1f71e None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:54.345671 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb095ce5-3df5-4163-a4c6-942b29f1f71e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:54.345671 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb095ce5-3df5-4163-a4c6-942b29f1f71e None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:54.347413 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 743/1483] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:27:54.352582 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a291f3a-6098-44ee-a7db-6b8775124237 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:54.353019 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a291f3a-6098-44ee-a7db-6b8775124237 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:54.353114 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a291f3a-6098-44ee-a7db-6b8775124237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:54.371108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-5a291f3a-6098-44ee-a7db-6b8775124237 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:27:54.372284 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5a291f3a-6098-44ee-a7db-6b8775124237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:27:54.379953 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 741/1484] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:27:54.415342 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb095ce5-3df5-4163-a4c6-942b29f1f71e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:27:54.426508 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb095ce5-3df5-4163-a4c6-942b29f1f71e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:27:54.430014 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f00b2-5b59-4b69-836d-2cb5604c0e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:27:54.430630 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f00b2-5b59-4b69-836d-2cb5604c0e9c service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:54.430911 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f00b2-5b59-4b69-836d-2cb5604c0e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:54.431183 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f00b2-5b59-4b69-836d-2cb5604c0e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:54.439801 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f00b2-5b59-4b69-836d-2cb5604c0e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:27:54.441214 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f00b2-5b59-4b69-836d-2cb5604c0e9c service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:27:54.450265 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 744/1485] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:27:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:27:56.778305 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8745c7-36e3-455b-8a12-c30534fab522 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:56.778829 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8745c7-36e3-455b-8a12-c30534fab522 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:56.778829 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8745c7-36e3-455b-8a12-c30534fab522 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:56.780622 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 742/1486] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:27:56.786433 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c11bf-9113-444f-ba85-4d95b3c4aa52 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:56.786849 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c11bf-9113-444f-ba85-4d95b3c4aa52 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:56.786965 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c11bf-9113-444f-ba85-4d95b3c4aa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:56.804483 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-163c11bf-9113-444f-ba85-4d95b3c4aa52 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:27:56.805695 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-163c11bf-9113-444f-ba85-4d95b3c4aa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:27:56.813305 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 745/1487] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:27:56.851020 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8745c7-36e3-455b-8a12-c30534fab522 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:27:56.861554 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8745c7-36e3-455b-8a12-c30534fab522 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:27:56.865001 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca24746-b4c3-4669-a09c-2facd8ef6c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:27:56.865660 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca24746-b4c3-4669-a09c-2facd8ef6c35 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:56.865941 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca24746-b4c3-4669-a09c-2facd8ef6c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:56.866210 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca24746-b4c3-4669-a09c-2facd8ef6c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:56.874863 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca24746-b4c3-4669-a09c-2facd8ef6c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:27:56.876326 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca24746-b4c3-4669-a09c-2facd8ef6c35 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:27:56.885414 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 743/1488] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:27:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:27:59.242718 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83c921-649b-4235-9d00-1f4363e27a08 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:59.243273 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83c921-649b-4235-9d00-1f4363e27a08 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:59.243273 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83c921-649b-4235-9d00-1f4363e27a08 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:59.245105 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 746/1489] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:27:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:27:59.250452 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbc584-6105-4b85-8efd-7f4af34d8db5 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:59.250898 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbc584-6105-4b85-8efd-7f4af34d8db5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:59.251101 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbc584-6105-4b85-8efd-7f4af34d8db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:59.268948 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-b0fbc584-6105-4b85-8efd-7f4af34d8db5 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:27:59.270175 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b0fbc584-6105-4b85-8efd-7f4af34d8db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:27:59.277901 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 744/1490] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:27:59.318802 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83c921-649b-4235-9d00-1f4363e27a08 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:27:59.329328 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83c921-649b-4235-9d00-1f4363e27a08 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:27:59.332839 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2546d-22f6-46e9-ab67-7462e03b0d69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:27:59.333493 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2546d-22f6-46e9-ab67-7462e03b0d69 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:27:59.333778 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2546d-22f6-46e9-ab67-7462e03b0d69 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:27:59.334048 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2546d-22f6-46e9-ab67-7462e03b0d69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:27:59.342642 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2546d-22f6-46e9-ab67-7462e03b0d69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:27:59.344580 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2546d-22f6-46e9-ab67-7462e03b0d69 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:27:59.353976 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 747/1491] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:27:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:28:01.859048 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b35e29-88cb-4039-917e-1cdebbac7486 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:28:01.860269 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b35e29-88cb-4039-917e-1cdebbac7486 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:28:01.860269 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b35e29-88cb-4039-917e-1cdebbac7486 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:28:01.862689 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 745/1492] 10.222.0.75 () {54 vars in 926 bytes} [Wed Feb 16 05:28:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:28:01.868888 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de23cc-bf13-4a18-ae16-d8c498e85e4a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:28:01.869377 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de23cc-bf13-4a18-ae16-d8c498e85e4a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:28:01.869471 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de23cc-bf13-4a18-ae16-d8c498e85e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:28:01.887639 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-48de23cc-bf13-4a18-ae16-d8c498e85e4a None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:28:01.888841 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-48de23cc-bf13-4a18-ae16-d8c498e85e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:28:01.897064 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 748/1493] 10.222.0.75 () {58 vars in 1023 bytes} [Wed Feb 16 05:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:28:01.935982 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b35e29-88cb-4039-917e-1cdebbac7486 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:28:01.946435 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b35e29-88cb-4039-917e-1cdebbac7486 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:28:01.949921 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11ee40-dd2d-4cae-9421-ab8d6d90920a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:28:01.950541 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11ee40-dd2d-4cae-9421-ab8d6d90920a service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:28:01.950828 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11ee40-dd2d-4cae-9421-ab8d6d90920a service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:28:01.951092 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11ee40-dd2d-4cae-9421-ab8d6d90920a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:28:01.960207 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11ee40-dd2d-4cae-9421-ab8d6d90920a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:28:01.961712 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11ee40-dd2d-4cae-9421-ab8d6d90920a service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:28:01.971686 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 746/1494] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:28:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:29:29.349686 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5717e-8e00-4078-a33a-87e7f3c318de None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:29:29.350312 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5717e-8e00-4078-a33a-87e7f3c318de None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:29:29.350312 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5717e-8e00-4078-a33a-87e7f3c318de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:29:29.368510 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-60a5717e-8e00-4078-a33a-87e7f3c318de None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:29:29.369726 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-60a5717e-8e00-4078-a33a-87e7f3c318de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:29:29.378508 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 749/1495] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:29:29.386754 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05a874-4b09-4216-afc5-566a90836bdc None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:29:29.387244 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05a874-4b09-4216-afc5-566a90836bdc None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:29:29.387341 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05a874-4b09-4216-afc5-566a90836bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:29:29.406272 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-cf05a874-4b09-4216-afc5-566a90836bdc None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:29:29.407457 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-cf05a874-4b09-4216-afc5-566a90836bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:29:29.415205 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 747/1496] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:29:29.419741 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5717e-8e00-4078-a33a-87e7f3c318de None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:29:29.429878 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5717e-8e00-4078-a33a-87e7f3c318de None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:29:29.434307 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede6908-dd04-4926-ba30-44ad6f57f3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:29:29.434936 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede6908-dd04-4926-ba30-44ad6f57f3ba admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:29:29.435213 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede6908-dd04-4926-ba30-44ad6f57f3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:29:29.435491 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede6908-dd04-4926-ba30-44ad6f57f3ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:29:29.436192 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede6908-dd04-4926-ba30-44ad6f57f3ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:29:29.436493 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede6908-dd04-4926-ba30-44ad6f57f3ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:29:29.438117 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede6908-dd04-4926-ba30-44ad6f57f3ba admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:29:29.448969 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 750/1497] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:29:29.456904 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05a874-4b09-4216-afc5-566a90836bdc None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:29:29.465743 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05a874-4b09-4216-afc5-566a90836bdc None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:29:29.470789 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4802c-2e90-465d-9c24-732cc45ff81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:29:29.471420 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4802c-2e90-465d-9c24-732cc45ff81a admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:29:29.471697 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4802c-2e90-465d-9c24-732cc45ff81a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:29:29.471967 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a4802c-2e90-465d-9c24-732cc45ff81a admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:29:29.472643 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4802c-2e90-465d-9c24-732cc45ff81a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:29:29.474581 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a4802c-2e90-465d-9c24-732cc45ff81a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:29:29.508557 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 748/1498] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:29:29 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:29:29.513107 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede6908-dd04-4926-ba30-44ad6f57f3ba admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:29:29.522968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede6908-dd04-4926-ba30-44ad6f57f3ba admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:29:29.576858 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8cfc4-ff22-4a64-84f3-fd05082918c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:29:29.577531 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8cfc4-ff22-4a64-84f3-fd05082918c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:29:29.577812 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8cfc4-ff22-4a64-84f3-fd05082918c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:29:29.578084 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8cfc4-ff22-4a64-84f3-fd05082918c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:29:29.578757 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8cfc4-ff22-4a64-84f3-fd05082918c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:29:29.580704 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8cfc4-ff22-4a64-84f3-fd05082918c3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:29:29.600223 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 751/1499] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:29:29 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:29:29.604349 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4802c-2e90-465d-9c24-732cc45ff81a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:29:29.615000 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a4802c-2e90-465d-9c24-732cc45ff81a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:29:29.619454 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3ce63-e0fb-4c79-ac4a-9eb2c5de56cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:29:29.620087 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3ce63-e0fb-4c79-ac4a-9eb2c5de56cd admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:29:29.620364 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3ce63-e0fb-4c79-ac4a-9eb2c5de56cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:29:29.620631 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f3ce63-e0fb-4c79-ac4a-9eb2c5de56cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:29:29.621373 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3ce63-e0fb-4c79-ac4a-9eb2c5de56cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:29:29.622969 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f3ce63-e0fb-4c79-ac4a-9eb2c5de56cd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:29:29.635198 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 749/1500] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:29:29.639110 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8cfc4-ff22-4a64-84f3-fd05082918c3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:29:29.648859 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8cfc4-ff22-4a64-84f3-fd05082918c3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:29:29.653389 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9226a17-737d-40d6-b507-06bba594d7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:29:29.654047 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9226a17-737d-40d6-b507-06bba594d7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:29:29.654855 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9226a17-737d-40d6-b507-06bba594d7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:29:29.655126 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9226a17-737d-40d6-b507-06bba594d7e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:29:29.655835 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9226a17-737d-40d6-b507-06bba594d7e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:29:29.657443 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9226a17-737d-40d6-b507-06bba594d7e3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:29:29.671605 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 752/1501] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:29:29.675944 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3ce63-e0fb-4c79-ac4a-9eb2c5de56cd admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:29:29.685552 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f3ce63-e0fb-4c79-ac4a-9eb2c5de56cd admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:29:29.689907 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725f51b-3d6c-42c4-8ce6-2be8e11fedd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:29:29.690787 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725f51b-3d6c-42c4-8ce6-2be8e11fedd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:29:29.691062 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725f51b-3d6c-42c4-8ce6-2be8e11fedd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:29:29.691334 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725f51b-3d6c-42c4-8ce6-2be8e11fedd7 admin admin] PATH_INFO: `/v3/projects/a091415c1eff4fa09225ff816e93e16d/users/3d6858fc644949e68071d08592141f39/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:29:29.705583 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725f51b-3d6c-42c4-8ce6-2be8e11fedd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a091415c1eff4fa09225ff816e93e16d, user_id=3d6858fc644949e68071d08592141f39, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:29:29.708230 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725f51b-3d6c-42c4-8ce6-2be8e11fedd7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:29:29.721053 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 750/1502] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:29:29 2022] PUT /identity/v3/projects/a091415c1eff4fa09225ff816e93e16d/users/3d6858fc644949e68071d08592141f39/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:29:29.733107 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5defd68-a085-47d5-83e5-c913afd0ee73 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:29:29.733428 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5defd68-a085-47d5-83e5-c913afd0ee73 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:29:29.733705 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5defd68-a085-47d5-83e5-c913afd0ee73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:29:29.758873 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-c5defd68-a085-47d5-83e5-c913afd0ee73 None None] MFA Rules not processed for user `3d6858fc644949e68071d08592141f39`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:29:29.760056 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c5defd68-a085-47d5-83e5-c913afd0ee73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:29:29.819474 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 753/1503] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:29:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:29:29.830996 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725f51b-3d6c-42c4-8ce6-2be8e11fedd7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:29:29.896816 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725f51b-3d6c-42c4-8ce6-2be8e11fedd7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:29:29.902132 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecade0-f0ec-4677-90d5-a97ebec0d8b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:29:29.902756 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecade0-f0ec-4677-90d5-a97ebec0d8b2 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:29:29.903034 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecade0-f0ec-4677-90d5-a97ebec0d8b2 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:29:29.903308 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecade0-f0ec-4677-90d5-a97ebec0d8b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:29:29.911308 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecade0-f0ec-4677-90d5-a97ebec0d8b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:29:29.912893 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fecade0-f0ec-4677-90d5-a97ebec0d8b2 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:29:29.921310 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 751/1504] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:29:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:29:29.991647 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e0163-faf2-48dc-9cf3-bcbd6bdd1f18 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:29:29.991930 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e0163-faf2-48dc-9cf3-bcbd6bdd1f18 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:29:29.992198 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e0163-faf2-48dc-9cf3-bcbd6bdd1f18 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:29:29.993949 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 754/1505] 10.222.0.75 () {52 vars in 829 bytes} [Wed Feb 16 05:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:29:29.997587 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecade0-f0ec-4677-90d5-a97ebec0d8b2 service nova] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:29:30.057581 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fecade0-f0ec-4677-90d5-a97ebec0d8b2 service nova] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:29:30.062483 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6e696-4a63-4ab5-8a98-cf635361f8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:29:30.063322 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6e696-4a63-4ab5-8a98-cf635361f8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:29:30.063598 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6e696-4a63-4ab5-8a98-cf635361f8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:29:30.063862 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6e696-4a63-4ab5-8a98-cf635361f8cc admin admin] PATH_INFO: `/v3/users/3d6858fc644949e68071d08592141f39` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:29:30.065019 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6e696-4a63-4ab5-8a98-cf635361f8cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d6858fc644949e68071d08592141f39)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:29:30.066074 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-28d6e696-4a63-4ab5-8a98-cf635361f8cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:29:30.066074 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Feb 16 05:29:30.066074 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: Feb 16 05:29:30.067255 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6e696-4a63-4ab5-8a98-cf635361f8cc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:29:30.127901 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-28d6e696-4a63-4ab5-8a98-cf635361f8cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d6858fc644949e68071d08592141f39'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:29:30.145627 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-28d6e696-4a63-4ab5-8a98-cf635361f8cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d6858fc644949e68071d08592141f39'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:29:30.146378 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-28d6e696-4a63-4ab5-8a98-cf635361f8cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d6858fc644949e68071d08592141f39'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:29:30.147040 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-28d6e696-4a63-4ab5-8a98-cf635361f8cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d6858fc644949e68071d08592141f39'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:29:30.156004 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-28d6e696-4a63-4ab5-8a98-cf635361f8cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d6858fc644949e68071d08592141f39'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:29:30.172989 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 752/1506] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:29:29 2022] DELETE /identity/v3/users/3d6858fc644949e68071d08592141f39 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:29:30.177794 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff8890-d4ac-4768-89a1-9d1dc3b7d0fa None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:29:30.178164 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff8890-d4ac-4768-89a1-9d1dc3b7d0fa None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:29:30.178504 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff8890-d4ac-4768-89a1-9d1dc3b7d0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:29:30.195672 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-3cff8890-d4ac-4768-89a1-9d1dc3b7d0fa None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:29:30.196838 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3cff8890-d4ac-4768-89a1-9d1dc3b7d0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:29:30.252633 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 755/1507] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:29:30.262100 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6e696-4a63-4ab5-8a98-cf635361f8cc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:29:30.263491 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-28d6e696-4a63-4ab5-8a98-cf635361f8cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:29:30.318166 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6e696-4a63-4ab5-8a98-cf635361f8cc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:29:30.321756 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a954a-fdf7-4599-a5d1-3a6b1a1b23fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:29:30.322378 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a954a-fdf7-4599-a5d1-3a6b1a1b23fe service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:29:30.322665 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a954a-fdf7-4599-a5d1-3a6b1a1b23fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:29:30.322939 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a954a-fdf7-4599-a5d1-3a6b1a1b23fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:29:30.332108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a954a-fdf7-4599-a5d1-3a6b1a1b23fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:29:30.333584 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a954a-fdf7-4599-a5d1-3a6b1a1b23fe service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:29:30.342630 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 753/1508] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:29:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:29:30.677782 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff8890-d4ac-4768-89a1-9d1dc3b7d0fa None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:29:30.679226 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3cff8890-d4ac-4768-89a1-9d1dc3b7d0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:29:30.691587 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff8890-d4ac-4768-89a1-9d1dc3b7d0fa None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:29:30.697043 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c1dcf-d8cd-409e-b58a-63265c187638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:29:30.697941 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c1dcf-d8cd-409e-b58a-63265c187638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:29:30.698216 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c1dcf-d8cd-409e-b58a-63265c187638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:29:30.698523 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c1dcf-d8cd-409e-b58a-63265c187638 admin admin] PATH_INFO: `/v3/projects/a091415c1eff4fa09225ff816e93e16d` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:29:30.699694 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c1dcf-d8cd-409e-b58a-63265c187638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a091415c1eff4fa09225ff816e93e16d)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:29:30.700707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-8f4c1dcf-d8cd-409e-b58a-63265c187638 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:29:30.700707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Feb 16 05:29:30.700707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: Feb 16 05:29:30.701955 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c1dcf-d8cd-409e-b58a-63265c187638 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:29:30.760097 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8f4c1dcf-d8cd-409e-b58a-63265c187638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a091415c1eff4fa09225ff816e93e16d', 'request_id': 'req-8f4c1dcf-d8cd-409e-b58a-63265c187638'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:29:30.769354 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8f4c1dcf-d8cd-409e-b58a-63265c187638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a091415c1eff4fa09225ff816e93e16d', 'request_id': 'req-8f4c1dcf-d8cd-409e-b58a-63265c187638'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:29:30.775205 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8f4c1dcf-d8cd-409e-b58a-63265c187638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a091415c1eff4fa09225ff816e93e16d', 'request_id': 'req-8f4c1dcf-d8cd-409e-b58a-63265c187638'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:29:30.792861 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8f4c1dcf-d8cd-409e-b58a-63265c187638 admin admin] The token cache is being invalidate because project a091415c1eff4fa09225ff816e93e16d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:29:30.793143 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8f4c1dcf-d8cd-409e-b58a-63265c187638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:29:30.793810 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8f4c1dcf-d8cd-409e-b58a-63265c187638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:29:30.795945 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 756/1509] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:29:30 2022] DELETE /identity/v3/projects/a091415c1eff4fa09225ff816e93e16d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:31:06.407730 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81509d-4c34-47c0-badc-8f5b9c7a50bc None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:06.408327 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81509d-4c34-47c0-badc-8f5b9c7a50bc None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:06.408327 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81509d-4c34-47c0-badc-8f5b9c7a50bc None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:06.410118 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 754/1510] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 05:31:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:31:06.414725 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de393809-0053-45bc-93dc-5eb2742f2550 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:06.415189 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de393809-0053-45bc-93dc-5eb2742f2550 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:06.415287 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de393809-0053-45bc-93dc-5eb2742f2550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:06.433553 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-de393809-0053-45bc-93dc-5eb2742f2550 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:31:06.434737 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-de393809-0053-45bc-93dc-5eb2742f2550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:31:06.490444 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 757/1511] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 05:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:31:06.642367 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81509d-4c34-47c0-badc-8f5b9c7a50bc None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:31:06.644131 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6b81509d-4c34-47c0-badc-8f5b9c7a50bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:31:06.711407 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e481cd-4c81-4e1d-8745-d1586691f8e2 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:06.711693 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e481cd-4c81-4e1d-8745-d1586691f8e2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:06.712003 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e481cd-4c81-4e1d-8745-d1586691f8e2 None None] PATH_INFO: `/v3` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:06.713576 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 758/1512] 10.222.0.60 () {54 vars in 925 bytes} [Wed Feb 16 05:31:06 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:31:06.719292 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81509d-4c34-47c0-badc-8f5b9c7a50bc None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:31:06.720466 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78f915-538e-4666-9d6c-0393440bd86e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:06.720753 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78f915-538e-4666-9d6c-0393440bd86e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:06.721026 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78f915-538e-4666-9d6c-0393440bd86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:06.724762 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f222d56-fdd0-48a4-bfe5-9f81065f2a0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:31:06.725448 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f222d56-fdd0-48a4-bfe5-9f81065f2a0e service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:06.725796 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f222d56-fdd0-48a4-bfe5-9f81065f2a0e service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:06.726043 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f222d56-fdd0-48a4-bfe5-9f81065f2a0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:06.734316 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f222d56-fdd0-48a4-bfe5-9f81065f2a0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:31:06.736587 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f222d56-fdd0-48a4-bfe5-9f81065f2a0e service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:31:06.740691 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-fa78f915-538e-4666-9d6c-0393440bd86e None None] MFA Rules not processed for user `cc233f62146a49099216c6236fb2ee2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:31:06.741910 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-fa78f915-538e-4666-9d6c-0393440bd86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:31:06.746045 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 755/1513] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:31:06.802701 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 759/1514] 10.222.0.60 () {58 vars in 1015 bytes} [Wed Feb 16 05:31:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:31:08.087038 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d389a9-724f-4906-8e7e-25b9f3fbc525 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:08.087627 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d389a9-724f-4906-8e7e-25b9f3fbc525 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:08.087627 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d389a9-724f-4906-8e7e-25b9f3fbc525 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:08.089344 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 756/1515] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 05:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:31:08.094400 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1db717-d8cc-4f24-94a7-16df711c20ab None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:08.094845 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1db717-d8cc-4f24-94a7-16df711c20ab None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:08.094942 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1db717-d8cc-4f24-94a7-16df711c20ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:08.113124 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-fd1db717-d8cc-4f24-94a7-16df711c20ab None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:31:08.114372 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-fd1db717-d8cc-4f24-94a7-16df711c20ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:31:08.122303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 760/1516] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 05:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:31:08.278195 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d389a9-724f-4906-8e7e-25b9f3fbc525 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:31:08.293779 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d389a9-724f-4906-8e7e-25b9f3fbc525 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:31:08.299999 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a9193-199f-4838-8614-bc11b855405c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:31:08.300630 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a9193-199f-4838-8614-bc11b855405c service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:08.300907 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a9193-199f-4838-8614-bc11b855405c service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:08.301210 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a9193-199f-4838-8614-bc11b855405c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:08.309196 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a9193-199f-4838-8614-bc11b855405c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:31:08.310807 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a9193-199f-4838-8614-bc11b855405c service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:31:08.319833 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 757/1517] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:31:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:31:15.711828 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f971143-e58f-4eac-b401-cae099b6bad8 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:15.712384 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f971143-e58f-4eac-b401-cae099b6bad8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:15.712384 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f971143-e58f-4eac-b401-cae099b6bad8 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:15.714178 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 761/1518] 10.222.0.75 () {54 vars in 960 bytes} [Wed Feb 16 05:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:31:15.719212 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5670d-aefd-48f4-82f9-09b403210ffe None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:15.720186 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5670d-aefd-48f4-82f9-09b403210ffe None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:15.720292 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5670d-aefd-48f4-82f9-09b403210ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:15.740836 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-84e5670d-aefd-48f4-82f9-09b403210ffe None None] MFA Rules not processed for user `cc233f62146a49099216c6236fb2ee2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:31:15.742074 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-84e5670d-aefd-48f4-82f9-09b403210ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:31:15.750419 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 758/1519] 10.222.0.75 () {58 vars in 1057 bytes} [Wed Feb 16 05:31:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:31:15.757758 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f971143-e58f-4eac-b401-cae099b6bad8 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:31:15.770709 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f971143-e58f-4eac-b401-cae099b6bad8 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:31:15.775505 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1eb9e-12e0-497d-acde-ec736e266da3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc233f62146a49099216c6236fb2ee2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:31:15.776119 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1eb9e-12e0-497d-acde-ec736e266da3 service placement] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:15.776394 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1eb9e-12e0-497d-acde-ec736e266da3 service placement] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:15.776666 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1eb9e-12e0-497d-acde-ec736e266da3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:15.785174 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1eb9e-12e0-497d-acde-ec736e266da3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:31:15.786764 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1eb9e-12e0-497d-acde-ec736e266da3 service placement] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:31:15.796026 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 762/1520] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:31:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:31:20.003403 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c40ed-1d5a-4f64-bff8-e3b14cf9cdb1 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:20.003924 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c40ed-1d5a-4f64-bff8-e3b14cf9cdb1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:20.003924 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c40ed-1d5a-4f64-bff8-e3b14cf9cdb1 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:20.005684 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 759/1521] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 05:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:31:20.010462 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051e7ed-b6c0-4ca1-9c80-b5196f9c37f7 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:20.010851 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051e7ed-b6c0-4ca1-9c80-b5196f9c37f7 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:20.011044 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051e7ed-b6c0-4ca1-9c80-b5196f9c37f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:20.029019 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-7051e7ed-b6c0-4ca1-9c80-b5196f9c37f7 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:31:20.030241 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7051e7ed-b6c0-4ca1-9c80-b5196f9c37f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:31:20.038635 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 763/1522] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 05:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:31:20.189431 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c40ed-1d5a-4f64-bff8-e3b14cf9cdb1 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:31:20.203277 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c40ed-1d5a-4f64-bff8-e3b14cf9cdb1 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:31:20.209112 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d84fe5-7f37-4225-b5dc-e3b08d404311 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:31:20.209753 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d84fe5-7f37-4225-b5dc-e3b08d404311 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:20.210032 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d84fe5-7f37-4225-b5dc-e3b08d404311 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:20.210302 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d84fe5-7f37-4225-b5dc-e3b08d404311 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:20.218083 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d84fe5-7f37-4225-b5dc-e3b08d404311 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:31:20.219675 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d84fe5-7f37-4225-b5dc-e3b08d404311 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:31:20.228645 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 760/1523] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:31:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:31:21.571068 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6473a-326a-4cc2-a6b3-b309d636ca3b None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:21.571637 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6473a-326a-4cc2-a6b3-b309d636ca3b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:21.571637 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6473a-326a-4cc2-a6b3-b309d636ca3b None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:21.573487 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 764/1524] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 16 05:31:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:31:21.578595 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681856b-d6af-43f6-9b9c-e5050ebd48f2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:21.579032 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681856b-d6af-43f6-9b9c-e5050ebd48f2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:21.579133 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681856b-d6af-43f6-9b9c-e5050ebd48f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:21.596573 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-d681856b-d6af-43f6-9b9c-e5050ebd48f2 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:31:21.597784 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d681856b-d6af-43f6-9b9c-e5050ebd48f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:31:21.605445 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 761/1525] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 16 05:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:31:21.758730 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6473a-326a-4cc2-a6b3-b309d636ca3b None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:31:21.773051 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6473a-326a-4cc2-a6b3-b309d636ca3b None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:31:21.778409 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755114b-7462-4d9c-a7e6-b597f5e53f0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:31:21.779029 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755114b-7462-4d9c-a7e6-b597f5e53f0e service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:21.779308 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755114b-7462-4d9c-a7e6-b597f5e53f0e service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:21.779582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755114b-7462-4d9c-a7e6-b597f5e53f0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:21.787930 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755114b-7462-4d9c-a7e6-b597f5e53f0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:31:21.789528 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755114b-7462-4d9c-a7e6-b597f5e53f0e service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:31:21.799467 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 765/1526] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:31:25.936568 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceaaf02-7723-4aff-b1b5-cfdee4e2561c None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:25.937149 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceaaf02-7723-4aff-b1b5-cfdee4e2561c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:25.937149 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceaaf02-7723-4aff-b1b5-cfdee4e2561c None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:25.939452 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 762/1527] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 05:31:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:31:25.944545 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb476c-e750-48e3-8ce6-c9de0d61d8df None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:25.944945 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb476c-e750-48e3-8ce6-c9de0d61d8df None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:25.945094 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb476c-e750-48e3-8ce6-c9de0d61d8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:25.962667 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-eacb476c-e750-48e3-8ce6-c9de0d61d8df None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:31:25.963838 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-eacb476c-e750-48e3-8ce6-c9de0d61d8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:31:25.971482 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 766/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 05:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:31:26.007119 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceaaf02-7723-4aff-b1b5-cfdee4e2561c None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:31:26.008873 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9ceaaf02-7723-4aff-b1b5-cfdee4e2561c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:31:26.065815 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceaaf02-7723-4aff-b1b5-cfdee4e2561c None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:31:26.069516 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8dc36-b152-4949-a6cf-a75f6e01f307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:31:26.070206 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8dc36-b152-4949-a6cf-a75f6e01f307 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:26.070483 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8dc36-b152-4949-a6cf-a75f6e01f307 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:26.070753 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8dc36-b152-4949-a6cf-a75f6e01f307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:26.083736 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8dc36-b152-4949-a6cf-a75f6e01f307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:31:26.085218 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8dc36-b152-4949-a6cf-a75f6e01f307 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:31:26.095323 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 763/1529] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:31:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:31:28.359444 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12971392-46b1-4404-916d-f97e4f8af37d None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:28.360017 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12971392-46b1-4404-916d-f97e4f8af37d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:28.360017 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12971392-46b1-4404-916d-f97e4f8af37d None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:28.361837 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 767/1530] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 05:31:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 05:31:28.367176 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6596a-eba9-4693-a029-182c0fa4f56a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:28.367570 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6596a-eba9-4693-a029-182c0fa4f56a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:28.367732 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6596a-eba9-4693-a029-182c0fa4f56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:28.386349 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-27e6596a-eba9-4693-a029-182c0fa4f56a None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:31:28.387658 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-27e6596a-eba9-4693-a029-182c0fa4f56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:31:28.396305 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 764/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 05:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:31:28.431968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12971392-46b1-4404-916d-f97e4f8af37d None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:31:28.442865 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12971392-46b1-4404-916d-f97e4f8af37d None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:31:28.446330 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d1182-13c1-4d74-b883-a3990276e346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:31:28.446941 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d1182-13c1-4d74-b883-a3990276e346 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:28.447213 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d1182-13c1-4d74-b883-a3990276e346 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:28.447477 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d1182-13c1-4d74-b883-a3990276e346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:28.456514 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d1182-13c1-4d74-b883-a3990276e346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:31:28.458165 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d1182-13c1-4d74-b883-a3990276e346 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:31:28.467131 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 768/1532] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:31:32.225197 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5133c-73b4-44f4-8861-d211cebb4751 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:32.225759 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5133c-73b4-44f4-8861-d211cebb4751 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:32.225759 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5133c-73b4-44f4-8861-d211cebb4751 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:32.227537 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 765/1533] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 05:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:31:32.232790 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886016cf-5c81-4918-b97a-8b7652820109 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:32.233196 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886016cf-5c81-4918-b97a-8b7652820109 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:32.233346 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886016cf-5c81-4918-b97a-8b7652820109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:32.251680 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-886016cf-5c81-4918-b97a-8b7652820109 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:31:32.252865 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-886016cf-5c81-4918-b97a-8b7652820109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:31:32.260543 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 769/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 05:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:31:32.511373 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5133c-73b4-44f4-8861-d211cebb4751 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:31:32.512997 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4ed5133c-73b4-44f4-8861-d211cebb4751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:31:32.576120 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5133c-73b4-44f4-8861-d211cebb4751 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:31:32.579730 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f1adb-a92f-42a6-9cbd-4d770951b67f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:31:32.580361 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f1adb-a92f-42a6-9cbd-4d770951b67f service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:32.580640 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f1adb-a92f-42a6-9cbd-4d770951b67f service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:32.580914 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f1adb-a92f-42a6-9cbd-4d770951b67f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:32.589631 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f1adb-a92f-42a6-9cbd-4d770951b67f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:31:32.591072 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f1adb-a92f-42a6-9cbd-4d770951b67f service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:31:32.600185 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 766/1535] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:31:34.941303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7b236-58be-4de6-a4e3-7b808baa8471 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:34.941811 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7b236-58be-4de6-a4e3-7b808baa8471 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:34.941811 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7b236-58be-4de6-a4e3-7b808baa8471 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:34.943565 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 770/1536] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 16 05:31:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:31:34.948872 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cbdfa-3dbc-4c94-b84c-3c2bef32ebe2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:34.949307 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cbdfa-3dbc-4c94-b84c-3c2bef32ebe2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:34.949483 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cbdfa-3dbc-4c94-b84c-3c2bef32ebe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:34.967182 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-231cbdfa-3dbc-4c94-b84c-3c2bef32ebe2 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:31:34.968381 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-231cbdfa-3dbc-4c94-b84c-3c2bef32ebe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:31:34.976732 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 767/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 16 05:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:31:35.227206 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f65bd-6ab9-4dad-b3f0-7a809a7d42b6 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:35.227420 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f65bd-6ab9-4dad-b3f0-7a809a7d42b6 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:35.227685 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f65bd-6ab9-4dad-b3f0-7a809a7d42b6 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:35.229521 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 771/1538] 10.222.0.75 () {54 vars in 963 bytes} [Wed Feb 16 05:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:31:35.234594 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de4b1c-fc28-40f4-a2e5-a990180d70b2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:35.234881 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de4b1c-fc28-40f4-a2e5-a990180d70b2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:35.235156 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de4b1c-fc28-40f4-a2e5-a990180d70b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:35.253394 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-a6de4b1c-fc28-40f4-a2e5-a990180d70b2 None None] MFA Rules not processed for user `ff019ca0eef8455ba680191b8ae1fdba`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:31:35.254547 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a6de4b1c-fc28-40f4-a2e5-a990180d70b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:31:35.260803 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 768/1539] 10.222.0.75 () {58 vars in 1060 bytes} [Wed Feb 16 05:31:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:31:35.268782 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f65bd-6ab9-4dad-b3f0-7a809a7d42b6 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:31:35.279070 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f65bd-6ab9-4dad-b3f0-7a809a7d42b6 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:31:35.282573 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df1ba2-81a4-4523-b6da-c32bc028f778 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:31:35.283184 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df1ba2-81a4-4523-b6da-c32bc028f778 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:31:35.283464 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df1ba2-81a4-4523-b6da-c32bc028f778 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:31:35.283737 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df1ba2-81a4-4523-b6da-c32bc028f778 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:31:35.292674 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df1ba2-81a4-4523-b6da-c32bc028f778 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:31:35.295161 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df1ba2-81a4-4523-b6da-c32bc028f778 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:31:35.304506 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 772/1540] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:32:58.393991 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61f13f-86f3-4165-8c40-98488cc56f59 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.394621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61f13f-86f3-4165-8c40-98488cc56f59 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.394621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61f13f-86f3-4165-8c40-98488cc56f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.423285 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-4d61f13f-86f3-4165-8c40-98488cc56f59 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:32:58.424525 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4d61f13f-86f3-4165-8c40-98488cc56f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:32:58.440959 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 769/1541] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:32:58.450718 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125518f-871f-4f07-a244-61488965d903 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.451329 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125518f-871f-4f07-a244-61488965d903 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.451329 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125518f-871f-4f07-a244-61488965d903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.478432 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2125518f-871f-4f07-a244-61488965d903 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:32:58.480137 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2125518f-871f-4f07-a244-61488965d903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:32:58.493717 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 773/1542] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:32:58.499066 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61f13f-86f3-4165-8c40-98488cc56f59 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:58.514077 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61f13f-86f3-4165-8c40-98488cc56f59 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:58.521883 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61fd9e-fb1c-4769-9f50-9b930e739d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:58.522841 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61fd9e-fb1c-4769-9f50-9b930e739d14 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.523142 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61fd9e-fb1c-4769-9f50-9b930e739d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.523396 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61fd9e-fb1c-4769-9f50-9b930e739d14 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.524141 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61fd9e-fb1c-4769-9f50-9b930e739d14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:32:58.524450 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61fd9e-fb1c-4769-9f50-9b930e739d14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:58.526218 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61fd9e-fb1c-4769-9f50-9b930e739d14 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:58.535629 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dee713-47e0-440c-b8c9-d4e6f59a513a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.535970 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dee713-47e0-440c-b8c9-d4e6f59a513a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.536175 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dee713-47e0-440c-b8c9-d4e6f59a513a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.547441 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 770/1543] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:32:58.549997 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a991eb-6008-4576-b836-0679b5f9b7ff None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.550136 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a991eb-6008-4576-b836-0679b5f9b7ff None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.550357 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a991eb-6008-4576-b836-0679b5f9b7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.570987 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-c7dee713-47e0-440c-b8c9-d4e6f59a513a None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:32:58.572845 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c7dee713-47e0-440c-b8c9-d4e6f59a513a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:32:58.587067 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-04a991eb-6008-4576-b836-0679b5f9b7ff None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:32:58.588299 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-04a991eb-6008-4576-b836-0679b5f9b7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:32:58.602183 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 774/1544] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:32:58.603515 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa31e70-12a5-429a-a219-97d86a52dd68 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.603797 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa31e70-12a5-429a-a219-97d86a52dd68 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.604059 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa31e70-12a5-429a-a219-97d86a52dd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.616138 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 771/1545] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:32:58.617074 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a991eb-6008-4576-b836-0679b5f9b7ff None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:58.628649 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a991eb-6008-4576-b836-0679b5f9b7ff None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:58.632082 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-cfa31e70-12a5-429a-a219-97d86a52dd68 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:32:58.633604 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cfa31e70-12a5-429a-a219-97d86a52dd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:32:58.633739 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfadfc0f-e9dc-46dc-aac5-83c73aa732df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:58.634384 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadfc0f-e9dc-46dc-aac5-83c73aa732df admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.634686 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadfc0f-e9dc-46dc-aac5-83c73aa732df admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.634959 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadfc0f-e9dc-46dc-aac5-83c73aa732df admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.635645 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadfc0f-e9dc-46dc-aac5-83c73aa732df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:58.637773 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfadfc0f-e9dc-46dc-aac5-83c73aa732df admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:58.642896 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 775/1546] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:32:58.643958 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa76ba-bffd-4f77-aed4-95253afdbb3b None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.644308 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa76ba-bffd-4f77-aed4-95253afdbb3b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.644515 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa76ba-bffd-4f77-aed4-95253afdbb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.663685 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-cbfa76ba-bffd-4f77-aed4-95253afdbb3b None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:32:58.664882 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cbfa76ba-bffd-4f77-aed4-95253afdbb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:32:58.668817 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 772/1547] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:32:58 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:32:58.668981 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28284bf4-0022-4392-a73f-62e37f431196 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.669227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28284bf4-0022-4392-a73f-62e37f431196 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.669538 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28284bf4-0022-4392-a73f-62e37f431196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.688652 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-28284bf4-0022-4392-a73f-62e37f431196 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:32:58.689948 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-28284bf4-0022-4392-a73f-62e37f431196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:32:58.727748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 776/1548] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:32:58.729056 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734b7e9-a141-485d-85e5-1c216ec5f649 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.729466 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734b7e9-a141-485d-85e5-1c216ec5f649 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.729837 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734b7e9-a141-485d-85e5-1c216ec5f649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.747000 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-5734b7e9-a141-485d-85e5-1c216ec5f649 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:32:58.748187 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5734b7e9-a141-485d-85e5-1c216ec5f649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:32:58.748365 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 773/1549] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:32:58.750753 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed07ce-9d1f-44ca-8f00-da124948cc03 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.751036 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed07ce-9d1f-44ca-8f00-da124948cc03 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.751312 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed07ce-9d1f-44ca-8f00-da124948cc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.756832 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 777/1550] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:32:58.758132 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3587ac0-e26a-47a0-a5c1-8385d2cf6534 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.758471 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3587ac0-e26a-47a0-a5c1-8385d2cf6534 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.758797 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3587ac0-e26a-47a0-a5c1-8385d2cf6534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.770279 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-6fed07ce-9d1f-44ca-8f00-da124948cc03 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:32:58.771478 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6fed07ce-9d1f-44ca-8f00-da124948cc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:32:58.777662 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-c3587ac0-e26a-47a0-a5c1-8385d2cf6534 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:32:58.778824 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c3587ac0-e26a-47a0-a5c1-8385d2cf6534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:32:58.779255 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 774/1551] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:32:58.780508 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7faf7-aa7a-4b88-8b38-1e7e0bb96cb6 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.780894 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7faf7-aa7a-4b88-8b38-1e7e0bb96cb6 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.781070 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7faf7-aa7a-4b88-8b38-1e7e0bb96cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.789354 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 778/1552] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:32:58.794099 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e333195-8d24-48a4-8d5e-907b0b48848d None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.794454 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e333195-8d24-48a4-8d5e-907b0b48848d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.794790 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e333195-8d24-48a4-8d5e-907b0b48848d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.800551 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-aec7faf7-aa7a-4b88-8b38-1e7e0bb96cb6 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:32:58.801765 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-aec7faf7-aa7a-4b88-8b38-1e7e0bb96cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:32:58.809765 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 775/1553] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:32:58.810487 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7faf7-aa7a-4b88-8b38-1e7e0bb96cb6 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:58.813749 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4e333195-8d24-48a4-8d5e-907b0b48848d None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:32:58.814979 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4e333195-8d24-48a4-8d5e-907b0b48848d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:32:58.820172 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7faf7-aa7a-4b88-8b38-1e7e0bb96cb6 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:58.823235 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 779/1554] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:32:58.824546 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd40e8f-c0b4-4cc9-afe1-9ab8261991b0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.824788 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd40e8f-c0b4-4cc9-afe1-9ab8261991b0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.825058 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd40e8f-c0b4-4cc9-afe1-9ab8261991b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.825207 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7de225-f968-4215-b771-7c4cfcd28331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:58.825937 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7de225-f968-4215-b771-7c4cfcd28331 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.826315 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7de225-f968-4215-b771-7c4cfcd28331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.827033 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7de225-f968-4215-b771-7c4cfcd28331 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.827798 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7de225-f968-4215-b771-7c4cfcd28331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:58.829843 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7de225-f968-4215-b771-7c4cfcd28331 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:58.842964 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-cfd40e8f-c0b4-4cc9-afe1-9ab8261991b0 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:32:58.844192 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cfd40e8f-c0b4-4cc9-afe1-9ab8261991b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:32:58.849949 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 776/1555] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:32:58 2022] POST /identity/v3/users => generated 290 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:32:58.850749 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7de225-f968-4215-b771-7c4cfcd28331 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:58.855437 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 780/1556] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:32:58.856530 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7fae3-2b91-4888-9c19-7b840aa343f9 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.856813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7fae3-2b91-4888-9c19-7b840aa343f9 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.857085 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7fae3-2b91-4888-9c19-7b840aa343f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.863096 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7de225-f968-4215-b771-7c4cfcd28331 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:58.868480 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6dd78-b245-40ac-b095-f47e4b702134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:58.869129 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6dd78-b245-40ac-b095-f47e4b702134 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.869443 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6dd78-b245-40ac-b095-f47e4b702134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.869718 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6dd78-b245-40ac-b095-f47e4b702134 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.870446 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6dd78-b245-40ac-b095-f47e4b702134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:32:58.870753 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6dd78-b245-40ac-b095-f47e4b702134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:58.872401 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6dd78-b245-40ac-b095-f47e4b702134 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:58.879625 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4ec7fae3-2b91-4888-9c19-7b840aa343f9 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:32:58.880842 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4ec7fae3-2b91-4888-9c19-7b840aa343f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:32:58.888615 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 777/1557] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:32:58.888769 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 781/1558] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:32:58.889995 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6dd78-b245-40ac-b095-f47e4b702134 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:58.890140 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54c117-8a6e-4335-8aae-15eb70248046 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.890324 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54c117-8a6e-4335-8aae-15eb70248046 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.890598 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54c117-8a6e-4335-8aae-15eb70248046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.904968 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6dd78-b245-40ac-b095-f47e4b702134 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:58.908810 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-7b54c117-8a6e-4335-8aae-15eb70248046 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:32:58.909551 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883147b0-31d6-4db1-b530-4723a6280875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:58.910026 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7b54c117-8a6e-4335-8aae-15eb70248046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:32:58.910197 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883147b0-31d6-4db1-b530-4723a6280875 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.910480 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883147b0-31d6-4db1-b530-4723a6280875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.910757 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883147b0-31d6-4db1-b530-4723a6280875 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.911499 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883147b0-31d6-4db1-b530-4723a6280875 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:32:58.911814 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883147b0-31d6-4db1-b530-4723a6280875 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:58.913485 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883147b0-31d6-4db1-b530-4723a6280875 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:58.917744 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 782/1559] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:32:58.918948 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59039c31-0005-41bc-bb47-2ca43171106d None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.919234 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59039c31-0005-41bc-bb47-2ca43171106d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.919510 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59039c31-0005-41bc-bb47-2ca43171106d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.926145 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 778/1560] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:32:58.926946 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883147b0-31d6-4db1-b530-4723a6280875 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:58.937753 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883147b0-31d6-4db1-b530-4723a6280875 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:58.938577 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-59039c31-0005-41bc-bb47-2ca43171106d None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:32:58.939772 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-59039c31-0005-41bc-bb47-2ca43171106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:32:58.943058 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663ef0b-5e7a-44d5-b18c-c14cc870bd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:58.943694 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663ef0b-5e7a-44d5-b18c-c14cc870bd52 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.943975 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663ef0b-5e7a-44d5-b18c-c14cc870bd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.944249 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663ef0b-5e7a-44d5-b18c-c14cc870bd52 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.944965 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663ef0b-5e7a-44d5-b18c-c14cc870bd52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:32:58.945299 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663ef0b-5e7a-44d5-b18c-c14cc870bd52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:58.946915 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663ef0b-5e7a-44d5-b18c-c14cc870bd52 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:58.947657 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 783/1561] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:32:58.951446 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59039c31-0005-41bc-bb47-2ca43171106d None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:58.957340 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59039c31-0005-41bc-bb47-2ca43171106d None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:58.961822 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d51dd5-f8d8-4f30-8933-7f7182f6ceaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:58.962444 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d51dd5-f8d8-4f30-8933-7f7182f6ceaf admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.962722 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d51dd5-f8d8-4f30-8933-7f7182f6ceaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.962998 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d51dd5-f8d8-4f30-8933-7f7182f6ceaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.963102 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 779/1562] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:32:58.963714 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d51dd5-f8d8-4f30-8933-7f7182f6ceaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:58.963858 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663ef0b-5e7a-44d5-b18c-c14cc870bd52 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:58.965334 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d51dd5-f8d8-4f30-8933-7f7182f6ceaf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:58.973048 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663ef0b-5e7a-44d5-b18c-c14cc870bd52 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:58.975245 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 784/1563] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:32:58.976044 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d51dd5-f8d8-4f30-8933-7f7182f6ceaf admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:58.978818 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ec11e-d06b-4f13-86d8-778d4130678c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:58.979454 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ec11e-d06b-4f13-86d8-778d4130678c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.979733 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ec11e-d06b-4f13-86d8-778d4130678c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.980004 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ec11e-d06b-4f13-86d8-778d4130678c admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.980753 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ec11e-d06b-4f13-86d8-778d4130678c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:32:58.981198 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ec11e-d06b-4f13-86d8-778d4130678c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:58.983374 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ec11e-d06b-4f13-86d8-778d4130678c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:58.985759 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d51dd5-f8d8-4f30-8933-7f7182f6ceaf admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:58.990294 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89010b-6321-40a7-ad38-cafffab35806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:58.990907 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89010b-6321-40a7-ad38-cafffab35806 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:58.991184 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89010b-6321-40a7-ad38-cafffab35806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:58.991452 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89010b-6321-40a7-ad38-cafffab35806 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:58.992151 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89010b-6321-40a7-ad38-cafffab35806 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:32:58.992451 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89010b-6321-40a7-ad38-cafffab35806 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:58.994072 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89010b-6321-40a7-ad38-cafffab35806 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:58.994778 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 780/1564] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:32:58.995526 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ec11e-d06b-4f13-86d8-778d4130678c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.005249 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ec11e-d06b-4f13-86d8-778d4130678c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.009924 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc890b9a-d06d-44cb-9e58-f0291879addf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.010537 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc890b9a-d06d-44cb-9e58-f0291879addf admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.010814 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc890b9a-d06d-44cb-9e58-f0291879addf admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.011082 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc890b9a-d06d-44cb-9e58-f0291879addf admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.011294 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 785/1565] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:32:59.011897 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc890b9a-d06d-44cb-9e58-f0291879addf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.012100 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89010b-6321-40a7-ad38-cafffab35806 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.013817 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc890b9a-d06d-44cb-9e58-f0291879addf admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.021531 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89010b-6321-40a7-ad38-cafffab35806 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.026004 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c807f-d15b-4882-8c93-3b6b7c054749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.026622 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c807f-d15b-4882-8c93-3b6b7c054749 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.026900 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c807f-d15b-4882-8c93-3b6b7c054749 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.027171 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c807f-d15b-4882-8c93-3b6b7c054749 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.027875 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c807f-d15b-4882-8c93-3b6b7c054749 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:32:59.028177 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c807f-d15b-4882-8c93-3b6b7c054749 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.029814 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c807f-d15b-4882-8c93-3b6b7c054749 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.039800 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 781/1566] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:32:58 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:32:59.041303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 786/1567] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:32:59.041982 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c807f-d15b-4882-8c93-3b6b7c054749 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.046754 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc890b9a-d06d-44cb-9e58-f0291879addf admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.052381 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c807f-d15b-4882-8c93-3b6b7c054749 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.104887 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7e2fe-203b-49e7-b684-80b5e4bf6c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.105497 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7e2fe-203b-49e7-b684-80b5e4bf6c35 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.105780 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7e2fe-203b-49e7-b684-80b5e4bf6c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.106053 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa7e2fe-203b-49e7-b684-80b5e4bf6c35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.106215 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc890b9a-d06d-44cb-9e58-f0291879addf admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.106764 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7e2fe-203b-49e7-b684-80b5e4bf6c35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:32:59.107697 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7e2fe-203b-49e7-b684-80b5e4bf6c35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.109888 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa7e2fe-203b-49e7-b684-80b5e4bf6c35 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.111737 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502d948-6524-4762-8e67-2d98fe61c698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.112486 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502d948-6524-4762-8e67-2d98fe61c698 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.112835 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502d948-6524-4762-8e67-2d98fe61c698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.113179 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502d948-6524-4762-8e67-2d98fe61c698 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.113971 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502d948-6524-4762-8e67-2d98fe61c698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.116005 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502d948-6524-4762-8e67-2d98fe61c698 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.121126 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 787/1568] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:32:59.121926 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7e2fe-203b-49e7-b684-80b5e4bf6c35 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.137832 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa7e2fe-203b-49e7-b684-80b5e4bf6c35 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.145217 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 782/1569] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:32:59 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:32:59.145389 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffaf313-7022-403c-b246-52b5cb7b3321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.145501 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502d948-6524-4762-8e67-2d98fe61c698 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.145605 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffaf313-7022-403c-b246-52b5cb7b3321 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.145605 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffaf313-7022-403c-b246-52b5cb7b3321 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.145605 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffaf313-7022-403c-b246-52b5cb7b3321 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.145605 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffaf313-7022-403c-b246-52b5cb7b3321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.146391 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffaf313-7022-403c-b246-52b5cb7b3321 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.177125 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 788/1570] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:32:59 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:32:59.177125 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffaf313-7022-403c-b246-52b5cb7b3321 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.205569 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502d948-6524-4762-8e67-2d98fe61c698 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.234652 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffaf313-7022-403c-b246-52b5cb7b3321 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.239268 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bcdbc-ba4c-47a6-9ad6-94c32b4674fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.239913 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bcdbc-ba4c-47a6-9ad6-94c32b4674fa admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.240194 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bcdbc-ba4c-47a6-9ad6-94c32b4674fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.240467 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bcdbc-ba4c-47a6-9ad6-94c32b4674fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.241140 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530bcdbc-ba4c-47a6-9ad6-94c32b4674fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.243085 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530bcdbc-ba4c-47a6-9ad6-94c32b4674fa admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.259108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad8dd7-5a7a-47a1-81d6-844ee42c622d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.259788 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad8dd7-5a7a-47a1-81d6-844ee42c622d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.260086 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad8dd7-5a7a-47a1-81d6-844ee42c622d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.260434 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad8dd7-5a7a-47a1-81d6-844ee42c622d admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.261190 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad8dd7-5a7a-47a1-81d6-844ee42c622d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.262829 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad8dd7-5a7a-47a1-81d6-844ee42c622d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.267144 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 789/1571] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:32:59 2022] POST /identity/v3/projects => generated 361 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:32:59.267945 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bcdbc-ba4c-47a6-9ad6-94c32b4674fa admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.276003 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 783/1572] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:32:59.276003 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad8dd7-5a7a-47a1-81d6-844ee42c622d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.283331 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad8dd7-5a7a-47a1-81d6-844ee42c622d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.327671 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bcdbc-ba4c-47a6-9ad6-94c32b4674fa admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.332392 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95344a8c-2b75-4156-9bf9-a61696bb075c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.333031 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95344a8c-2b75-4156-9bf9-a61696bb075c admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.333343 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95344a8c-2b75-4156-9bf9-a61696bb075c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.333620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95344a8c-2b75-4156-9bf9-a61696bb075c admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.334294 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95344a8c-2b75-4156-9bf9-a61696bb075c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.336291 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95344a8c-2b75-4156-9bf9-a61696bb075c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.337903 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0149dc7-90b9-4476-85f9-25666c52bf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.338553 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0149dc7-90b9-4476-85f9-25666c52bf0f admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.338834 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0149dc7-90b9-4476-85f9-25666c52bf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.339109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0149dc7-90b9-4476-85f9-25666c52bf0f admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.339818 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0149dc7-90b9-4476-85f9-25666c52bf0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.341802 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0149dc7-90b9-4476-85f9-25666c52bf0f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.362525 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 784/1573] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:32:59 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:32:59.365972 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 790/1574] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:32:59 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:32:59.365972 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95344a8c-2b75-4156-9bf9-a61696bb075c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.366162 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0149dc7-90b9-4476-85f9-25666c52bf0f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.375149 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0149dc7-90b9-4476-85f9-25666c52bf0f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.427864 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95344a8c-2b75-4156-9bf9-a61696bb075c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.431061 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705ca28-280d-45e4-b2ef-581482a808dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.431731 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705ca28-280d-45e4-b2ef-581482a808dc admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.432009 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705ca28-280d-45e4-b2ef-581482a808dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.432281 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a705ca28-280d-45e4-b2ef-581482a808dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.432424 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df0f28-0632-4f21-8ccd-caabdcb34bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.432988 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705ca28-280d-45e4-b2ef-581482a808dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.433135 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df0f28-0632-4f21-8ccd-caabdcb34bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.433368 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df0f28-0632-4f21-8ccd-caabdcb34bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.433771 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df0f28-0632-4f21-8ccd-caabdcb34bc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.434457 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df0f28-0632-4f21-8ccd-caabdcb34bc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.434939 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a705ca28-280d-45e4-b2ef-581482a808dc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.436387 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df0f28-0632-4f21-8ccd-caabdcb34bc7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.460065 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 785/1575] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:32:59 2022] POST /identity/v3/projects => generated 405 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:32:59.460849 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705ca28-280d-45e4-b2ef-581482a808dc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.461823 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 791/1576] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:32:59 2022] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:32:59.462534 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df0f28-0632-4f21-8ccd-caabdcb34bc7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.523670 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df0f28-0632-4f21-8ccd-caabdcb34bc7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.524461 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a705ca28-280d-45e4-b2ef-581482a808dc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.528272 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a607a-396c-4968-b440-0ad4b163a17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.528928 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a607a-396c-4968-b440-0ad4b163a17c admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.529062 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868beff-c214-41a4-bc8b-167c3ccbc6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.529209 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a607a-396c-4968-b440-0ad4b163a17c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.529506 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a607a-396c-4968-b440-0ad4b163a17c admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.530303 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868beff-c214-41a4-bc8b-167c3ccbc6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.530584 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868beff-c214-41a4-bc8b-167c3ccbc6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.530699 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a607a-396c-4968-b440-0ad4b163a17c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.530873 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868beff-c214-41a4-bc8b-167c3ccbc6a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.531539 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868beff-c214-41a4-bc8b-167c3ccbc6a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.532604 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a607a-396c-4968-b440-0ad4b163a17c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.533598 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868beff-c214-41a4-bc8b-167c3ccbc6a2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.555599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 792/1577] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:32:59 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:32:59.555599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a607a-396c-4968-b440-0ad4b163a17c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.555889 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 786/1578] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:32:59 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:32:59.555889 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868beff-c214-41a4-bc8b-167c3ccbc6a2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.564594 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868beff-c214-41a4-bc8b-167c3ccbc6a2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.564727 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a607a-396c-4968-b440-0ad4b163a17c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.569104 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e45d2f-be18-4028-9b5f-d4abf28c2724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.569237 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e228ed-ffa8-47ab-a423-e400ec61ab74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.569815 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e228ed-ffa8-47ab-a423-e400ec61ab74 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.570023 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e45d2f-be18-4028-9b5f-d4abf28c2724 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.570148 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e228ed-ffa8-47ab-a423-e400ec61ab74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.570298 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e45d2f-be18-4028-9b5f-d4abf28c2724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.570402 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e228ed-ffa8-47ab-a423-e400ec61ab74 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.570569 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e45d2f-be18-4028-9b5f-d4abf28c2724 admin admin] PATH_INFO: `/v3/projects/f8c0817ca34947d797da354bfc2aa372/users/937df27c7eb1402b80a735a24170f074/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.571049 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e228ed-ffa8-47ab-a423-e400ec61ab74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.572948 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e228ed-ffa8-47ab-a423-e400ec61ab74 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.588798 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e45d2f-be18-4028-9b5f-d4abf28c2724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c0817ca34947d797da354bfc2aa372, user_id=937df27c7eb1402b80a735a24170f074, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.591634 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e45d2f-be18-4028-9b5f-d4abf28c2724 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.594395 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 793/1579] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:32:59 2022] POST /identity/v3/users => generated 281 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:32:59.595352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e228ed-ffa8-47ab-a423-e400ec61ab74 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.605383 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e228ed-ffa8-47ab-a423-e400ec61ab74 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.607292 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 787/1580] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:32:59 2022] PUT /identity/v3/projects/f8c0817ca34947d797da354bfc2aa372/users/937df27c7eb1402b80a735a24170f074/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:32:59.608093 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e45d2f-be18-4028-9b5f-d4abf28c2724 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.662421 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4709d45-a802-4101-a661-c9b189a52050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.663084 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4709d45-a802-4101-a661-c9b189a52050 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.663367 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4709d45-a802-4101-a661-c9b189a52050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.663643 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4709d45-a802-4101-a661-c9b189a52050 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.664366 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4709d45-a802-4101-a661-c9b189a52050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.666015 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4709d45-a802-4101-a661-c9b189a52050 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.671423 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e45d2f-be18-4028-9b5f-d4abf28c2724 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.675944 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 794/1581] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:32:59.676291 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183ba5d-d3de-48cf-9b7b-4a9bf7d21946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.676859 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4709d45-a802-4101-a661-c9b189a52050 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.676969 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183ba5d-d3de-48cf-9b7b-4a9bf7d21946 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.677219 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183ba5d-d3de-48cf-9b7b-4a9bf7d21946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.677534 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183ba5d-d3de-48cf-9b7b-4a9bf7d21946 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.678277 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4183ba5d-d3de-48cf-9b7b-4a9bf7d21946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.680417 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4183ba5d-d3de-48cf-9b7b-4a9bf7d21946 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.687378 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4709d45-a802-4101-a661-c9b189a52050 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.692386 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39425749-46cf-4c72-92e9-bd8a192b5a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.693123 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39425749-46cf-4c72-92e9-bd8a192b5a38 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.693507 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39425749-46cf-4c72-92e9-bd8a192b5a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.693921 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39425749-46cf-4c72-92e9-bd8a192b5a38 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.694702 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39425749-46cf-4c72-92e9-bd8a192b5a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.696824 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39425749-46cf-4c72-92e9-bd8a192b5a38 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.705659 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 788/1582] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:32:59 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:32:59.705659 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183ba5d-d3de-48cf-9b7b-4a9bf7d21946 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.713315 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183ba5d-d3de-48cf-9b7b-4a9bf7d21946 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.718710 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca35b3-f2f9-4a48-a819-a224ef72a150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.719355 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca35b3-f2f9-4a48-a819-a224ef72a150 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.719632 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca35b3-f2f9-4a48-a819-a224ef72a150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.719770 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 795/1583] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:32:59 2022] POST /identity/v3/users => generated 303 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:32:59.722895 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca35b3-f2f9-4a48-a819-a224ef72a150 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.722998 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39425749-46cf-4c72-92e9-bd8a192b5a38 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.723083 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca35b3-f2f9-4a48-a819-a224ef72a150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.723083 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca35b3-f2f9-4a48-a819-a224ef72a150 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.729863 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39425749-46cf-4c72-92e9-bd8a192b5a38 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.734552 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a86810-0010-4717-9c55-5cda5ba3f5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.735190 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a86810-0010-4717-9c55-5cda5ba3f5de admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.735471 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a86810-0010-4717-9c55-5cda5ba3f5de admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.735739 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a86810-0010-4717-9c55-5cda5ba3f5de admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.736473 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a86810-0010-4717-9c55-5cda5ba3f5de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.738069 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a86810-0010-4717-9c55-5cda5ba3f5de admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.742486 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 789/1584] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:32:59 2022] POST /identity/v3/users => generated 297 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:32:59.743270 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca35b3-f2f9-4a48-a819-a224ef72a150 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.751485 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 796/1585] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:32:59.751485 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a86810-0010-4717-9c55-5cda5ba3f5de admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.752866 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca35b3-f2f9-4a48-a819-a224ef72a150 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.757568 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab00a11-c181-49b0-ab5f-857358faa133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.758248 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab00a11-c181-49b0-ab5f-857358faa133 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.758535 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab00a11-c181-49b0-ab5f-857358faa133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.758811 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab00a11-c181-49b0-ab5f-857358faa133 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.759530 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab00a11-c181-49b0-ab5f-857358faa133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.760429 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a86810-0010-4717-9c55-5cda5ba3f5de admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.761155 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab00a11-c181-49b0-ab5f-857358faa133 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.765544 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da1c75-2aea-4b66-9080-2b9d9341e5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.766168 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da1c75-2aea-4b66-9080-2b9d9341e5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.766445 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da1c75-2aea-4b66-9080-2b9d9341e5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.766716 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da1c75-2aea-4b66-9080-2b9d9341e5b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.767562 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da1c75-2aea-4b66-9080-2b9d9341e5b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.769127 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da1c75-2aea-4b66-9080-2b9d9341e5b7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.772380 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 790/1586] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:32:59.773635 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bd7f7-5c4f-419e-bf59-0e94de0314c9 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.774038 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bd7f7-5c4f-419e-bf59-0e94de0314c9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.774318 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0bd7f7-5c4f-419e-bf59-0e94de0314c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.781180 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 797/1587] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:32:59.782024 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da1c75-2aea-4b66-9080-2b9d9341e5b7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.791297 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da1c75-2aea-4b66-9080-2b9d9341e5b7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.791704 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-8f0bd7f7-5c4f-419e-bf59-0e94de0314c9 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:32:59.792883 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8f0bd7f7-5c4f-419e-bf59-0e94de0314c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:32:59.795849 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02b3bf-92f8-4f90-b388-e2a8d7124c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.796480 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02b3bf-92f8-4f90-b388-e2a8d7124c2f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.796762 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02b3bf-92f8-4f90-b388-e2a8d7124c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.797333 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf02b3bf-92f8-4f90-b388-e2a8d7124c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.798046 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02b3bf-92f8-4f90-b388-e2a8d7124c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.799653 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf02b3bf-92f8-4f90-b388-e2a8d7124c2f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.800956 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 791/1588] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:32:59.804227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bd7f7-5c4f-419e-bf59-0e94de0314c9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.809813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 798/1589] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:32:59.810634 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02b3bf-92f8-4f90-b388-e2a8d7124c2f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.811240 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0bd7f7-5c4f-419e-bf59-0e94de0314c9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.816276 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767636b8-82fc-44b4-8411-2e966be001b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.817040 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767636b8-82fc-44b4-8411-2e966be001b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.817350 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767636b8-82fc-44b4-8411-2e966be001b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.817632 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767636b8-82fc-44b4-8411-2e966be001b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.818349 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767636b8-82fc-44b4-8411-2e966be001b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.819943 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767636b8-82fc-44b4-8411-2e966be001b5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.820674 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf02b3bf-92f8-4f90-b388-e2a8d7124c2f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.825422 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47566c56-903f-49aa-a0a0-9f2e98431450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.826134 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47566c56-903f-49aa-a0a0-9f2e98431450 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.826998 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47566c56-903f-49aa-a0a0-9f2e98431450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.827335 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47566c56-903f-49aa-a0a0-9f2e98431450 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.828050 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47566c56-903f-49aa-a0a0-9f2e98431450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.829653 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47566c56-903f-49aa-a0a0-9f2e98431450 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.833762 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 792/1590] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:32:59.833762 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767636b8-82fc-44b4-8411-2e966be001b5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.839972 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 799/1591] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:32:59.840534 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767636b8-82fc-44b4-8411-2e966be001b5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.841183 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47566c56-903f-49aa-a0a0-9f2e98431450 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.847707 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0ea21-ee45-4418-81cf-92da0e12764c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.848426 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0ea21-ee45-4418-81cf-92da0e12764c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.848756 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0ea21-ee45-4418-81cf-92da0e12764c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.849066 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0ea21-ee45-4418-81cf-92da0e12764c admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.849826 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0ea21-ee45-4418-81cf-92da0e12764c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.851027 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47566c56-903f-49aa-a0a0-9f2e98431450 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.851489 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0ea21-ee45-4418-81cf-92da0e12764c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.855677 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c8667-460d-4e53-879b-03355cb7f954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.856300 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c8667-460d-4e53-879b-03355cb7f954 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.856582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c8667-460d-4e53-879b-03355cb7f954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.856858 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c8667-460d-4e53-879b-03355cb7f954 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.857601 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c8667-460d-4e53-879b-03355cb7f954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.859314 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c8667-460d-4e53-879b-03355cb7f954 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.861670 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 793/1592] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:32:59.862443 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0ea21-ee45-4418-81cf-92da0e12764c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.871968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 800/1593] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:32:59.871968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c8667-460d-4e53-879b-03355cb7f954 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.872221 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0ea21-ee45-4418-81cf-92da0e12764c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.876141 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef0183-3eea-43b6-8120-09b2e803c220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.876765 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef0183-3eea-43b6-8120-09b2e803c220 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.877043 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef0183-3eea-43b6-8120-09b2e803c220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.877341 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef0183-3eea-43b6-8120-09b2e803c220 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.878056 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef0183-3eea-43b6-8120-09b2e803c220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.879107 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c8667-460d-4e53-879b-03355cb7f954 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.879632 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef0183-3eea-43b6-8120-09b2e803c220 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.883620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4c1ff-99f5-44e6-9631-ee60587a935f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.884239 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4c1ff-99f5-44e6-9631-ee60587a935f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.884521 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4c1ff-99f5-44e6-9631-ee60587a935f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.884796 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4c1ff-99f5-44e6-9631-ee60587a935f admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.885524 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4c1ff-99f5-44e6-9631-ee60587a935f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.887080 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4c1ff-99f5-44e6-9631-ee60587a935f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.889772 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 794/1594] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:32:59.890519 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef0183-3eea-43b6-8120-09b2e803c220 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.899511 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef0183-3eea-43b6-8120-09b2e803c220 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:32:59.900608 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 801/1595] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:32:59.901355 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4c1ff-99f5-44e6-9631-ee60587a935f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.904294 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106a92b-3ee4-486c-8237-fd7af4473a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:32:59.905797 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106a92b-3ee4-486c-8237-fd7af4473a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:32:59.906079 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106a92b-3ee4-486c-8237-fd7af4473a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:32:59.906351 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106a92b-3ee4-486c-8237-fd7af4473a5e admin admin] PATH_INFO: `/v3/projects/30e79b84eae64ef2a3c5399ef73f3443/users/bc9bebf7e8734542851229333d51eaae/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:32:59.921708 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106a92b-3ee4-486c-8237-fd7af4473a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e79b84eae64ef2a3c5399ef73f3443, user_id=bc9bebf7e8734542851229333d51eaae, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:32:59.924652 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106a92b-3ee4-486c-8237-fd7af4473a5e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:32:59.938890 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 795/1596] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:32:59 2022] PUT /identity/v3/projects/30e79b84eae64ef2a3c5399ef73f3443/users/bc9bebf7e8734542851229333d51eaae/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:32:59.939809 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106a92b-3ee4-486c-8237-fd7af4473a5e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:32:59.957622 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4c1ff-99f5-44e6-9631-ee60587a935f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:00.006168 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae3a95-43cb-408f-a74c-be99399bc7db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:00.006814 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae3a95-43cb-408f-a74c-be99399bc7db service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.007096 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae3a95-43cb-408f-a74c-be99399bc7db service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.007368 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae3a95-43cb-408f-a74c-be99399bc7db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.008856 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106a92b-3ee4-486c-8237-fd7af4473a5e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:00.013589 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2d063-7689-4236-98dd-5d9b602be74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:00.014797 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2d063-7689-4236-98dd-5d9b602be74c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.015096 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2d063-7689-4236-98dd-5d9b602be74c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.015470 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2d063-7689-4236-98dd-5d9b602be74c admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.016201 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2d063-7689-4236-98dd-5d9b602be74c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:00.016997 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae3a95-43cb-408f-a74c-be99399bc7db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:00.017846 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2d063-7689-4236-98dd-5d9b602be74c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:00.018458 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae3a95-43cb-408f-a74c-be99399bc7db service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:00.027295 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 796/1597] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:00.027758 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 802/1598] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:32:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:00.028220 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2d063-7689-4236-98dd-5d9b602be74c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:00.028383 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae3a95-43cb-408f-a74c-be99399bc7db service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:00.037529 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae3a95-43cb-408f-a74c-be99399bc7db service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:00.039888 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2d063-7689-4236-98dd-5d9b602be74c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:00.042162 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808943f-ef41-4102-afbe-782d1ecd1d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:00.042813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808943f-ef41-4102-afbe-782d1ecd1d89 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.043103 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808943f-ef41-4102-afbe-782d1ecd1d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.043362 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808943f-ef41-4102-afbe-782d1ecd1d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.044073 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808943f-ef41-4102-afbe-782d1ecd1d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:00.045738 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808943f-ef41-4102-afbe-782d1ecd1d89 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:00.046024 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192867e-b887-4a0f-ac68-473617b7f511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:00.046702 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192867e-b887-4a0f-ac68-473617b7f511 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.047260 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192867e-b887-4a0f-ac68-473617b7f511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.047534 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192867e-b887-4a0f-ac68-473617b7f511 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.048260 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192867e-b887-4a0f-ac68-473617b7f511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:00.049899 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192867e-b887-4a0f-ac68-473617b7f511 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:00.056887 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 803/1599] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:00.060602 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808943f-ef41-4102-afbe-782d1ecd1d89 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:00.064628 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 797/1600] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:00.064628 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192867e-b887-4a0f-ac68-473617b7f511 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:00.072151 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192867e-b887-4a0f-ac68-473617b7f511 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:00.074288 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808943f-ef41-4102-afbe-782d1ecd1d89 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:00.077821 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5fbd3-2292-415d-8f48-08f0ef336ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:00.078684 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5fbd3-2292-415d-8f48-08f0ef336ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.078964 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5fbd3-2292-415d-8f48-08f0ef336ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.079244 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5fbd3-2292-415d-8f48-08f0ef336ca9 admin admin] PATH_INFO: `/v3/projects/1050764769f2439fae8ad76e27663aec/users/65045a2a88084c12aeb9133bf0162193/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.079633 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae242ed-ab05-4a35-841b-e5cfb3c5b5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:00.080497 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae242ed-ab05-4a35-841b-e5cfb3c5b5d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.080776 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae242ed-ab05-4a35-841b-e5cfb3c5b5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.081044 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae242ed-ab05-4a35-841b-e5cfb3c5b5d5 admin admin] PATH_INFO: `/v3/projects/98f0673600914ab1a0a8636e309c3306/users/9d3207da0fb24b3f8f329b6837fd9376/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.096542 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5fbd3-2292-415d-8f48-08f0ef336ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1050764769f2439fae8ad76e27663aec, user_id=65045a2a88084c12aeb9133bf0162193, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:00.098247 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae242ed-ab05-4a35-841b-e5cfb3c5b5d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98f0673600914ab1a0a8636e309c3306, user_id=9d3207da0fb24b3f8f329b6837fd9376, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:00.100152 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5fbd3-2292-415d-8f48-08f0ef336ca9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:00.100979 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae242ed-ab05-4a35-841b-e5cfb3c5b5d5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:00.114706 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 798/1601] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:00 2022] PUT /identity/v3/projects/1050764769f2439fae8ad76e27663aec/users/65045a2a88084c12aeb9133bf0162193/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:00.115807 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5fbd3-2292-415d-8f48-08f0ef336ca9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:00.117493 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 804/1602] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:00 2022] PUT /identity/v3/projects/98f0673600914ab1a0a8636e309c3306/users/9d3207da0fb24b3f8f329b6837fd9376/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:00.119366 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30421c-9008-406c-abc0-f13eb89334ab None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.119815 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30421c-9008-406c-abc0-f13eb89334ab None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.120213 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30421c-9008-406c-abc0-f13eb89334ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.149350 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-6c30421c-9008-406c-abc0-f13eb89334ab None None] MFA Rules not processed for user `bc9bebf7e8734542851229333d51eaae`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:00.150681 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6c30421c-9008-406c-abc0-f13eb89334ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:00.207053 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5fbd3-2292-415d-8f48-08f0ef336ca9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:00.223231 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 805/1603] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:00.224038 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30421c-9008-406c-abc0-f13eb89334ab None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:00.271725 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f03503-2fa6-4356-81a5-430d4038b674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:00.272657 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f03503-2fa6-4356-81a5-430d4038b674 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.272934 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f03503-2fa6-4356-81a5-430d4038b674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.273204 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f03503-2fa6-4356-81a5-430d4038b674 admin admin] PATH_INFO: `/v3/projects/5cd549fb2fda43f1b4d77154d57672ac/users/c4374857f9d24557b906b8cadba49b33/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.290919 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f03503-2fa6-4356-81a5-430d4038b674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd549fb2fda43f1b4d77154d57672ac, user_id=c4374857f9d24557b906b8cadba49b33, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:00.293634 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f03503-2fa6-4356-81a5-430d4038b674 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:00.302437 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30421c-9008-406c-abc0-f13eb89334ab None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:00.307900 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3788878-c92d-4cfc-bb77-1d7c1c9c8441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:00.308988 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3788878-c92d-4cfc-bb77-1d7c1c9c8441 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.309299 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3788878-c92d-4cfc-bb77-1d7c1c9c8441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.309579 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3788878-c92d-4cfc-bb77-1d7c1c9c8441 admin admin] PATH_INFO: `/v3/projects/59d95f84bb5c4548a82ead0d4d2cb38c/users/737d115302cb48bb90f8c4771d6ad7f1/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.310099 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 799/1604] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:00 2022] PUT /identity/v3/projects/5cd549fb2fda43f1b4d77154d57672ac/users/c4374857f9d24557b906b8cadba49b33/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:00.318236 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f03503-2fa6-4356-81a5-430d4038b674 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:00.327641 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3788878-c92d-4cfc-bb77-1d7c1c9c8441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59d95f84bb5c4548a82ead0d4d2cb38c, user_id=737d115302cb48bb90f8c4771d6ad7f1, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:00.330707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3788878-c92d-4cfc-bb77-1d7c1c9c8441 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:00.355584 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 806/1605] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:00 2022] PUT /identity/v3/projects/59d95f84bb5c4548a82ead0d4d2cb38c/users/737d115302cb48bb90f8c4771d6ad7f1/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:00.356436 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3788878-c92d-4cfc-bb77-1d7c1c9c8441 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:00.401940 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f03503-2fa6-4356-81a5-430d4038b674 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:00.440803 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3788878-c92d-4cfc-bb77-1d7c1c9c8441 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:00.448977 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6e0a2-f078-48ad-acc9-94cd16953771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:00.450021 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6e0a2-f078-48ad-acc9-94cd16953771 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.450798 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6e0a2-f078-48ad-acc9-94cd16953771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.451059 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6e0a2-f078-48ad-acc9-94cd16953771 admin admin] PATH_INFO: `/v3/projects/29a54dafb7ef43e6a927b5853e138737/users/4238092890264934b19838fe9bdd5040/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.466405 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36d9d8-8450-46a9-8075-f69680b24c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:00.467358 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36d9d8-8450-46a9-8075-f69680b24c18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.467635 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36d9d8-8450-46a9-8075-f69680b24c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.467905 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36d9d8-8450-46a9-8075-f69680b24c18 admin admin] PATH_INFO: `/v3/projects/971394cccbfa49b584616f61ed5eb8a2/users/e83de12959394ba5a75f5881741540a8/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.468239 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6e0a2-f078-48ad-acc9-94cd16953771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29a54dafb7ef43e6a927b5853e138737, user_id=4238092890264934b19838fe9bdd5040, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:00.470961 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6e0a2-f078-48ad-acc9-94cd16953771 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:00.484294 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36d9d8-8450-46a9-8075-f69680b24c18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=971394cccbfa49b584616f61ed5eb8a2, user_id=e83de12959394ba5a75f5881741540a8, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:00.491080 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 807/1606] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:00 2022] PUT /identity/v3/projects/29a54dafb7ef43e6a927b5853e138737/users/4238092890264934b19838fe9bdd5040/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:00.491236 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36d9d8-8450-46a9-8075-f69680b24c18 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:00.491353 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ecc03-5645-4165-8dbb-a366d384f7c0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.491353 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ecc03-5645-4165-8dbb-a366d384f7c0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.491353 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ecc03-5645-4165-8dbb-a366d384f7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.503805 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 800/1607] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:00 2022] PUT /identity/v3/projects/971394cccbfa49b584616f61ed5eb8a2/users/e83de12959394ba5a75f5881741540a8/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:00.505404 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118504a-5701-41d9-a38a-5f9e60971c7a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.505823 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118504a-5701-41d9-a38a-5f9e60971c7a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.506171 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118504a-5701-41d9-a38a-5f9e60971c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.511226 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4b4ecc03-5645-4165-8dbb-a366d384f7c0 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:00.512447 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4b4ecc03-5645-4165-8dbb-a366d384f7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:00.524314 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-9118504a-5701-41d9-a38a-5f9e60971c7a None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:00.525675 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9118504a-5701-41d9-a38a-5f9e60971c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:00.574256 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 808/1608] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:00.575897 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16dd04-86ae-447f-8f41-525c6fa81f68 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.576397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16dd04-86ae-447f-8f41-525c6fa81f68 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.576809 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16dd04-86ae-447f-8f41-525c6fa81f68 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.578903 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 809/1609] 10.222.0.75 () {54 vars in 961 bytes} [Wed Feb 16 05:33:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:33:00.579915 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c82e3-77b7-4da6-ab4c-5a7ebbdebba8 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.580265 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c82e3-77b7-4da6-ab4c-5a7ebbdebba8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.580603 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c82e3-77b7-4da6-ab4c-5a7ebbdebba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.600849 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 801/1610] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:00.602654 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe2ccc-3911-4a30-8c1b-70f185036331 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.603127 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe2ccc-3911-4a30-8c1b-70f185036331 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.603703 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe2ccc-3911-4a30-8c1b-70f185036331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.610007 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-3a2c82e3-77b7-4da6-ab4c-5a7ebbdebba8 None None] MFA Rules not processed for user `c4374857f9d24557b906b8cadba49b33`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:00.611305 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3a2c82e3-77b7-4da6-ab4c-5a7ebbdebba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:00.629581 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-8efe2ccc-3911-4a30-8c1b-70f185036331 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:00.630962 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8efe2ccc-3911-4a30-8c1b-70f185036331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:00.639674 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 802/1611] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:00.640934 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2ce0a-2194-4cae-909d-3f0e1ba3680a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.641378 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2ce0a-2194-4cae-909d-3f0e1ba3680a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.641553 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2ce0a-2194-4cae-909d-3f0e1ba3680a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.660717 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f4d2ce0a-2194-4cae-909d-3f0e1ba3680a None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:00.662112 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f4d2ce0a-2194-4cae-909d-3f0e1ba3680a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:00.673578 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 803/1612] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:00.674994 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21f206-6fd4-4e7a-b470-143575cf2938 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.675306 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21f206-6fd4-4e7a-b470-143575cf2938 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.675681 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21f206-6fd4-4e7a-b470-143575cf2938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.695679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 810/1613] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:00.696646 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c82e3-77b7-4da6-ab4c-5a7ebbdebba8 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:00.721667 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ad21f206-6fd4-4e7a-b470-143575cf2938 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:00.722889 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ad21f206-6fd4-4e7a-b470-143575cf2938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:00.731596 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 804/1614] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:00.732655 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a06ac-c0ae-4c76-827d-46f6535b4ace None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.733530 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a06ac-c0ae-4c76-827d-46f6535b4ace None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.733808 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a06ac-c0ae-4c76-827d-46f6535b4ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.752496 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-914a06ac-c0ae-4c76-827d-46f6535b4ace None None] MFA Rules not processed for user `6522d231532a48ad8dbc9c9e79a021dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:00.753755 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-914a06ac-c0ae-4c76-827d-46f6535b4ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:00.768036 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c82e3-77b7-4da6-ab4c-5a7ebbdebba8 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:00.771994 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354da38-1262-4572-a0d5-94133f989e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:00.772641 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354da38-1262-4572-a0d5-94133f989e7f service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.772921 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354da38-1262-4572-a0d5-94133f989e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.773419 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354da38-1262-4572-a0d5-94133f989e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.784358 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354da38-1262-4572-a0d5-94133f989e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:00.786404 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4354da38-1262-4572-a0d5-94133f989e7f service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:00.798652 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 811/1615] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:00.799476 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354da38-1262-4572-a0d5-94133f989e7f service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:00.808258 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354da38-1262-4572-a0d5-94133f989e7f service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:00.812096 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c15ed-f4d0-4b7e-8d4d-16d75db2428d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:00.812949 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c15ed-f4d0-4b7e-8d4d-16d75db2428d service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.813229 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c15ed-f4d0-4b7e-8d4d-16d75db2428d service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.813552 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c15ed-f4d0-4b7e-8d4d-16d75db2428d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.823012 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c15ed-f4d0-4b7e-8d4d-16d75db2428d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:00.824461 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c15ed-f4d0-4b7e-8d4d-16d75db2428d service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:00.832344 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 805/1616] 10.222.0.75 () {58 vars in 1058 bytes} [Wed Feb 16 05:33:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:00.833349 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a06ac-c0ae-4c76-827d-46f6535b4ace None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:00.836330 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 812/1617] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:00.837229 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c15ed-f4d0-4b7e-8d4d-16d75db2428d service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:00.843734 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a06ac-c0ae-4c76-827d-46f6535b4ace None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:00.847136 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c15ed-f4d0-4b7e-8d4d-16d75db2428d service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:00.847813 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147129d-ba08-4540-b6af-ee7d274d30e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:00.848548 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147129d-ba08-4540-b6af-ee7d274d30e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.848886 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147129d-ba08-4540-b6af-ee7d274d30e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.849227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147129d-ba08-4540-b6af-ee7d274d30e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.851539 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c463ab2-7496-4e28-9ee1-fa1e3317207b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:00.852311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c463ab2-7496-4e28-9ee1-fa1e3317207b service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.852664 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c463ab2-7496-4e28-9ee1-fa1e3317207b service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.853148 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c463ab2-7496-4e28-9ee1-fa1e3317207b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.864140 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c463ab2-7496-4e28-9ee1-fa1e3317207b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:00.865727 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c463ab2-7496-4e28-9ee1-fa1e3317207b service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:00.869165 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147129d-ba08-4540-b6af-ee7d274d30e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:00.871417 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147129d-ba08-4540-b6af-ee7d274d30e1 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:00.876683 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 813/1618] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:00.877828 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c463ab2-7496-4e28-9ee1-fa1e3317207b service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:00.885049 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 806/1619] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:00.886226 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaa394-b4a2-4edd-9baf-5150b460a4c9 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.886476 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaa394-b4a2-4edd-9baf-5150b460a4c9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.886852 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaa394-b4a2-4edd-9baf-5150b460a4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.891442 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c463ab2-7496-4e28-9ee1-fa1e3317207b service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:00.897826 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de18ea1-2f73-4779-9381-d7d1ed13c36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:00.898630 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de18ea1-2f73-4779-9381-d7d1ed13c36e admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:00.899013 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de18ea1-2f73-4779-9381-d7d1ed13c36e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:00.899353 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de18ea1-2f73-4779-9381-d7d1ed13c36e admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:00.900209 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de18ea1-2f73-4779-9381-d7d1ed13c36e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:00.902449 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de18ea1-2f73-4779-9381-d7d1ed13c36e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:00.921047 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-0bdaa394-b4a2-4edd-9baf-5150b460a4c9 None None] MFA Rules not processed for user `937df27c7eb1402b80a735a24170f074`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:00.922869 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0bdaa394-b4a2-4edd-9baf-5150b460a4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:00.938754 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 814/1620] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:33:00 2022] POST /identity/v3/projects => generated 363 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:00.940229 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de18ea1-2f73-4779-9381-d7d1ed13c36e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:01.011212 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de18ea1-2f73-4779-9381-d7d1ed13c36e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:01.018237 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 807/1621] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:01.019312 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaa394-b4a2-4edd-9baf-5150b460a4c9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:01.021099 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cd1b2-4459-4743-9c18-98c3cf23edeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:01.022241 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cd1b2-4459-4743-9c18-98c3cf23edeb service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:01.022780 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cd1b2-4459-4743-9c18-98c3cf23edeb service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:01.023266 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cd1b2-4459-4743-9c18-98c3cf23edeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:01.033593 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaa394-b4a2-4edd-9baf-5150b460a4c9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:01.095889 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cd1b2-4459-4743-9c18-98c3cf23edeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:01.097556 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cd1b2-4459-4743-9c18-98c3cf23edeb service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:01.108717 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 815/1622] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:01.109590 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cd1b2-4459-4743-9c18-98c3cf23edeb service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:01.116774 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190dab2-4070-48a4-a309-778a7112de94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:01.117822 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190dab2-4070-48a4-a309-778a7112de94 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:01.118111 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190dab2-4070-48a4-a309-778a7112de94 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:01.118386 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7190dab2-4070-48a4-a309-778a7112de94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:01.119631 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cd1b2-4459-4743-9c18-98c3cf23edeb service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:01.125274 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52e854-fd4d-4fbb-8529-5450a85694ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:01.126112 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52e854-fd4d-4fbb-8529-5450a85694ee admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:01.126453 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52e854-fd4d-4fbb-8529-5450a85694ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:01.126794 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52e854-fd4d-4fbb-8529-5450a85694ee admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:01.127572 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52e854-fd4d-4fbb-8529-5450a85694ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:01.129714 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52e854-fd4d-4fbb-8529-5450a85694ee admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:01.150852 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 816/1623] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:33:01 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:01.152416 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c189b-334e-4955-b85c-4020e38c0c46 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:01.152860 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c189b-334e-4955-b85c-4020e38c0c46 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:01.153329 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c189b-334e-4955-b85c-4020e38c0c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:01.176774 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-f27c189b-334e-4955-b85c-4020e38c0c46 None None] MFA Rules not processed for user `937df27c7eb1402b80a735a24170f074`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:01.178039 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f27c189b-334e-4955-b85c-4020e38c0c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:01.189969 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190dab2-4070-48a4-a309-778a7112de94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:01.191887 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7190dab2-4070-48a4-a309-778a7112de94 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:01.202487 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 808/1624] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:01.203830 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190dab2-4070-48a4-a309-778a7112de94 service nova] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:01.216451 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7190dab2-4070-48a4-a309-778a7112de94 service nova] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:01.225192 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51918c69-4783-4dbd-8b15-3552bf5d4bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:01.226229 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51918c69-4783-4dbd-8b15-3552bf5d4bca admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:01.227251 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51918c69-4783-4dbd-8b15-3552bf5d4bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:01.227674 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51918c69-4783-4dbd-8b15-3552bf5d4bca admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:01.228600 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51918c69-4783-4dbd-8b15-3552bf5d4bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:01.230634 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51918c69-4783-4dbd-8b15-3552bf5d4bca admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:01.248188 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 817/1625] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:01.248428 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 809/1626] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:01.250216 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c189b-334e-4955-b85c-4020e38c0c46 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:01.263023 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88652826-b69e-4447-b6f8-b349291d68aa None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:01.263348 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88652826-b69e-4447-b6f8-b349291d68aa None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:01.263714 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88652826-b69e-4447-b6f8-b349291d68aa None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:01.266607 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 810/1627] 10.222.0.75 () {54 vars in 961 bytes} [Wed Feb 16 05:33:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 05:33:01.267646 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c189b-334e-4955-b85c-4020e38c0c46 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:01.272660 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda1c3b-b4f3-4de1-932d-737a0e3602e9 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:01.273043 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda1c3b-b4f3-4de1-932d-737a0e3602e9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:01.273486 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda1c3b-b4f3-4de1-932d-737a0e3602e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:01.276337 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0a71d-b674-4d19-9fab-ce925d6b4d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:01.277494 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0a71d-b674-4d19-9fab-ce925d6b4d92 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:01.277943 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0a71d-b674-4d19-9fab-ce925d6b4d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:01.278364 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0a71d-b674-4d19-9fab-ce925d6b4d92 admin admin] PATH_INFO: `/v3/projects/3b416c78c1b546b28d04999fae66aa05/users/da511cb567e949ef81feb648a5123110/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:01.299431 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-abda1c3b-b4f3-4de1-932d-737a0e3602e9 None None] MFA Rules not processed for user `6522d231532a48ad8dbc9c9e79a021dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:01.301834 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-abda1c3b-b4f3-4de1-932d-737a0e3602e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:01.314313 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0a71d-b674-4d19-9fab-ce925d6b4d92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b416c78c1b546b28d04999fae66aa05, user_id=da511cb567e949ef81feb648a5123110, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:01.315691 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 811/1628] 10.222.0.75 () {58 vars in 1058 bytes} [Wed Feb 16 05:33:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:33:01.324107 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda1c3b-b4f3-4de1-932d-737a0e3602e9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:01.325456 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0a71d-b674-4d19-9fab-ce925d6b4d92 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:01.338046 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda1c3b-b4f3-4de1-932d-737a0e3602e9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:01.343579 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 818/1629] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:01 2022] PUT /identity/v3/projects/3b416c78c1b546b28d04999fae66aa05/users/da511cb567e949ef81feb648a5123110/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:01.347285 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0a71d-b674-4d19-9fab-ce925d6b4d92 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:01.426300 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7a0ab-8aad-44f8-a2a2-dcc08358fc94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:01.427392 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7a0ab-8aad-44f8-a2a2-dcc08358fc94 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:01.428251 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7a0ab-8aad-44f8-a2a2-dcc08358fc94 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:01.428635 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7a0ab-8aad-44f8-a2a2-dcc08358fc94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:01.430358 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0a71d-b674-4d19-9fab-ce925d6b4d92 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:01.439521 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5650f1-fcff-4ec3-89ae-21af5f4d9273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:01.440466 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5650f1-fcff-4ec3-89ae-21af5f4d9273 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:01.441066 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5650f1-fcff-4ec3-89ae-21af5f4d9273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:01.441812 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5650f1-fcff-4ec3-89ae-21af5f4d9273 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:01.443614 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5650f1-fcff-4ec3-89ae-21af5f4d9273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:01.446154 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5650f1-fcff-4ec3-89ae-21af5f4d9273 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:01.459648 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 819/1630] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:33:01.461736 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35da896-845a-4fa4-b79f-87a7ee322593 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:01.462205 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35da896-845a-4fa4-b79f-87a7ee322593 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:01.462872 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35da896-845a-4fa4-b79f-87a7ee322593 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:01.465146 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 820/1631] 10.222.0.75 () {54 vars in 912 bytes} [Wed Feb 16 05:33:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:33:01.466097 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35da896-845a-4fa4-b79f-87a7ee322593 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:01.483215 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35da896-845a-4fa4-b79f-87a7ee322593 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:01.488068 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620a4fe-ef04-4320-a3bb-dadf52fcc8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:01.489051 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620a4fe-ef04-4320-a3bb-dadf52fcc8af admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:01.489366 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620a4fe-ef04-4320-a3bb-dadf52fcc8af admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:01.489693 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620a4fe-ef04-4320-a3bb-dadf52fcc8af admin admin] PATH_INFO: `/v3/projects/3b416c78c1b546b28d04999fae66aa05/users/da511cb567e949ef81feb648a5123110/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:01.492780 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620a4fe-ef04-4320-a3bb-dadf52fcc8af admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b416c78c1b546b28d04999fae66aa05, user_id=da511cb567e949ef81feb648a5123110, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:01.496052 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620a4fe-ef04-4320-a3bb-dadf52fcc8af admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:01.504831 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7a0ab-8aad-44f8-a2a2-dcc08358fc94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:01.507279 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c7a0ab-8aad-44f8-a2a2-dcc08358fc94 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:01.520372 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 812/1633] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:33:01.521405 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 821/1633] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:01 2022] PUT /identity/v3/projects/3b416c78c1b546b28d04999fae66aa05/users/da511cb567e949ef81feb648a5123110/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:01.522381 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1645ffc-27cc-438c-961c-165fc6085f1f None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:01.522927 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1645ffc-27cc-438c-961c-165fc6085f1f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:01.523405 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1645ffc-27cc-438c-961c-165fc6085f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:01.525984 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35368f7d-015d-4d9b-8148-ec1ef1b7c71e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:01.526296 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35368f7d-015d-4d9b-8148-ec1ef1b7c71e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:01.526573 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35368f7d-015d-4d9b-8148-ec1ef1b7c71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:01.543869 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-a1645ffc-27cc-438c-961c-165fc6085f1f None None] MFA Rules not processed for user `6522d231532a48ad8dbc9c9e79a021dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:01.545794 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a1645ffc-27cc-438c-961c-165fc6085f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:01.567037 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-35368f7d-015d-4d9b-8148-ec1ef1b7c71e None None] MFA Rules not processed for user `da511cb567e949ef81feb648a5123110`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:01.568327 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-35368f7d-015d-4d9b-8148-ec1ef1b7c71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:01.657428 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 813/1634] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Feb 16 05:33:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:01.668681 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1645ffc-27cc-438c-961c-165fc6085f1f None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:01.704963 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 822/1635] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:01 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:33:01.716982 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35368f7d-015d-4d9b-8148-ec1ef1b7c71e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:01.757794 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1645ffc-27cc-438c-961c-165fc6085f1f None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:01.763399 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15fcc5-ce38-46fb-a1af-f8d31878177c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:01.764323 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15fcc5-ce38-46fb-a1af-f8d31878177c service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:01.764782 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15fcc5-ce38-46fb-a1af-f8d31878177c service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:01.765172 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15fcc5-ce38-46fb-a1af-f8d31878177c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:01.778622 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15fcc5-ce38-46fb-a1af-f8d31878177c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:01.781200 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15fcc5-ce38-46fb-a1af-f8d31878177c service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:01.792155 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35368f7d-015d-4d9b-8148-ec1ef1b7c71e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:01.796756 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 814/1636] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:33:01.799513 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af6648-29ee-4562-82c8-11725ad23bd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:01.800316 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af6648-29ee-4562-82c8-11725ad23bd5 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:01.800529 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af6648-29ee-4562-82c8-11725ad23bd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:01.800804 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af6648-29ee-4562-82c8-11725ad23bd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:01.811753 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af6648-29ee-4562-82c8-11725ad23bd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:01.813390 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af6648-29ee-4562-82c8-11725ad23bd5 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:01.840281 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 823/1637] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:01 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:33:01.869209 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad5ada-95dd-4af5-8c9d-76744b396fe1 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:01.870375 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad5ada-95dd-4af5-8c9d-76744b396fe1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:01.870931 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad5ada-95dd-4af5-8c9d-76744b396fe1 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:01.873957 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 815/1638] 10.222.0.75 () {54 vars in 912 bytes} [Wed Feb 16 05:33:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:33:01.879778 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac62f45-2e4c-48ec-9131-377b878df3fd None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:01.879995 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac62f45-2e4c-48ec-9131-377b878df3fd None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:01.880300 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac62f45-2e4c-48ec-9131-377b878df3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:01.915185 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-5ac62f45-2e4c-48ec-9131-377b878df3fd None None] MFA Rules not processed for user `6522d231532a48ad8dbc9c9e79a021dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:01.916668 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5ac62f45-2e4c-48ec-9131-377b878df3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:01.978356 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 824/1639] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Feb 16 05:33:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:01.991979 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad5ada-95dd-4af5-8c9d-76744b396fe1 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:01.994401 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-29ad5ada-95dd-4af5-8c9d-76744b396fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:02.047687 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac62f45-2e4c-48ec-9131-377b878df3fd None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:02.059887 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac62f45-2e4c-48ec-9131-377b878df3fd None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:02.070087 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7d5b3-ccf9-4ace-b82e-ab8685dcea4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:02.071635 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7d5b3-ccf9-4ace-b82e-ab8685dcea4b service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:02.071635 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7d5b3-ccf9-4ace-b82e-ab8685dcea4b service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:02.071635 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7d5b3-ccf9-4ace-b82e-ab8685dcea4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:02.090631 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad5ada-95dd-4af5-8c9d-76744b396fe1 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:02.097802 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e560bf4-33ce-42ef-b0c9-28e723126768 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8e4a7763524f4190c5cd66e27b5910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:02.098822 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e560bf4-33ce-42ef-b0c9-28e723126768 service glance] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:02.099211 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e560bf4-33ce-42ef-b0c9-28e723126768 service glance] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:02.100176 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e560bf4-33ce-42ef-b0c9-28e723126768 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:02.115315 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e560bf4-33ce-42ef-b0c9-28e723126768 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:02.118049 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e560bf4-33ce-42ef-b0c9-28e723126768 service glance] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:02.134600 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 816/1640] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:02.174954 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7d5b3-ccf9-4ace-b82e-ab8685dcea4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:02.179040 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7d5b3-ccf9-4ace-b82e-ab8685dcea4b service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:02.201509 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 825/1641] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:33:02.269499 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabc3e4-c03f-485c-8bc3-0518531f99c3 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:02.269738 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabc3e4-c03f-485c-8bc3-0518531f99c3 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:02.269901 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daabc3e4-c03f-485c-8bc3-0518531f99c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:02.356075 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-daabc3e4-c03f-485c-8bc3-0518531f99c3 None None] MFA Rules not processed for user `65045a2a88084c12aeb9133bf0162193`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:02.358991 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-daabc3e4-c03f-485c-8bc3-0518531f99c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:02.475038 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 817/1642] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:02.487298 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac70e92-2956-41b3-82df-97b543315acf None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:02.487830 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac70e92-2956-41b3-82df-97b543315acf None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:02.487830 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac70e92-2956-41b3-82df-97b543315acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:02.524717 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-eac70e92-2956-41b3-82df-97b543315acf None None] MFA Rules not processed for user `65045a2a88084c12aeb9133bf0162193`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:02.527843 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-eac70e92-2956-41b3-82df-97b543315acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:02.551958 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 826/1643] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:02.874311 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebb8e8-e839-4baa-acb5-51e77cd8136e None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:02.875038 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebb8e8-e839-4baa-acb5-51e77cd8136e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:02.875038 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebb8e8-e839-4baa-acb5-51e77cd8136e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:02.912735 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-98ebb8e8-e839-4baa-acb5-51e77cd8136e None None] MFA Rules not processed for user `4238092890264934b19838fe9bdd5040`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:02.915968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac70e92-2956-41b3-82df-97b543315acf None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:02.919283 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-98ebb8e8-e839-4baa-acb5-51e77cd8136e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:02.932282 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac70e92-2956-41b3-82df-97b543315acf None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:02.960093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e65e3d-83c4-4a0e-b55a-dafefa26584f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:02.960757 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e65e3d-83c4-4a0e-b55a-dafefa26584f service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:02.961030 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e65e3d-83c4-4a0e-b55a-dafefa26584f service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:02.961320 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e65e3d-83c4-4a0e-b55a-dafefa26584f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:02.973943 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e65e3d-83c4-4a0e-b55a-dafefa26584f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:02.975807 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e65e3d-83c4-4a0e-b55a-dafefa26584f service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:02.991322 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 827/1644] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:03.039207 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e65e3d-83c4-4a0e-b55a-dafefa26584f service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:03.041866 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 818/1645] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:03.172543 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e65e3d-83c4-4a0e-b55a-dafefa26584f service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:03.179990 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bac54-399e-4709-8e99-8407ea9c2a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:03.180845 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bac54-399e-4709-8e99-8407ea9c2a39 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:03.181089 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bac54-399e-4709-8e99-8407ea9c2a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:03.181399 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bac54-399e-4709-8e99-8407ea9c2a39 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:03.182995 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741bac54-399e-4709-8e99-8407ea9c2a39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:03.185514 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741bac54-399e-4709-8e99-8407ea9c2a39 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:03.247786 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 828/1646] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:33:03 2022] POST /identity/v3/projects => generated 403 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:03.250055 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebb8e8-e839-4baa-acb5-51e77cd8136e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:03.263225 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebb8e8-e839-4baa-acb5-51e77cd8136e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:03.269314 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1fc7a-2c85-41d1-9174-badc0f5bdb92 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:03.269829 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1fc7a-2c85-41d1-9174-badc0f5bdb92 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:03.270365 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1fc7a-2c85-41d1-9174-badc0f5bdb92 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:03.278985 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 829/1647] 10.222.0.75 () {54 vars in 912 bytes} [Wed Feb 16 05:33:03 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 16 05:33:03.288257 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae8adb-2252-4884-af79-5b359fb68ffd None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:03.289540 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae8adb-2252-4884-af79-5b359fb68ffd None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:03.290170 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae8adb-2252-4884-af79-5b359fb68ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:03.379703 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-f4ae8adb-2252-4884-af79-5b359fb68ffd None None] MFA Rules not processed for user `fd4eac62484c47988657d2a730f2d056`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:03.380946 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f4ae8adb-2252-4884-af79-5b359fb68ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:03.402846 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f3a72-66f7-4f99-ad6e-2e78561f2cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:03.404278 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f3a72-66f7-4f99-ad6e-2e78561f2cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:03.404278 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f3a72-66f7-4f99-ad6e-2e78561f2cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:03.404278 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f3a72-66f7-4f99-ad6e-2e78561f2cc4 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:03.404919 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f3a72-66f7-4f99-ad6e-2e78561f2cc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:03.407001 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f3a72-66f7-4f99-ad6e-2e78561f2cc4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:03.438094 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 819/1648] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:33:03 2022] POST /identity/v3/users => generated 308 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:03.440789 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f3a72-66f7-4f99-ad6e-2e78561f2cc4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:03.452901 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f3a72-66f7-4f99-ad6e-2e78561f2cc4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:03.458270 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ed26a-b62f-471b-9739-24609d59ade2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:03.459349 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ed26a-b62f-471b-9739-24609d59ade2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:03.459801 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ed26a-b62f-471b-9739-24609d59ade2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:03.460120 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ed26a-b62f-471b-9739-24609d59ade2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:03.460919 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ed26a-b62f-471b-9739-24609d59ade2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:03.462640 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ed26a-b62f-471b-9739-24609d59ade2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:03.474190 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 830/1649] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Feb 16 05:33:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:33:03.474933 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 820/1650] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:03.479616 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae8adb-2252-4884-af79-5b359fb68ffd None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:03.490035 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ed26a-b62f-471b-9739-24609d59ade2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:03.499411 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae8adb-2252-4884-af79-5b359fb68ffd None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:03.501880 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ed26a-b62f-471b-9739-24609d59ade2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:03.507105 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdc3cc-eec5-4a14-b831-e461e6a7c25b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:03.507326 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3f52b-0840-4380-840d-4a5c8036129c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:03.507751 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdc3cc-eec5-4a14-b831-e461e6a7c25b service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:03.508031 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdc3cc-eec5-4a14-b831-e461e6a7c25b service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:03.508303 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdc3cc-eec5-4a14-b831-e461e6a7c25b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:03.508955 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3f52b-0840-4380-840d-4a5c8036129c admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:03.509492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3f52b-0840-4380-840d-4a5c8036129c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:03.509924 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3f52b-0840-4380-840d-4a5c8036129c admin admin] PATH_INFO: `/v3/projects/8177bbab7c064d3591e870288c0ce180/users/48c4263ebbc749f989d22b73244e5296/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:03.517533 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bdc3cc-eec5-4a14-b831-e461e6a7c25b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:03.519224 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bdc3cc-eec5-4a14-b831-e461e6a7c25b service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:03.528563 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 821/1651] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:33:03.531741 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3f52b-0840-4380-840d-4a5c8036129c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8177bbab7c064d3591e870288c0ce180, user_id=48c4263ebbc749f989d22b73244e5296, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:03.534847 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3f52b-0840-4380-840d-4a5c8036129c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:03.554360 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 831/1652] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:03 2022] PUT /identity/v3/projects/8177bbab7c064d3591e870288c0ce180/users/48c4263ebbc749f989d22b73244e5296/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:03.555451 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdc3cc-eec5-4a14-b831-e461e6a7c25b service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:03.570381 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdc3cc-eec5-4a14-b831-e461e6a7c25b service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:03.645491 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556dcb1-b911-4e94-bd55-8c6b8c11902c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:03.646664 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556dcb1-b911-4e94-bd55-8c6b8c11902c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:03.646664 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556dcb1-b911-4e94-bd55-8c6b8c11902c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:03.646860 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556dcb1-b911-4e94-bd55-8c6b8c11902c admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:03.648372 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556dcb1-b911-4e94-bd55-8c6b8c11902c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:03.649533 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556dcb1-b911-4e94-bd55-8c6b8c11902c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:03.662109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 822/1653] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:03.666985 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3f52b-0840-4380-840d-4a5c8036129c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:03.679940 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3f52b-0840-4380-840d-4a5c8036129c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:03.685649 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db030984-92e8-44b1-908b-48bfbf1dd9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:03.686802 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db030984-92e8-44b1-908b-48bfbf1dd9bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:03.687257 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db030984-92e8-44b1-908b-48bfbf1dd9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:03.687555 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db030984-92e8-44b1-908b-48bfbf1dd9bb admin admin] PATH_INFO: `/v3/projects/8177bbab7c064d3591e870288c0ce180/users/48c4263ebbc749f989d22b73244e5296/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:03.690333 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db030984-92e8-44b1-908b-48bfbf1dd9bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8177bbab7c064d3591e870288c0ce180, user_id=48c4263ebbc749f989d22b73244e5296, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:03.693030 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db030984-92e8-44b1-908b-48bfbf1dd9bb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:03.704596 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 832/1654] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:03 2022] PUT /identity/v3/projects/8177bbab7c064d3591e870288c0ce180/users/48c4263ebbc749f989d22b73244e5296/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:03.827735 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb94901-822c-42c3-8bab-d766097c31ac None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:03.828665 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb94901-822c-42c3-8bab-d766097c31ac None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:03.829187 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb94901-822c-42c3-8bab-d766097c31ac None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:03.833280 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 823/1655] 10.222.0.75 () {54 vars in 912 bytes} [Wed Feb 16 05:33:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:33:03.847082 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879cce4-a8ba-4258-9c81-6874f6a81e69 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:03.847623 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879cce4-a8ba-4258-9c81-6874f6a81e69 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:03.847942 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879cce4-a8ba-4258-9c81-6874f6a81e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:03.882111 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-7879cce4-a8ba-4258-9c81-6874f6a81e69 None None] MFA Rules not processed for user `fd4eac62484c47988657d2a730f2d056`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:03.886256 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7879cce4-a8ba-4258-9c81-6874f6a81e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:04.020405 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 833/1656] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Feb 16 05:33:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:33:04.056735 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb94901-822c-42c3-8bab-d766097c31ac None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:04.058549 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2eb94901-822c-42c3-8bab-d766097c31ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:04.090126 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb94901-822c-42c3-8bab-d766097c31ac None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:04.097855 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb980e-d906-4ee3-ac4e-ff1d2ce3c346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:04.098496 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb980e-d906-4ee3-ac4e-ff1d2ce3c346 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:04.098773 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb980e-d906-4ee3-ac4e-ff1d2ce3c346 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:04.099046 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb980e-d906-4ee3-ac4e-ff1d2ce3c346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:04.119689 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb980e-d906-4ee3-ac4e-ff1d2ce3c346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:04.121724 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb980e-d906-4ee3-ac4e-ff1d2ce3c346 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:04.142999 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 824/1657] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:04.359865 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879cce4-a8ba-4258-9c81-6874f6a81e69 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:04.517553 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7879cce4-a8ba-4258-9c81-6874f6a81e69 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:04.519199 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ceaab7-34ed-45b8-b863-20d137053b1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc233f62146a49099216c6236fb2ee2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:04.519907 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceaab7-34ed-45b8-b863-20d137053b1b service placement] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:04.520384 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceaab7-34ed-45b8-b863-20d137053b1b service placement] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:04.520813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ceaab7-34ed-45b8-b863-20d137053b1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:04.525192 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-93ceaab7-34ed-45b8-b863-20d137053b1b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:04.538881 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ceaab7-34ed-45b8-b863-20d137053b1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:04.540799 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ceaab7-34ed-45b8-b863-20d137053b1b service placement] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:04.556070 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 834/1658] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:07.199655 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27796b10-744f-4d18-899a-2ee6f5da18ee None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:07.200632 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27796b10-744f-4d18-899a-2ee6f5da18ee None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:07.201068 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27796b10-744f-4d18-899a-2ee6f5da18ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:07.272354 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-27796b10-744f-4d18-899a-2ee6f5da18ee None None] MFA Rules not processed for user `48c4263ebbc749f989d22b73244e5296`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:07.274149 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-27796b10-744f-4d18-899a-2ee6f5da18ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:07.426017 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 825/1659] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:07 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:10.410715 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d51a20-b1b1-46a4-be12-73ab5f006210 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:10.411276 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d51a20-b1b1-46a4-be12-73ab5f006210 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:10.411276 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d51a20-b1b1-46a4-be12-73ab5f006210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:10.450243 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-88d51a20-b1b1-46a4-be12-73ab5f006210 None None] MFA Rules not processed for user `737d115302cb48bb90f8c4771d6ad7f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:10.451517 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-88d51a20-b1b1-46a4-be12-73ab5f006210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:10.526478 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 835/1660] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:10.543443 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27796b10-744f-4d18-899a-2ee6f5da18ee None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:10.664020 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27796b10-744f-4d18-899a-2ee6f5da18ee None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:10.683171 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca040c-8306-41e7-b93b-cb401ca06035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:10.684255 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca040c-8306-41e7-b93b-cb401ca06035 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:10.684583 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca040c-8306-41e7-b93b-cb401ca06035 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:10.684906 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca040c-8306-41e7-b93b-cb401ca06035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:10.695701 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca040c-8306-41e7-b93b-cb401ca06035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:10.697500 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca040c-8306-41e7-b93b-cb401ca06035 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:10.718637 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 826/1661] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:11.245539 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d51a20-b1b1-46a4-be12-73ab5f006210 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:11.408504 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d51a20-b1b1-46a4-be12-73ab5f006210 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:11.414091 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1188a-22ba-4769-97b3-44ecba36ecb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:11.416382 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1188a-22ba-4769-97b3-44ecba36ecb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:11.416890 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1188a-22ba-4769-97b3-44ecba36ecb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:11.417320 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1188a-22ba-4769-97b3-44ecba36ecb0 admin admin] PATH_INFO: `/v3/users/4238092890264934b19838fe9bdd5040` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:11.420605 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1188a-22ba-4769-97b3-44ecba36ecb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4238092890264934b19838fe9bdd5040)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:11.423259 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: WARNING py.warnings [None req-24e1188a-22ba-4769-97b3-44ecba36ecb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:33:11.423259 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: warnings.warn(msg) Feb 16 05:33:11.423259 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: Feb 16 05:33:11.426305 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1188a-22ba-4769-97b3-44ecba36ecb0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:11.551506 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-24e1188a-22ba-4769-97b3-44ecba36ecb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4238092890264934b19838fe9bdd5040'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:11.581416 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-24e1188a-22ba-4769-97b3-44ecba36ecb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4238092890264934b19838fe9bdd5040'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:11.635334 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-24e1188a-22ba-4769-97b3-44ecba36ecb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4238092890264934b19838fe9bdd5040'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:11.636539 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-24e1188a-22ba-4769-97b3-44ecba36ecb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4238092890264934b19838fe9bdd5040'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:11.637317 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-24e1188a-22ba-4769-97b3-44ecba36ecb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4238092890264934b19838fe9bdd5040'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:11.661425 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 836/1662] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:33:11 2022] DELETE /identity/v3/users/4238092890264934b19838fe9bdd5040 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:12.547149 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ba746-0841-4e90-8a45-8d8448ab1044 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:12.548130 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ba746-0841-4e90-8a45-8d8448ab1044 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:12.548534 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ba746-0841-4e90-8a45-8d8448ab1044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:12.586400 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-650ba746-0841-4e90-8a45-8d8448ab1044 None None] MFA Rules not processed for user `4d22345d2e2646cc99c74a2f9692b648`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:12.587980 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-650ba746-0841-4e90-8a45-8d8448ab1044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:12.671351 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 827/1663] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Feb 16 05:33:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:12.978329 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1188a-22ba-4769-97b3-44ecba36ecb0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:12.981729 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-24e1188a-22ba-4769-97b3-44ecba36ecb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:13.061375 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ba746-0841-4e90-8a45-8d8448ab1044 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:13.063119 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-650ba746-0841-4e90-8a45-8d8448ab1044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:13.198960 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1188a-22ba-4769-97b3-44ecba36ecb0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:13.222282 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbd07c-ac00-46f9-85e6-01659527f1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:13.228256 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbd07c-ac00-46f9-85e6-01659527f1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:13.228545 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbd07c-ac00-46f9-85e6-01659527f1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:13.228825 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dbd07c-ac00-46f9-85e6-01659527f1a3 admin admin] PATH_INFO: `/v3/projects/29a54dafb7ef43e6a927b5853e138737` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:13.231033 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbd07c-ac00-46f9-85e6-01659527f1a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29a54dafb7ef43e6a927b5853e138737)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:13.254908 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dbd07c-ac00-46f9-85e6-01659527f1a3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:13.311617 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ba746-0841-4e90-8a45-8d8448ab1044 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:13.327720 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea15ba-2098-4d6d-ac2a-91c1a180fb2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eb49cac0c94e73a70361831dd789b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:13.330544 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea15ba-2098-4d6d-ac2a-91c1a180fb2c service swift] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:13.331055 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea15ba-2098-4d6d-ac2a-91c1a180fb2c service swift] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:13.331756 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea15ba-2098-4d6d-ac2a-91c1a180fb2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:13.384700 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea15ba-2098-4d6d-ac2a-91c1a180fb2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:13.393174 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea15ba-2098-4d6d-ac2a-91c1a180fb2c service swift] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:13.425767 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 828/1664] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Feb 16 05:33:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 05:33:13.432653 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-37dbd07c-ac00-46f9-85e6-01659527f1a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29a54dafb7ef43e6a927b5853e138737', 'request_id': 'req-37dbd07c-ac00-46f9-85e6-01659527f1a3'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:13.458612 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-37dbd07c-ac00-46f9-85e6-01659527f1a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29a54dafb7ef43e6a927b5853e138737', 'request_id': 'req-37dbd07c-ac00-46f9-85e6-01659527f1a3'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:13.476480 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-37dbd07c-ac00-46f9-85e6-01659527f1a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29a54dafb7ef43e6a927b5853e138737', 'request_id': 'req-37dbd07c-ac00-46f9-85e6-01659527f1a3'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:13.515748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-37dbd07c-ac00-46f9-85e6-01659527f1a3 admin admin] The token cache is being invalidate because project 29a54dafb7ef43e6a927b5853e138737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:33:13.516041 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-37dbd07c-ac00-46f9-85e6-01659527f1a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:13.520372 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-37dbd07c-ac00-46f9-85e6-01659527f1a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:13.531104 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea15ba-2098-4d6d-ac2a-91c1a180fb2c service swift] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:13.532007 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 837/1665] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:33:12 2022] DELETE /identity/v3/projects/29a54dafb7ef43e6a927b5853e138737 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:13.555472 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea15ba-2098-4d6d-ac2a-91c1a180fb2c service swift] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:13.756845 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fc572-494b-416c-b510-e56b74aa0c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:13.760881 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fc572-494b-416c-b510-e56b74aa0c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:13.764527 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fc572-494b-416c-b510-e56b74aa0c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:13.766112 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fc572-494b-416c-b510-e56b74aa0c59 admin admin] PATH_INFO: `/v3/users/48c4263ebbc749f989d22b73244e5296` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:13.770800 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fc572-494b-416c-b510-e56b74aa0c59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48c4263ebbc749f989d22b73244e5296)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:13.782131 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fc572-494b-416c-b510-e56b74aa0c59 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:13.865485 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbd07c-ac00-46f9-85e6-01659527f1a3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:13.867234 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-37dbd07c-ac00-46f9-85e6-01659527f1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:13.895898 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dbd07c-ac00-46f9-85e6-01659527f1a3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:13.908833 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83446878-e907-4747-9cb4-1750ff63135a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:13.912224 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83446878-e907-4747-9cb4-1750ff63135a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:13.912674 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83446878-e907-4747-9cb4-1750ff63135a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:13.914006 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83446878-e907-4747-9cb4-1750ff63135a admin admin] PATH_INFO: `/v3/users/bc9bebf7e8734542851229333d51eaae` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:13.920983 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83446878-e907-4747-9cb4-1750ff63135a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc9bebf7e8734542851229333d51eaae)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:13.925875 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83446878-e907-4747-9cb4-1750ff63135a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:13.950509 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-687fc572-494b-416c-b510-e56b74aa0c59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48c4263ebbc749f989d22b73244e5296'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:13.980512 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-687fc572-494b-416c-b510-e56b74aa0c59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48c4263ebbc749f989d22b73244e5296'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:13.981128 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-687fc572-494b-416c-b510-e56b74aa0c59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48c4263ebbc749f989d22b73244e5296'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:13.981760 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-687fc572-494b-416c-b510-e56b74aa0c59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48c4263ebbc749f989d22b73244e5296'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:13.996325 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-687fc572-494b-416c-b510-e56b74aa0c59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48c4263ebbc749f989d22b73244e5296'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:14.030188 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 829/1666] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:33:13 2022] DELETE /identity/v3/users/48c4263ebbc749f989d22b73244e5296 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:14.069166 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-83446878-e907-4747-9cb4-1750ff63135a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc9bebf7e8734542851229333d51eaae'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:14.092753 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-83446878-e907-4747-9cb4-1750ff63135a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc9bebf7e8734542851229333d51eaae'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:14.138803 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-83446878-e907-4747-9cb4-1750ff63135a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc9bebf7e8734542851229333d51eaae'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:14.140416 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-83446878-e907-4747-9cb4-1750ff63135a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc9bebf7e8734542851229333d51eaae'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:14.142486 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-83446878-e907-4747-9cb4-1750ff63135a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc9bebf7e8734542851229333d51eaae'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:14.187681 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 838/1667] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:33:13 2022] DELETE /identity/v3/users/bc9bebf7e8734542851229333d51eaae => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:14.192733 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fc524-861e-4b74-ab2e-7e73ca298bc7 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:14.193081 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fc524-861e-4b74-ab2e-7e73ca298bc7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:14.193435 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fc524-861e-4b74-ab2e-7e73ca298bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:14.234098 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-850fc524-861e-4b74-ab2e-7e73ca298bc7 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:14.235330 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-850fc524-861e-4b74-ab2e-7e73ca298bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:14.446314 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 830/1668] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:14.542855 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83446878-e907-4747-9cb4-1750ff63135a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:14.545516 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-83446878-e907-4747-9cb4-1750ff63135a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:14.828352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83446878-e907-4747-9cb4-1750ff63135a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:14.835585 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50821d98-ded7-4974-b847-8d543ba3d260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:14.836245 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50821d98-ded7-4974-b847-8d543ba3d260 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:14.836521 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50821d98-ded7-4974-b847-8d543ba3d260 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:14.836844 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50821d98-ded7-4974-b847-8d543ba3d260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:14.855853 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50821d98-ded7-4974-b847-8d543ba3d260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:14.857724 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50821d98-ded7-4974-b847-8d543ba3d260 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:14.891448 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 839/1669] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:15.693692 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fc524-861e-4b74-ab2e-7e73ca298bc7 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:15.695339 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-850fc524-861e-4b74-ab2e-7e73ca298bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:15.719892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fc524-861e-4b74-ab2e-7e73ca298bc7 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:15.734459 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0019291-5c07-4a06-afcc-c2afdcf35de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:15.736771 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0019291-5c07-4a06-afcc-c2afdcf35de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:15.737092 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0019291-5c07-4a06-afcc-c2afdcf35de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:15.738770 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0019291-5c07-4a06-afcc-c2afdcf35de9 admin admin] PATH_INFO: `/v3/projects/8177bbab7c064d3591e870288c0ce180` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:15.746513 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0019291-5c07-4a06-afcc-c2afdcf35de9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8177bbab7c064d3591e870288c0ce180)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:15.747724 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: WARNING py.warnings [None req-a0019291-5c07-4a06-afcc-c2afdcf35de9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 16 05:33:15.747724 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: warnings.warn(msg) Feb 16 05:33:15.747724 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: Feb 16 05:33:15.754105 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0019291-5c07-4a06-afcc-c2afdcf35de9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:15.996061 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-a0019291-5c07-4a06-afcc-c2afdcf35de9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8177bbab7c064d3591e870288c0ce180', 'request_id': 'req-a0019291-5c07-4a06-afcc-c2afdcf35de9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:16.042600 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-a0019291-5c07-4a06-afcc-c2afdcf35de9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8177bbab7c064d3591e870288c0ce180', 'request_id': 'req-a0019291-5c07-4a06-afcc-c2afdcf35de9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:16.083721 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-a0019291-5c07-4a06-afcc-c2afdcf35de9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8177bbab7c064d3591e870288c0ce180', 'request_id': 'req-a0019291-5c07-4a06-afcc-c2afdcf35de9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:16.172584 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-a0019291-5c07-4a06-afcc-c2afdcf35de9 admin admin] The token cache is being invalidate because project 8177bbab7c064d3591e870288c0ce180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:33:16.178960 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-a0019291-5c07-4a06-afcc-c2afdcf35de9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:16.180607 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-a0019291-5c07-4a06-afcc-c2afdcf35de9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:16.190067 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 831/1670] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:33:15 2022] DELETE /identity/v3/projects/8177bbab7c064d3591e870288c0ce180 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:16.194895 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef200c-467d-4094-b0a0-3b74c8264b01 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:16.195420 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef200c-467d-4094-b0a0-3b74c8264b01 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:16.195420 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef200c-467d-4094-b0a0-3b74c8264b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:16.279820 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-24ef200c-467d-4094-b0a0-3b74c8264b01 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:16.283678 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-24ef200c-467d-4094-b0a0-3b74c8264b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:16.557509 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0019291-5c07-4a06-afcc-c2afdcf35de9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:16.559184 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a0019291-5c07-4a06-afcc-c2afdcf35de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:16.563112 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 840/1671] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:16.564642 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d89fb-c688-4fa2-9a19-80bfa93f9df0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:16.564930 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d89fb-c688-4fa2-9a19-80bfa93f9df0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:16.565208 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d89fb-c688-4fa2-9a19-80bfa93f9df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:16.583493 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0019291-5c07-4a06-afcc-c2afdcf35de9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:16.609371 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-b86d89fb-c688-4fa2-9a19-80bfa93f9df0 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:16.610312 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b6740-ed88-4e94-9804-0d1f97848cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:16.610628 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b86d89fb-c688-4fa2-9a19-80bfa93f9df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:16.611238 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b6740-ed88-4e94-9804-0d1f97848cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:16.611523 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b6740-ed88-4e94-9804-0d1f97848cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:16.611888 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b6740-ed88-4e94-9804-0d1f97848cb3 admin admin] PATH_INFO: `/v3/users/c4374857f9d24557b906b8cadba49b33` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:16.622196 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b6740-ed88-4e94-9804-0d1f97848cb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4374857f9d24557b906b8cadba49b33)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:16.625572 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b6740-ed88-4e94-9804-0d1f97848cb3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:16.637945 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 841/1672] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:16.644807 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d89fb-c688-4fa2-9a19-80bfa93f9df0 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:16.667130 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d89fb-c688-4fa2-9a19-80bfa93f9df0 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:16.675977 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1872b-aaf2-43c9-854c-b162fe6b6443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:16.676831 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1872b-aaf2-43c9-854c-b162fe6b6443 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:16.677294 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1872b-aaf2-43c9-854c-b162fe6b6443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:16.677726 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1872b-aaf2-43c9-854c-b162fe6b6443 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:16.678612 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1872b-aaf2-43c9-854c-b162fe6b6443 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:33:16.679069 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1872b-aaf2-43c9-854c-b162fe6b6443 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:16.680874 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1872b-aaf2-43c9-854c-b162fe6b6443 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:16.708059 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 842/1673] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:33:16.710439 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1872b-aaf2-43c9-854c-b162fe6b6443 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:16.777623 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1872b-aaf2-43c9-854c-b162fe6b6443 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:16.801911 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b364457-02dc-4fab-bd84-d180bc5df0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:16.807332 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b364457-02dc-4fab-bd84-d180bc5df0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:16.807966 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b364457-02dc-4fab-bd84-d180bc5df0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:16.808316 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b364457-02dc-4fab-bd84-d180bc5df0c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:16.815510 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b364457-02dc-4fab-bd84-d180bc5df0c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:16.816039 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e60b6740-ed88-4e94-9804-0d1f97848cb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4374857f9d24557b906b8cadba49b33'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:16.826455 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b364457-02dc-4fab-bd84-d180bc5df0c7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:16.872748 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e60b6740-ed88-4e94-9804-0d1f97848cb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4374857f9d24557b906b8cadba49b33'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:16.874144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e60b6740-ed88-4e94-9804-0d1f97848cb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4374857f9d24557b906b8cadba49b33'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:16.877926 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e60b6740-ed88-4e94-9804-0d1f97848cb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4374857f9d24557b906b8cadba49b33'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:16.908771 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e60b6740-ed88-4e94-9804-0d1f97848cb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4374857f9d24557b906b8cadba49b33'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:16.930552 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 843/1674] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:33:16 2022] POST /identity/v3/projects => generated 363 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:16.936833 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b364457-02dc-4fab-bd84-d180bc5df0c7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:16.939684 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6b364457-02dc-4fab-bd84-d180bc5df0c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:16.959994 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 832/1675] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:33:16 2022] DELETE /identity/v3/users/c4374857f9d24557b906b8cadba49b33 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:16.961378 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79df6bc-b516-4372-83bd-0213662bffae None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:16.971655 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79df6bc-b516-4372-83bd-0213662bffae None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:16.974943 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79df6bc-b516-4372-83bd-0213662bffae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:17.096820 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-d79df6bc-b516-4372-83bd-0213662bffae None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:17.104774 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d79df6bc-b516-4372-83bd-0213662bffae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:17.315027 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b364457-02dc-4fab-bd84-d180bc5df0c7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:17.449624 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 833/1676] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:17.450842 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770dd8f-f191-40e2-99f8-5d92ffb6c2ca None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:17.451779 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770dd8f-f191-40e2-99f8-5d92ffb6c2ca None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:17.452171 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770dd8f-f191-40e2-99f8-5d92ffb6c2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:17.482852 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78de40-f63b-4734-bb6a-f3789ddedfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:17.485063 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78de40-f63b-4734-bb6a-f3789ddedfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:17.485375 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78de40-f63b-4734-bb6a-f3789ddedfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:17.485660 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78de40-f63b-4734-bb6a-f3789ddedfb3 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:17.486371 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78de40-f63b-4734-bb6a-f3789ddedfb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:17.492850 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78de40-f63b-4734-bb6a-f3789ddedfb3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:17.548252 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 844/1677] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:33:16 2022] POST /identity/v3/users => generated 282 bytes in 613 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:17.549401 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78de40-f63b-4734-bb6a-f3789ddedfb3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:17.565567 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-3770dd8f-f191-40e2-99f8-5d92ffb6c2ca None None] MFA Rules not processed for user `fd4eac62484c47988657d2a730f2d056`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:17.572690 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78de40-f63b-4734-bb6a-f3789ddedfb3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:17.577589 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3770dd8f-f191-40e2-99f8-5d92ffb6c2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:17.584679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e2b15-6c2a-4d20-b221-be00043c641c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:17.585397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e2b15-6c2a-4d20-b221-be00043c641c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:17.585682 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e2b15-6c2a-4d20-b221-be00043c641c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:17.585965 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e2b15-6c2a-4d20-b221-be00043c641c admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:17.586708 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e2b15-6c2a-4d20-b221-be00043c641c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:17.593706 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e2b15-6c2a-4d20-b221-be00043c641c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:17.620255 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 845/1678] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:17.624606 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e2b15-6c2a-4d20-b221-be00043c641c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:17.627298 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6d6e2b15-6c2a-4d20-b221-be00043c641c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:17.698587 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 834/1679] 10.222.0.60 () {58 vars in 1015 bytes} [Wed Feb 16 05:33:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:17.699867 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770dd8f-f191-40e2-99f8-5d92ffb6c2ca None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:17.721580 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770dd8f-f191-40e2-99f8-5d92ffb6c2ca None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:17.731361 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39b47b-e2d7-46dc-9c2a-f47220b20226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:17.732090 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39b47b-e2d7-46dc-9c2a-f47220b20226 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:17.732906 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39b47b-e2d7-46dc-9c2a-f47220b20226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:17.733252 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39b47b-e2d7-46dc-9c2a-f47220b20226 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:17.735778 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39b47b-e2d7-46dc-9c2a-f47220b20226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:17.739993 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39b47b-e2d7-46dc-9c2a-f47220b20226 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:17.752909 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 835/1680] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:17.757616 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e2b15-6c2a-4d20-b221-be00043c641c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:17.761703 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39b47b-e2d7-46dc-9c2a-f47220b20226 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:17.775486 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f9967-70ac-4dfb-86fe-28f6e5a4d9d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:17.781111 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f9967-70ac-4dfb-86fe-28f6e5a4d9d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:17.781743 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f9967-70ac-4dfb-86fe-28f6e5a4d9d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:17.782033 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f9967-70ac-4dfb-86fe-28f6e5a4d9d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:17.784403 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39b47b-e2d7-46dc-9c2a-f47220b20226 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:17.803586 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5aafa-5001-4cd4-b813-92e2c0687e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:17.804632 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5aafa-5001-4cd4-b813-92e2c0687e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:17.804979 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5aafa-5001-4cd4-b813-92e2c0687e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:17.805299 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5aafa-5001-4cd4-b813-92e2c0687e43 admin admin] PATH_INFO: `/v3/projects/925dd6ab1be14fdfb407c04dc635844f/users/3dce843c1f664ad896c8f5b9a59cf575/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:17.823628 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f9967-70ac-4dfb-86fe-28f6e5a4d9d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:17.824919 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f9967-70ac-4dfb-86fe-28f6e5a4d9d2 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:17.856002 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5aafa-5001-4cd4-b813-92e2c0687e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=925dd6ab1be14fdfb407c04dc635844f, user_id=3dce843c1f664ad896c8f5b9a59cf575, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:17.861384 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5aafa-5001-4cd4-b813-92e2c0687e43 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:17.879871 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 846/1681] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:17.881628 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f9967-70ac-4dfb-86fe-28f6e5a4d9d2 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:17.902112 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f9967-70ac-4dfb-86fe-28f6e5a4d9d2 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:17.931730 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 836/1682] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:17 2022] PUT /identity/v3/projects/925dd6ab1be14fdfb407c04dc635844f/users/3dce843c1f664ad896c8f5b9a59cf575/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:17.939217 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5aafa-5001-4cd4-b813-92e2c0687e43 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:18.075199 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88041995-cdaa-4566-bbb8-b9a0d74bd606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:18.076003 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88041995-cdaa-4566-bbb8-b9a0d74bd606 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:18.076382 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88041995-cdaa-4566-bbb8-b9a0d74bd606 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:18.076772 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88041995-cdaa-4566-bbb8-b9a0d74bd606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:18.116500 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88041995-cdaa-4566-bbb8-b9a0d74bd606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:18.119328 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88041995-cdaa-4566-bbb8-b9a0d74bd606 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:18.122058 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5aafa-5001-4cd4-b813-92e2c0687e43 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:18.135873 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0ce4e-bc16-4166-925e-54be9fac4843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:18.136555 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ce4e-bc16-4166-925e-54be9fac4843 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:18.136817 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ce4e-bc16-4166-925e-54be9fac4843 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:18.140991 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0ce4e-bc16-4166-925e-54be9fac4843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:18.165627 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 847/1683] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:18.167366 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4f024-299d-44e4-9d4d-bb46a83a31a1 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:18.168204 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4f024-299d-44e4-9d4d-bb46a83a31a1 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:18.168968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4f024-299d-44e4-9d4d-bb46a83a31a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:18.169081 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0ce4e-bc16-4166-925e-54be9fac4843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:18.176413 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe0ce4e-bc16-4166-925e-54be9fac4843 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:18.210129 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 837/1684] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:18.253038 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0cb4f024-299d-44e4-9d4d-bb46a83a31a1 None None] MFA Rules not processed for user `3dce843c1f664ad896c8f5b9a59cf575`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:18.254619 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0cb4f024-299d-44e4-9d4d-bb46a83a31a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:18.479501 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 848/1685] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:18.484891 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0ce4e-bc16-4166-925e-54be9fac4843 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:18.718888 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0ce4e-bc16-4166-925e-54be9fac4843 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:18.739257 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41715d-c308-4cc0-b500-6dbcc478f013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:18.739857 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41715d-c308-4cc0-b500-6dbcc478f013 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:18.740144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41715d-c308-4cc0-b500-6dbcc478f013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:18.740427 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41715d-c308-4cc0-b500-6dbcc478f013 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:18.741152 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41715d-c308-4cc0-b500-6dbcc478f013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:18.750314 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41715d-c308-4cc0-b500-6dbcc478f013 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:18.850458 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4f024-299d-44e4-9d4d-bb46a83a31a1 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:18.851548 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 838/1686] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:33:18 2022] POST /identity/v3/projects => generated 363 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:18.873475 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4f024-299d-44e4-9d4d-bb46a83a31a1 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:19.088348 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f70584-be5d-43e5-af95-67b6cb00c6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:19.089208 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f70584-be5d-43e5-af95-67b6cb00c6a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:19.089677 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f70584-be5d-43e5-af95-67b6cb00c6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:19.090056 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f70584-be5d-43e5-af95-67b6cb00c6a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:19.090873 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f70584-be5d-43e5-af95-67b6cb00c6a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:19.093567 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f70584-be5d-43e5-af95-67b6cb00c6a6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:19.164796 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 849/1687] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:33:18 2022] POST /identity/v3/users => generated 288 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:19.168806 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41715d-c308-4cc0-b500-6dbcc478f013 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:19.181303 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41715d-c308-4cc0-b500-6dbcc478f013 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:19.212128 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939eb5b-f274-4733-9691-2160285dbcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:19.212907 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939eb5b-f274-4733-9691-2160285dbcab admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:19.213271 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939eb5b-f274-4733-9691-2160285dbcab admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:19.215568 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939eb5b-f274-4733-9691-2160285dbcab admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:19.216468 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939eb5b-f274-4733-9691-2160285dbcab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:19.218735 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939eb5b-f274-4733-9691-2160285dbcab admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:19.261776 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f70584-be5d-43e5-af95-67b6cb00c6a6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:19.262831 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 839/1688] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:19.275386 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f70584-be5d-43e5-af95-67b6cb00c6a6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:19.290802 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc9a6a-6811-4b40-9c1c-b35756ae3084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:19.291885 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc9a6a-6811-4b40-9c1c-b35756ae3084 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:19.292350 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc9a6a-6811-4b40-9c1c-b35756ae3084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:19.292735 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc9a6a-6811-4b40-9c1c-b35756ae3084 admin admin] PATH_INFO: `/v3/projects/13d7c90e99184ed19b34a1c4e6c50f8a/users/4dfda98906424b5d9fd8c035ec2d1391/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:19.325480 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc9a6a-6811-4b40-9c1c-b35756ae3084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d7c90e99184ed19b34a1c4e6c50f8a, user_id=4dfda98906424b5d9fd8c035ec2d1391, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:19.329058 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc9a6a-6811-4b40-9c1c-b35756ae3084 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:19.384903 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 850/1689] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:19 2022] PUT /identity/v3/projects/13d7c90e99184ed19b34a1c4e6c50f8a/users/4dfda98906424b5d9fd8c035ec2d1391/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:19.390596 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939eb5b-f274-4733-9691-2160285dbcab admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:19.404073 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd652798-449c-4b24-9cd0-d968701d48c8 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:19.405147 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd652798-449c-4b24-9cd0-d968701d48c8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:19.405660 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd652798-449c-4b24-9cd0-d968701d48c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:19.415386 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939eb5b-f274-4733-9691-2160285dbcab admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:19.459927 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-dd652798-449c-4b24-9cd0-d968701d48c8 None None] MFA Rules not processed for user `737d115302cb48bb90f8c4771d6ad7f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:19.461522 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-dd652798-449c-4b24-9cd0-d968701d48c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:19.607190 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 851/1690] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:33:19.608291 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd652798-449c-4b24-9cd0-d968701d48c8 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:19.611669 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-dd652798-449c-4b24-9cd0-d968701d48c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:19.660712 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc52c6-2872-4bf3-af69-ba0fd8db9363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:19.663924 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc52c6-2872-4bf3-af69-ba0fd8db9363 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:19.683632 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc52c6-2872-4bf3-af69-ba0fd8db9363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:19.684065 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc52c6-2872-4bf3-af69-ba0fd8db9363 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:19.684876 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc52c6-2872-4bf3-af69-ba0fd8db9363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:19.689198 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc52c6-2872-4bf3-af69-ba0fd8db9363 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:19.729526 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 840/1691] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:19.733637 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc52c6-2872-4bf3-af69-ba0fd8db9363 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:19.754566 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc52c6-2872-4bf3-af69-ba0fd8db9363 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:19.774112 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c377b8-eed2-49d1-9c6d-04f0e655d6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:19.775076 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c377b8-eed2-49d1-9c6d-04f0e655d6e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:19.775358 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c377b8-eed2-49d1-9c6d-04f0e655d6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:19.775797 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c377b8-eed2-49d1-9c6d-04f0e655d6e0 admin admin] PATH_INFO: `/v3/projects/13d7c90e99184ed19b34a1c4e6c50f8a/users/4dfda98906424b5d9fd8c035ec2d1391/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:19.780293 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c377b8-eed2-49d1-9c6d-04f0e655d6e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d7c90e99184ed19b34a1c4e6c50f8a, user_id=4dfda98906424b5d9fd8c035ec2d1391, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:19.785284 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c377b8-eed2-49d1-9c6d-04f0e655d6e0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:19.812175 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd652798-449c-4b24-9cd0-d968701d48c8 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:19.822489 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 841/1692] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:19 2022] PUT /identity/v3/projects/13d7c90e99184ed19b34a1c4e6c50f8a/users/4dfda98906424b5d9fd8c035ec2d1391/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:19.824049 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5697b7-c076-4e58-80ef-e5fd55f5c590 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:19.824334 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5697b7-c076-4e58-80ef-e5fd55f5c590 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:19.824604 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5697b7-c076-4e58-80ef-e5fd55f5c590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:19.900616 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ab5697b7-c076-4e58-80ef-e5fd55f5c590 None None] MFA Rules not processed for user `4dfda98906424b5d9fd8c035ec2d1391`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:19.901880 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ab5697b7-c076-4e58-80ef-e5fd55f5c590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:19.940125 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e202da-653b-4536-8226-612e2510a2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:19.941144 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e202da-653b-4536-8226-612e2510a2a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:19.941592 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e202da-653b-4536-8226-612e2510a2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:19.942037 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e202da-653b-4536-8226-612e2510a2a0 admin admin] PATH_INFO: `/v3/projects/30e79b84eae64ef2a3c5399ef73f3443` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:19.943785 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e202da-653b-4536-8226-612e2510a2a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30e79b84eae64ef2a3c5399ef73f3443)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:19.948425 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e202da-653b-4536-8226-612e2510a2a0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:20.144718 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-95e202da-653b-4536-8226-612e2510a2a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30e79b84eae64ef2a3c5399ef73f3443', 'request_id': 'req-95e202da-653b-4536-8226-612e2510a2a0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:20.146761 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 842/1693] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:19 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:20.147729 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5697b7-c076-4e58-80ef-e5fd55f5c590 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:20.156352 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ab5697b7-c076-4e58-80ef-e5fd55f5c590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:20.179811 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-95e202da-653b-4536-8226-612e2510a2a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30e79b84eae64ef2a3c5399ef73f3443', 'request_id': 'req-95e202da-653b-4536-8226-612e2510a2a0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:20.193424 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-95e202da-653b-4536-8226-612e2510a2a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30e79b84eae64ef2a3c5399ef73f3443', 'request_id': 'req-95e202da-653b-4536-8226-612e2510a2a0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:20.243842 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-95e202da-653b-4536-8226-612e2510a2a0 admin admin] The token cache is being invalidate because project 30e79b84eae64ef2a3c5399ef73f3443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:33:20.245547 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-95e202da-653b-4536-8226-612e2510a2a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:20.249740 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-95e202da-653b-4536-8226-612e2510a2a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:20.255399 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 852/1694] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:33:19 2022] DELETE /identity/v3/projects/30e79b84eae64ef2a3c5399ef73f3443 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:20.257099 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac486e-ee19-481e-ba4b-e5dcb3691804 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:20.262363 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac486e-ee19-481e-ba4b-e5dcb3691804 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:20.262686 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac486e-ee19-481e-ba4b-e5dcb3691804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:20.280533 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5697b7-c076-4e58-80ef-e5fd55f5c590 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:20.318235 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-86ac486e-ee19-481e-ba4b-e5dcb3691804 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:20.319482 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-86ac486e-ee19-481e-ba4b-e5dcb3691804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:20.437844 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058c42b-1cee-4ce6-8137-172622842cc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:20.438511 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058c42b-1cee-4ce6-8137-172622842cc2 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:20.443878 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058c42b-1cee-4ce6-8137-172622842cc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:20.446111 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058c42b-1cee-4ce6-8137-172622842cc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:20.455265 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-1058c42b-1cee-4ce6-8137-172622842cc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:20.501576 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 853/1695] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:20.509310 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e5f2f-f951-4d5e-92c8-e02bf6d5ac82 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:20.509606 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e5f2f-f951-4d5e-92c8-e02bf6d5ac82 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:20.509864 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e5f2f-f951-4d5e-92c8-e02bf6d5ac82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:20.551560 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-b53e5f2f-f951-4d5e-92c8-e02bf6d5ac82 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:20.561817 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b53e5f2f-f951-4d5e-92c8-e02bf6d5ac82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:20.593902 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 854/1696] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:33:20.594945 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e5f2f-f951-4d5e-92c8-e02bf6d5ac82 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:20.620911 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e5f2f-f951-4d5e-92c8-e02bf6d5ac82 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:20.640554 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058c42b-1cee-4ce6-8137-172622842cc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:20.642077 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058c42b-1cee-4ce6-8137-172622842cc2 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:20.646133 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87fbc8-f44d-45d1-850c-912c67ef52ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:20.646816 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87fbc8-f44d-45d1-850c-912c67ef52ee admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:20.647090 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87fbc8-f44d-45d1-850c-912c67ef52ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:20.647359 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87fbc8-f44d-45d1-850c-912c67ef52ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:20.648090 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87fbc8-f44d-45d1-850c-912c67ef52ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:33:20.655886 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87fbc8-f44d-45d1-850c-912c67ef52ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:20.655886 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87fbc8-f44d-45d1-850c-912c67ef52ee admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:20.687233 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 843/1697] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:20 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:20.706329 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 855/1698] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:33:20.707752 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058c42b-1cee-4ce6-8137-172622842cc2 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:20.722609 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058c42b-1cee-4ce6-8137-172622842cc2 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:20.754178 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2acb1-4432-4487-a91d-d59703510e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:20.755109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2acb1-4432-4487-a91d-d59703510e02 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:20.755583 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2acb1-4432-4487-a91d-d59703510e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:20.756037 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2acb1-4432-4487-a91d-d59703510e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:20.756991 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2acb1-4432-4487-a91d-d59703510e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:20.759451 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c2acb1-4432-4487-a91d-d59703510e02 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:20.855443 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 844/1699] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:33:20 2022] POST /identity/v3/projects => generated 363 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:20.855631 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87fbc8-f44d-45d1-850c-912c67ef52ee admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:20.855631 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ff87fbc8-f44d-45d1-850c-912c67ef52ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:20.856896 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2acb1-4432-4487-a91d-d59703510e02 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:20.890943 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87fbc8-f44d-45d1-850c-912c67ef52ee admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:20.980062 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2acb1-4432-4487-a91d-d59703510e02 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:20.994089 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a2369-797d-41b6-b59f-1f085c391c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:20.995145 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2369-797d-41b6-b59f-1f085c391c22 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:20.995653 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2369-797d-41b6-b59f-1f085c391c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:20.996146 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2369-797d-41b6-b59f-1f085c391c22 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:20.997070 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a2369-797d-41b6-b59f-1f085c391c22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:21.000430 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a2369-797d-41b6-b59f-1f085c391c22 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:21.039761 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d993e-35fb-42be-9207-9cf46175c07f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:21.040409 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d993e-35fb-42be-9207-9cf46175c07f service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:21.040687 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d993e-35fb-42be-9207-9cf46175c07f service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:21.040953 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d993e-35fb-42be-9207-9cf46175c07f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:21.048808 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-464d993e-35fb-42be-9207-9cf46175c07f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:21.061359 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 845/1700] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:33:20 2022] POST /identity/v3/users => generated 282 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:21.063650 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a2369-797d-41b6-b59f-1f085c391c22 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:21.098686 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a2369-797d-41b6-b59f-1f085c391c22 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:21.123154 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb1d35-8f55-4f51-aae6-3a97aad5aa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:21.124378 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb1d35-8f55-4f51-aae6-3a97aad5aa4f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:21.124378 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb1d35-8f55-4f51-aae6-3a97aad5aa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:21.124558 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb1d35-8f55-4f51-aae6-3a97aad5aa4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:21.125336 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb1d35-8f55-4f51-aae6-3a97aad5aa4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:21.127099 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb1d35-8f55-4f51-aae6-3a97aad5aa4f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:21.168056 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 846/1701] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:21.168765 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb1d35-8f55-4f51-aae6-3a97aad5aa4f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:21.186144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb1d35-8f55-4f51-aae6-3a97aad5aa4f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:21.204288 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777e964-6d63-47b3-90f6-fac8ec82a22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:21.204972 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777e964-6d63-47b3-90f6-fac8ec82a22b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:21.205280 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777e964-6d63-47b3-90f6-fac8ec82a22b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:21.205551 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777e964-6d63-47b3-90f6-fac8ec82a22b admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:21.206287 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777e964-6d63-47b3-90f6-fac8ec82a22b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:21.208016 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777e964-6d63-47b3-90f6-fac8ec82a22b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:21.226622 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 847/1702] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:21 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:21.238186 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff826a7-f36d-4ec9-9a5d-05b3b2ea2a0b None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:21.238495 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff826a7-f36d-4ec9-9a5d-05b3b2ea2a0b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:21.238788 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff826a7-f36d-4ec9-9a5d-05b3b2ea2a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:21.248475 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d993e-35fb-42be-9207-9cf46175c07f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:21.250024 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d993e-35fb-42be-9207-9cf46175c07f service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:21.308720 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-7ff826a7-f36d-4ec9-9a5d-05b3b2ea2a0b None None] MFA Rules not processed for user `e83de12959394ba5a75f5881741540a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:21.309975 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7ff826a7-f36d-4ec9-9a5d-05b3b2ea2a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:21.328520 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 856/1703] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:20 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:33:21.329541 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d993e-35fb-42be-9207-9cf46175c07f service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:21.362471 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d993e-35fb-42be-9207-9cf46175c07f service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:21.396483 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cffebf-7b10-4d0e-9180-3360fba545f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:21.397467 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cffebf-7b10-4d0e-9180-3360fba545f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:21.397751 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cffebf-7b10-4d0e-9180-3360fba545f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:21.398018 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cffebf-7b10-4d0e-9180-3360fba545f3 admin admin] PATH_INFO: `/v3/projects/752eedd6d9ca4080810f0ad4caaf541f/users/4d0a710953d849a4a0a669eee10590a7/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:21.435746 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cffebf-7b10-4d0e-9180-3360fba545f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=752eedd6d9ca4080810f0ad4caaf541f, user_id=4d0a710953d849a4a0a669eee10590a7, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:21.439257 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cffebf-7b10-4d0e-9180-3360fba545f3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:21.491775 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 848/1704] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:21.502880 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed9f83-83b4-49e6-b63c-f8c2a6fb885d None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:21.503081 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed9f83-83b4-49e6-b63c-f8c2a6fb885d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:21.503421 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 857/1705] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:21 2022] PUT /identity/v3/projects/752eedd6d9ca4080810f0ad4caaf541f/users/4d0a710953d849a4a0a669eee10590a7/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:21.512083 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed9f83-83b4-49e6-b63c-f8c2a6fb885d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:21.515993 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa98a2-5135-4fb2-a6fe-80653deb72ca None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:21.516450 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa98a2-5135-4fb2-a6fe-80653deb72ca None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:21.516871 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa98a2-5135-4fb2-a6fe-80653deb72ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:21.599638 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-15ed9f83-83b4-49e6-b63c-f8c2a6fb885d None None] MFA Rules not processed for user `e83de12959394ba5a75f5881741540a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:21.604039 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-15ed9f83-83b4-49e6-b63c-f8c2a6fb885d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:21.636459 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-f5aa98a2-5135-4fb2-a6fe-80653deb72ca None None] MFA Rules not processed for user `4d0a710953d849a4a0a669eee10590a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:21.637722 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f5aa98a2-5135-4fb2-a6fe-80653deb72ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:21.786697 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 858/1706] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:21.791465 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa98a2-5135-4fb2-a6fe-80653deb72ca None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:21.857925 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 849/1707] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:33:21.923862 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa98a2-5135-4fb2-a6fe-80653deb72ca None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:21.936920 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68e19f-6032-449e-87f0-aca1f745f305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:21.937623 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68e19f-6032-449e-87f0-aca1f745f305 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:21.937908 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68e19f-6032-449e-87f0-aca1f745f305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:21.938178 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68e19f-6032-449e-87f0-aca1f745f305 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:21.938869 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68e19f-6032-449e-87f0-aca1f745f305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:21.940797 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68e19f-6032-449e-87f0-aca1f745f305 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:22.008516 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 859/1708] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:33:21 2022] POST /identity/v3/projects => generated 363 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:33:22.014470 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed9f83-83b4-49e6-b63c-f8c2a6fb885d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:22.053341 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed9f83-83b4-49e6-b63c-f8c2a6fb885d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:22.103749 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68e19f-6032-449e-87f0-aca1f745f305 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:22.106613 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1a68e19f-6032-449e-87f0-aca1f745f305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:22.334621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee9a0c-155d-40db-9876-a29876ee4be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:22.335366 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee9a0c-155d-40db-9876-a29876ee4be0 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:22.335663 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee9a0c-155d-40db-9876-a29876ee4be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:22.335945 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee9a0c-155d-40db-9876-a29876ee4be0 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:22.336688 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee9a0c-155d-40db-9876-a29876ee4be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:22.343135 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee9a0c-155d-40db-9876-a29876ee4be0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:22.382343 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68e19f-6032-449e-87f0-aca1f745f305 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:22.397772 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e30aaf-4ec5-45e4-b77f-dae179febc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:22.400223 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e30aaf-4ec5-45e4-b77f-dae179febc4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:22.402609 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e30aaf-4ec5-45e4-b77f-dae179febc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:22.403109 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e30aaf-4ec5-45e4-b77f-dae179febc4e admin admin] PATH_INFO: `/v3/projects/5cd549fb2fda43f1b4d77154d57672ac` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:22.408211 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e30aaf-4ec5-45e4-b77f-dae179febc4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd549fb2fda43f1b4d77154d57672ac)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:22.413524 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e30aaf-4ec5-45e4-b77f-dae179febc4e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:22.417981 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 850/1709] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:33:22 2022] POST /identity/v3/users => generated 288 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:22.421385 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee9a0c-155d-40db-9876-a29876ee4be0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:22.461969 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee9a0c-155d-40db-9876-a29876ee4be0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:22.474727 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf07ab0-d086-4dbf-a3ac-fe90e7a1e07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:22.475419 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf07ab0-d086-4dbf-a3ac-fe90e7a1e07c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:22.475705 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf07ab0-d086-4dbf-a3ac-fe90e7a1e07c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:22.476441 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf07ab0-d086-4dbf-a3ac-fe90e7a1e07c admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:22.476907 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf07ab0-d086-4dbf-a3ac-fe90e7a1e07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:22.478587 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf07ab0-d086-4dbf-a3ac-fe90e7a1e07c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:22.514164 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 851/1710] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:33:22.523557 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf07ab0-d086-4dbf-a3ac-fe90e7a1e07c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:22.545102 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-09e30aaf-4ec5-45e4-b77f-dae179febc4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd549fb2fda43f1b4d77154d57672ac', 'request_id': 'req-09e30aaf-4ec5-45e4-b77f-dae179febc4e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:22.564779 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-09e30aaf-4ec5-45e4-b77f-dae179febc4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd549fb2fda43f1b4d77154d57672ac', 'request_id': 'req-09e30aaf-4ec5-45e4-b77f-dae179febc4e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:22.567537 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf07ab0-d086-4dbf-a3ac-fe90e7a1e07c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:22.575553 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-09e30aaf-4ec5-45e4-b77f-dae179febc4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd549fb2fda43f1b4d77154d57672ac', 'request_id': 'req-09e30aaf-4ec5-45e4-b77f-dae179febc4e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:22.631111 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-09e30aaf-4ec5-45e4-b77f-dae179febc4e admin admin] The token cache is being invalidate because project 5cd549fb2fda43f1b4d77154d57672ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:33:22.631392 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-09e30aaf-4ec5-45e4-b77f-dae179febc4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:22.632137 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-09e30aaf-4ec5-45e4-b77f-dae179febc4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:22.635428 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 860/1711] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:33:22 2022] DELETE /identity/v3/projects/5cd549fb2fda43f1b4d77154d57672ac => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:22.639707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e30aaf-4ec5-45e4-b77f-dae179febc4e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:22.641123 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-09e30aaf-4ec5-45e4-b77f-dae179febc4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:22.782798 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e754033-fbcb-48c4-a84c-03fb10c2118e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:22.783805 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e754033-fbcb-48c4-a84c-03fb10c2118e admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:22.784152 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e754033-fbcb-48c4-a84c-03fb10c2118e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:22.784497 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e754033-fbcb-48c4-a84c-03fb10c2118e admin admin] PATH_INFO: `/v3/projects/3b963ec7bb8d4cf9a3a08e84cd24dcc8/users/84d601ee25d342e1b8db67caae7bf55c/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:22.826651 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e754033-fbcb-48c4-a84c-03fb10c2118e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b963ec7bb8d4cf9a3a08e84cd24dcc8, user_id=84d601ee25d342e1b8db67caae7bf55c, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:22.832822 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e754033-fbcb-48c4-a84c-03fb10c2118e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:22.873698 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 852/1712] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:22 2022] PUT /identity/v3/projects/3b963ec7bb8d4cf9a3a08e84cd24dcc8/users/84d601ee25d342e1b8db67caae7bf55c/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:22.875242 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e754033-fbcb-48c4-a84c-03fb10c2118e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:22.883099 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5e754033-fbcb-48c4-a84c-03fb10c2118e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:22.901472 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e30aaf-4ec5-45e4-b77f-dae179febc4e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:23.089689 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e754033-fbcb-48c4-a84c-03fb10c2118e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:23.104336 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b33527-a450-4e89-a257-a01c1df88735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:23.105928 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b33527-a450-4e89-a257-a01c1df88735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:23.109417 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8e1d2-fe4a-49d9-a9a7-de7056d244c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:23.109941 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b33527-a450-4e89-a257-a01c1df88735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:23.110373 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b33527-a450-4e89-a257-a01c1df88735 admin admin] PATH_INFO: `/v3/users/da511cb567e949ef81feb648a5123110` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:23.111198 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8e1d2-fe4a-49d9-a9a7-de7056d244c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:23.114298 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8e1d2-fe4a-49d9-a9a7-de7056d244c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:23.115206 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b33527-a450-4e89-a257-a01c1df88735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da511cb567e949ef81feb648a5123110)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:23.116130 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8e1d2-fe4a-49d9-a9a7-de7056d244c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:23.125652 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8e1d2-fe4a-49d9-a9a7-de7056d244c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:23.131131 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b33527-a450-4e89-a257-a01c1df88735 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:23.133322 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8e1d2-fe4a-49d9-a9a7-de7056d244c3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:23.192359 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 853/1713] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:23.192359 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8e1d2-fe4a-49d9-a9a7-de7056d244c3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:23.194168 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e0d8e1d2-fe4a-49d9-a9a7-de7056d244c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:23.315004 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-30b33527-a450-4e89-a257-a01c1df88735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da511cb567e949ef81feb648a5123110'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:23.330269 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-30b33527-a450-4e89-a257-a01c1df88735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da511cb567e949ef81feb648a5123110'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:23.355031 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-30b33527-a450-4e89-a257-a01c1df88735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da511cb567e949ef81feb648a5123110'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:23.356367 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-30b33527-a450-4e89-a257-a01c1df88735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da511cb567e949ef81feb648a5123110'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:23.357797 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-30b33527-a450-4e89-a257-a01c1df88735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da511cb567e949ef81feb648a5123110'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:23.391743 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 861/1714] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:33:22 2022] DELETE /identity/v3/users/da511cb567e949ef81feb648a5123110 => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:33:23.391743 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b33527-a450-4e89-a257-a01c1df88735 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:23.393458 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-30b33527-a450-4e89-a257-a01c1df88735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:23.434087 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8e1d2-fe4a-49d9-a9a7-de7056d244c3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:23.508569 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b33527-a450-4e89-a257-a01c1df88735 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:23.519041 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bde7cb-1552-4d7a-aa9a-bfa818545f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:23.522307 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bde7cb-1552-4d7a-aa9a-bfa818545f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:23.522851 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bde7cb-1552-4d7a-aa9a-bfa818545f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:23.523294 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bde7cb-1552-4d7a-aa9a-bfa818545f55 admin admin] PATH_INFO: `/v3/projects/3b963ec7bb8d4cf9a3a08e84cd24dcc8/users/84d601ee25d342e1b8db67caae7bf55c/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:23.527403 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bde7cb-1552-4d7a-aa9a-bfa818545f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b963ec7bb8d4cf9a3a08e84cd24dcc8, user_id=84d601ee25d342e1b8db67caae7bf55c, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:23.532180 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bde7cb-1552-4d7a-aa9a-bfa818545f55 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:23.554974 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 862/1715] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:23 2022] PUT /identity/v3/projects/3b963ec7bb8d4cf9a3a08e84cd24dcc8/users/84d601ee25d342e1b8db67caae7bf55c/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:23.557218 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875473fc-a6dd-413b-8485-4260b73f6c8b None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:23.557832 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875473fc-a6dd-413b-8485-4260b73f6c8b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:23.558967 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875473fc-a6dd-413b-8485-4260b73f6c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:23.612216 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-875473fc-a6dd-413b-8485-4260b73f6c8b None None] MFA Rules not processed for user `9d3207da0fb24b3f8f329b6837fd9376`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:23.613350 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-875473fc-a6dd-413b-8485-4260b73f6c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:23.696271 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bb68bb-b346-4795-8101-f7e551c09f16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:23.697363 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb68bb-b346-4795-8101-f7e551c09f16 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:23.697852 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb68bb-b346-4795-8101-f7e551c09f16 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:23.698323 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb68bb-b346-4795-8101-f7e551c09f16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:23.703461 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-77bb68bb-b346-4795-8101-f7e551c09f16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:23.849888 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 863/1716] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:23.853742 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cd068-0e4f-431c-b0cc-b8e584cca9a0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:23.854031 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cd068-0e4f-431c-b0cc-b8e584cca9a0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:23.861871 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64cd068-0e4f-431c-b0cc-b8e584cca9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:23.912804 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb68bb-b346-4795-8101-f7e551c09f16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:23.914568 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bb68bb-b346-4795-8101-f7e551c09f16 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:23.933318 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 854/1717] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 743 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:23.945424 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-a64cd068-0e4f-431c-b0cc-b8e584cca9a0 None None] MFA Rules not processed for user `84d601ee25d342e1b8db67caae7bf55c`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:23.946664 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a64cd068-0e4f-431c-b0cc-b8e584cca9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:23.987910 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f8a21-2b18-4a7f-b8ea-1464143dd316 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:23.990375 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f8a21-2b18-4a7f-b8ea-1464143dd316 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:23.990772 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f8a21-2b18-4a7f-b8ea-1464143dd316 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:23.993375 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 855/1718] 10.222.0.75 () {54 vars in 921 bytes} [Wed Feb 16 05:33:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:33:24.108101 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 864/1719] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:23 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:24.124683 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f8a21-2b18-4a7f-b8ea-1464143dd316 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:24.128895 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-599f8a21-2b18-4a7f-b8ea-1464143dd316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:24.234859 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19730e-8005-4a91-8d91-47cb011ab8bb None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:24.235678 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19730e-8005-4a91-8d91-47cb011ab8bb None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:24.235678 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19730e-8005-4a91-8d91-47cb011ab8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:24.252774 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f8a21-2b18-4a7f-b8ea-1464143dd316 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:24.261198 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d9a04-19f7-4360-aa16-c8c38cf6f34b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:24.265170 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d9a04-19f7-4360-aa16-c8c38cf6f34b service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:24.265618 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d9a04-19f7-4360-aa16-c8c38cf6f34b service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:24.266660 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d9a04-19f7-4360-aa16-c8c38cf6f34b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:24.272903 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-6a19730e-8005-4a91-8d91-47cb011ab8bb None None] MFA Rules not processed for user `6522d231532a48ad8dbc9c9e79a021dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:24.274728 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6a19730e-8005-4a91-8d91-47cb011ab8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:24.295039 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d9a04-19f7-4360-aa16-c8c38cf6f34b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:24.300239 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d9a04-19f7-4360-aa16-c8c38cf6f34b service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:24.330623 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 856/1720] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:24 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:24.486035 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 865/1721] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Feb 16 05:33:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:24.739192 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d9a04-19f7-4360-aa16-c8c38cf6f34b service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:24.741547 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-df2d9a04-19f7-4360-aa16-c8c38cf6f34b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:24.823238 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19730e-8005-4a91-8d91-47cb011ab8bb None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:24.883717 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d9a04-19f7-4360-aa16-c8c38cf6f34b service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:24.895326 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba53b6-f0cc-4a61-b868-d8246941c105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:24.899634 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba53b6-f0cc-4a61-b868-d8246941c105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:24.900415 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba53b6-f0cc-4a61-b868-d8246941c105 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:24.900913 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba53b6-f0cc-4a61-b868-d8246941c105 admin admin] PATH_INFO: `/v3/projects/3b416c78c1b546b28d04999fae66aa05` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:24.906108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba53b6-f0cc-4a61-b868-d8246941c105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b416c78c1b546b28d04999fae66aa05)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:24.913253 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cba53b6-f0cc-4a61-b868-d8246941c105 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:25.042519 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19730e-8005-4a91-8d91-47cb011ab8bb None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:25.050966 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3cba53b6-f0cc-4a61-b868-d8246941c105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b416c78c1b546b28d04999fae66aa05', 'request_id': 'req-3cba53b6-f0cc-4a61-b868-d8246941c105'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:25.087502 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3cba53b6-f0cc-4a61-b868-d8246941c105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b416c78c1b546b28d04999fae66aa05', 'request_id': 'req-3cba53b6-f0cc-4a61-b868-d8246941c105'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:25.110452 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3cba53b6-f0cc-4a61-b868-d8246941c105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b416c78c1b546b28d04999fae66aa05', 'request_id': 'req-3cba53b6-f0cc-4a61-b868-d8246941c105'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:25.142291 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3cba53b6-f0cc-4a61-b868-d8246941c105 admin admin] The token cache is being invalidate because project 3b416c78c1b546b28d04999fae66aa05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:33:25.142624 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3cba53b6-f0cc-4a61-b868-d8246941c105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:25.145695 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3cba53b6-f0cc-4a61-b868-d8246941c105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:25.147671 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 857/1722] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:33:24 2022] DELETE /identity/v3/projects/3b416c78c1b546b28d04999fae66aa05 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:25.148459 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba53b6-f0cc-4a61-b868-d8246941c105 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:25.152857 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3cba53b6-f0cc-4a61-b868-d8246941c105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:25.238257 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538044f-5684-4690-bfb6-f6aa86ffc4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:25.239431 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538044f-5684-4690-bfb6-f6aa86ffc4ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:25.239796 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538044f-5684-4690-bfb6-f6aa86ffc4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:25.240174 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538044f-5684-4690-bfb6-f6aa86ffc4ad admin admin] PATH_INFO: `/v3/users/4d0a710953d849a4a0a669eee10590a7` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:25.248439 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538044f-5684-4690-bfb6-f6aa86ffc4ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d0a710953d849a4a0a669eee10590a7)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:25.250709 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538044f-5684-4690-bfb6-f6aa86ffc4ad admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:25.295737 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba53b6-f0cc-4a61-b868-d8246941c105 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:25.314831 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b3835-5d8a-47c8-bfec-9ba20582a68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:25.315734 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b3835-5d8a-47c8-bfec-9ba20582a68c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:25.316010 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b3835-5d8a-47c8-bfec-9ba20582a68c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:25.316284 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b3835-5d8a-47c8-bfec-9ba20582a68c admin admin] PATH_INFO: `/v3/users/3dce843c1f664ad896c8f5b9a59cf575` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:25.328435 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b3835-5d8a-47c8-bfec-9ba20582a68c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dce843c1f664ad896c8f5b9a59cf575)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:25.330470 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b3835-5d8a-47c8-bfec-9ba20582a68c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:25.356835 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c538044f-5684-4690-bfb6-f6aa86ffc4ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d0a710953d849a4a0a669eee10590a7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:25.387064 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c538044f-5684-4690-bfb6-f6aa86ffc4ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d0a710953d849a4a0a669eee10590a7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:25.453570 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c538044f-5684-4690-bfb6-f6aa86ffc4ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d0a710953d849a4a0a669eee10590a7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:25.456133 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c538044f-5684-4690-bfb6-f6aa86ffc4ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d0a710953d849a4a0a669eee10590a7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:25.457957 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c538044f-5684-4690-bfb6-f6aa86ffc4ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d0a710953d849a4a0a669eee10590a7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:25.514584 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 866/1723] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:33:24 2022] DELETE /identity/v3/users/4d0a710953d849a4a0a669eee10590a7 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:25.521399 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28ed4e-7280-4c0a-8cca-d1caf147e8e8 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:25.521692 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28ed4e-7280-4c0a-8cca-d1caf147e8e8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:25.522012 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28ed4e-7280-4c0a-8cca-d1caf147e8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:25.536389 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-563b3835-5d8a-47c8-bfec-9ba20582a68c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dce843c1f664ad896c8f5b9a59cf575'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:25.588629 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-3c28ed4e-7280-4c0a-8cca-d1caf147e8e8 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:25.592778 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3c28ed4e-7280-4c0a-8cca-d1caf147e8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:25.631289 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-563b3835-5d8a-47c8-bfec-9ba20582a68c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dce843c1f664ad896c8f5b9a59cf575'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:25.638994 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-563b3835-5d8a-47c8-bfec-9ba20582a68c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dce843c1f664ad896c8f5b9a59cf575'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:25.642364 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-563b3835-5d8a-47c8-bfec-9ba20582a68c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dce843c1f664ad896c8f5b9a59cf575'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:25.658041 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-563b3835-5d8a-47c8-bfec-9ba20582a68c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dce843c1f664ad896c8f5b9a59cf575'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:25.702561 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 867/1724] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:25.710593 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 858/1725] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:33:25 2022] DELETE /identity/v3/users/3dce843c1f664ad896c8f5b9a59cf575 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:25.715777 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62327f8c-0a39-452e-9379-13b098516a4a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:25.716102 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62327f8c-0a39-452e-9379-13b098516a4a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:25.716407 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62327f8c-0a39-452e-9379-13b098516a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:25.717160 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcf296-9451-44ac-8625-1d17c953f86d None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:25.717470 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcf296-9451-44ac-8625-1d17c953f86d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:25.717741 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcf296-9451-44ac-8625-1d17c953f86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:25.765924 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-87fcf296-9451-44ac-8625-1d17c953f86d None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:25.767080 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-87fcf296-9451-44ac-8625-1d17c953f86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:25.770966 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-62327f8c-0a39-452e-9379-13b098516a4a None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:25.772634 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-62327f8c-0a39-452e-9379-13b098516a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:26.004354 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 859/1726] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:26.007798 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb38951-6e9d-487b-aa9b-db070adfaf19 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:26.008136 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb38951-6e9d-487b-aa9b-db070adfaf19 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:26.008359 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb38951-6e9d-487b-aa9b-db070adfaf19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:26.011158 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 868/1727] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:26.015264 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62327f8c-0a39-452e-9379-13b098516a4a None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:26.051802 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62327f8c-0a39-452e-9379-13b098516a4a None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:26.062268 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe99162-d37a-48af-b588-59755a9a79bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:26.063073 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe99162-d37a-48af-b588-59755a9a79bc admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:26.063485 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe99162-d37a-48af-b588-59755a9a79bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:26.063891 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-1cb38951-6e9d-487b-aa9b-db070adfaf19 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:26.064026 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe99162-d37a-48af-b588-59755a9a79bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:26.064869 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe99162-d37a-48af-b588-59755a9a79bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:33:26.065287 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe99162-d37a-48af-b588-59755a9a79bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:26.067126 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe99162-d37a-48af-b588-59755a9a79bc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:26.070421 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-1cb38951-6e9d-487b-aa9b-db070adfaf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:26.099302 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 869/1728] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:33:26.100571 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe99162-d37a-48af-b588-59755a9a79bc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:26.109595 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-bfe99162-d37a-48af-b588-59755a9a79bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:26.116585 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 860/1729] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:26.121113 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb38951-6e9d-487b-aa9b-db070adfaf19 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:26.174252 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb38951-6e9d-487b-aa9b-db070adfaf19 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:26.223252 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675df4b2-8c93-47df-80f8-ed6f8822f51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:26.224261 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675df4b2-8c93-47df-80f8-ed6f8822f51a admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:26.224706 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675df4b2-8c93-47df-80f8-ed6f8822f51a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:26.225244 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675df4b2-8c93-47df-80f8-ed6f8822f51a admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:26.226106 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675df4b2-8c93-47df-80f8-ed6f8822f51a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:26.238176 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675df4b2-8c93-47df-80f8-ed6f8822f51a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:26.355275 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe99162-d37a-48af-b588-59755a9a79bc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:26.366239 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 861/1730] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:33:26 2022] POST /identity/v3/projects => generated 377 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:26.367456 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675df4b2-8c93-47df-80f8-ed6f8822f51a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:26.384910 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31ec02-3574-4748-94c7-74fb739bb47a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:26.386060 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31ec02-3574-4748-94c7-74fb739bb47a service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:26.386060 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31ec02-3574-4748-94c7-74fb739bb47a service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:26.386485 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31ec02-3574-4748-94c7-74fb739bb47a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:26.418519 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31ec02-3574-4748-94c7-74fb739bb47a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:26.425763 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31ec02-3574-4748-94c7-74fb739bb47a service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:26.472110 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 870/1731] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:26.476424 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31ec02-3574-4748-94c7-74fb739bb47a service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:26.538765 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31ec02-3574-4748-94c7-74fb739bb47a service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:26.595224 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675df4b2-8c93-47df-80f8-ed6f8822f51a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:26.615480 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0e3d7-2db5-442c-8bf6-c6e2bc23b697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:26.616346 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0e3d7-2db5-442c-8bf6-c6e2bc23b697 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:26.619110 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0e3d7-2db5-442c-8bf6-c6e2bc23b697 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:26.619408 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0e3d7-2db5-442c-8bf6-c6e2bc23b697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:26.754604 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a208c2e-807e-4e1f-a8ac-69cd02a1c561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:26.763182 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a208c2e-807e-4e1f-a8ac-69cd02a1c561 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:26.764336 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a208c2e-807e-4e1f-a8ac-69cd02a1c561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:26.764824 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a208c2e-807e-4e1f-a8ac-69cd02a1c561 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:26.766329 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a208c2e-807e-4e1f-a8ac-69cd02a1c561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:26.776006 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a208c2e-807e-4e1f-a8ac-69cd02a1c561 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:26.858701 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 871/1732] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:33:26 2022] POST /identity/v3/users => generated 289 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:26.873593 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a208c2e-807e-4e1f-a8ac-69cd02a1c561 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:26.878840 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8a208c2e-807e-4e1f-a8ac-69cd02a1c561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:26.937004 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0e3d7-2db5-442c-8bf6-c6e2bc23b697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:26.938514 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c0e3d7-2db5-442c-8bf6-c6e2bc23b697 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:27.008922 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 862/1733] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:27.018832 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0e3d7-2db5-442c-8bf6-c6e2bc23b697 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:27.058525 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c0e3d7-2db5-442c-8bf6-c6e2bc23b697 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:27.086754 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfd168-188e-4071-844a-92a8667d023d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:27.087611 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfd168-188e-4071-844a-92a8667d023d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:27.088081 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfd168-188e-4071-844a-92a8667d023d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:27.088365 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfd168-188e-4071-844a-92a8667d023d admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:27.089244 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfd168-188e-4071-844a-92a8667d023d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:27.093769 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfd168-188e-4071-844a-92a8667d023d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:27.104780 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a208c2e-807e-4e1f-a8ac-69cd02a1c561 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:27.120347 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516d208-07c8-4f49-96bb-9cc25e84844c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:27.121109 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516d208-07c8-4f49-96bb-9cc25e84844c service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:27.121486 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516d208-07c8-4f49-96bb-9cc25e84844c service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:27.121817 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 863/1734] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:27.121934 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9516d208-07c8-4f49-96bb-9cc25e84844c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:27.125724 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9516d208-07c8-4f49-96bb-9cc25e84844c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:27.126518 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfd168-188e-4071-844a-92a8667d023d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:27.142913 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfd168-188e-4071-844a-92a8667d023d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:27.154509 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a327bc-c589-41a5-802f-a7ececf35983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:27.157438 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a327bc-c589-41a5-802f-a7ececf35983 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:27.157849 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a327bc-c589-41a5-802f-a7ececf35983 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:27.158132 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a327bc-c589-41a5-802f-a7ececf35983 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:27.159567 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a327bc-c589-41a5-802f-a7ececf35983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:27.164934 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a327bc-c589-41a5-802f-a7ececf35983 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:27.197398 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 864/1735] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:27.199613 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a327bc-c589-41a5-802f-a7ececf35983 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:27.238255 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a327bc-c589-41a5-802f-a7ececf35983 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:27.245133 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ae396-dac8-46a1-ae4c-d7175bee5840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:27.247757 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ae396-dac8-46a1-ae4c-d7175bee5840 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:27.248425 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ae396-dac8-46a1-ae4c-d7175bee5840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:27.248848 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ae396-dac8-46a1-ae4c-d7175bee5840 admin admin] PATH_INFO: `/v3/projects/775bc73e70d64e63acd9a277aa9e2bcc/users/98e2edf749084c34a65d46a8834a0441/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:27.272156 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ae396-dac8-46a1-ae4c-d7175bee5840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=775bc73e70d64e63acd9a277aa9e2bcc, user_id=98e2edf749084c34a65d46a8834a0441, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:27.274899 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ae396-dac8-46a1-ae4c-d7175bee5840 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:27.314276 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 865/1736] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:27 2022] PUT /identity/v3/projects/775bc73e70d64e63acd9a277aa9e2bcc/users/98e2edf749084c34a65d46a8834a0441/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:27.321960 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516d208-07c8-4f49-96bb-9cc25e84844c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:27.323452 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9516d208-07c8-4f49-96bb-9cc25e84844c service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:27.328622 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab67f35-dbc3-4765-9fc5-79118d8b0c1d None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:27.329181 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab67f35-dbc3-4765-9fc5-79118d8b0c1d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:27.329583 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab67f35-dbc3-4765-9fc5-79118d8b0c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:27.357303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 872/1737] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:27.396434 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-2ab67f35-dbc3-4765-9fc5-79118d8b0c1d None None] MFA Rules not processed for user `98e2edf749084c34a65d46a8834a0441`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:27.397784 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2ab67f35-dbc3-4765-9fc5-79118d8b0c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:27.523709 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516d208-07c8-4f49-96bb-9cc25e84844c service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:27.525710 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9516d208-07c8-4f49-96bb-9cc25e84844c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:27.553939 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 866/1738] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:33:27.556154 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab67f35-dbc3-4765-9fc5-79118d8b0c1d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:27.566097 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9516d208-07c8-4f49-96bb-9cc25e84844c service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:27.693839 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38d323-33bf-4757-8b8e-ff601295ccde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:27.696694 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38d323-33bf-4757-8b8e-ff601295ccde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:27.696694 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38d323-33bf-4757-8b8e-ff601295ccde admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:27.696694 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38d323-33bf-4757-8b8e-ff601295ccde admin admin] PATH_INFO: `/v3/projects/752eedd6d9ca4080810f0ad4caaf541f` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:27.697586 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38d323-33bf-4757-8b8e-ff601295ccde admin admin] RBAC: Authorizing `identity:delete_project(project_id=752eedd6d9ca4080810f0ad4caaf541f)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:27.704274 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38d323-33bf-4757-8b8e-ff601295ccde admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:27.775617 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab67f35-dbc3-4765-9fc5-79118d8b0c1d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:27.791607 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9356a-0284-4760-bcba-4f1cbbe9d1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:27.792007 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9356a-0284-4760-bcba-4f1cbbe9d1ab admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:27.792314 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9356a-0284-4760-bcba-4f1cbbe9d1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:27.792621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9356a-0284-4760-bcba-4f1cbbe9d1ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:27.793874 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9356a-0284-4760-bcba-4f1cbbe9d1ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:27.796929 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9356a-0284-4760-bcba-4f1cbbe9d1ab admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:27.829037 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-af38d323-33bf-4757-8b8e-ff601295ccde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '752eedd6d9ca4080810f0ad4caaf541f', 'request_id': 'req-af38d323-33bf-4757-8b8e-ff601295ccde'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:27.835264 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 867/1739] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:33:27 2022] POST /identity/v3/projects => generated 375 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:33:27.838895 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9356a-0284-4760-bcba-4f1cbbe9d1ab admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:27.840807 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-85b9356a-0284-4760-bcba-4f1cbbe9d1ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:27.850569 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-af38d323-33bf-4757-8b8e-ff601295ccde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '752eedd6d9ca4080810f0ad4caaf541f', 'request_id': 'req-af38d323-33bf-4757-8b8e-ff601295ccde'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:27.863465 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-af38d323-33bf-4757-8b8e-ff601295ccde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '752eedd6d9ca4080810f0ad4caaf541f', 'request_id': 'req-af38d323-33bf-4757-8b8e-ff601295ccde'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:27.889518 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-af38d323-33bf-4757-8b8e-ff601295ccde admin admin] The token cache is being invalidate because project 752eedd6d9ca4080810f0ad4caaf541f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:33:27.889820 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-af38d323-33bf-4757-8b8e-ff601295ccde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:27.891269 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-af38d323-33bf-4757-8b8e-ff601295ccde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:27.904133 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 873/1740] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:33:27 2022] DELETE /identity/v3/projects/752eedd6d9ca4080810f0ad4caaf541f => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:27.907630 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38d323-33bf-4757-8b8e-ff601295ccde admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:27.910332 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-af38d323-33bf-4757-8b8e-ff601295ccde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:28.084494 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9356a-0284-4760-bcba-4f1cbbe9d1ab admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:28.090006 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38d323-33bf-4757-8b8e-ff601295ccde admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:28.099960 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d93ec-df08-44f8-a916-303c37165211 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:28.100637 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d93ec-df08-44f8-a916-303c37165211 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:28.100917 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d93ec-df08-44f8-a916-303c37165211 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:28.101191 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d93ec-df08-44f8-a916-303c37165211 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:28.104247 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0a3d93ec-df08-44f8-a916-303c37165211 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:28.133153 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d93ec-df08-44f8-a916-303c37165211 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:28.140212 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d93ec-df08-44f8-a916-303c37165211 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:28.177526 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 868/1741] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:28.178498 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d93ec-df08-44f8-a916-303c37165211 service nova] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:28.184473 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0a3d93ec-df08-44f8-a916-303c37165211 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:28.224954 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144234f-7d75-47bf-980b-4fe4729a370f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:28.225736 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144234f-7d75-47bf-980b-4fe4729a370f admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:28.226038 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144234f-7d75-47bf-980b-4fe4729a370f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:28.226586 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144234f-7d75-47bf-980b-4fe4729a370f admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:28.226983 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144234f-7d75-47bf-980b-4fe4729a370f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:28.229883 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144234f-7d75-47bf-980b-4fe4729a370f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:28.275435 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 874/1742] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:33:27 2022] POST /identity/v3/users => generated 294 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:28.279709 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144234f-7d75-47bf-980b-4fe4729a370f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:28.298028 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b144234f-7d75-47bf-980b-4fe4729a370f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:28.331082 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144234f-7d75-47bf-980b-4fe4729a370f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:28.350008 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b8913-f012-4452-afed-db472426b3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:28.351698 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b8913-f012-4452-afed-db472426b3cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:28.352193 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b8913-f012-4452-afed-db472426b3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:28.353309 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b8913-f012-4452-afed-db472426b3cc admin admin] PATH_INFO: `/v3/projects/925dd6ab1be14fdfb407c04dc635844f` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:28.354855 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b8913-f012-4452-afed-db472426b3cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=925dd6ab1be14fdfb407c04dc635844f)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:28.357037 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b8913-f012-4452-afed-db472426b3cc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:28.415760 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d93ec-df08-44f8-a916-303c37165211 service nova] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:28.423574 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a4012-7364-4a64-9f8d-3f8da1ef5f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:28.424470 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a4012-7364-4a64-9f8d-3f8da1ef5f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:28.424697 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a4012-7364-4a64-9f8d-3f8da1ef5f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:28.424977 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a4012-7364-4a64-9f8d-3f8da1ef5f0f admin admin] PATH_INFO: `/v3/users/84d601ee25d342e1b8db67caae7bf55c` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:28.426501 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a4012-7364-4a64-9f8d-3f8da1ef5f0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=84d601ee25d342e1b8db67caae7bf55c)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:28.428648 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a4012-7364-4a64-9f8d-3f8da1ef5f0f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:28.539237 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3c3a4012-7364-4a64-9f8d-3f8da1ef5f0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84d601ee25d342e1b8db67caae7bf55c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:28.544211 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-100b8913-f012-4452-afed-db472426b3cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '925dd6ab1be14fdfb407c04dc635844f', 'request_id': 'req-100b8913-f012-4452-afed-db472426b3cc'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:28.566517 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3c3a4012-7364-4a64-9f8d-3f8da1ef5f0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84d601ee25d342e1b8db67caae7bf55c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:28.567783 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3c3a4012-7364-4a64-9f8d-3f8da1ef5f0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84d601ee25d342e1b8db67caae7bf55c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:28.568460 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3c3a4012-7364-4a64-9f8d-3f8da1ef5f0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84d601ee25d342e1b8db67caae7bf55c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:28.584067 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-100b8913-f012-4452-afed-db472426b3cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '925dd6ab1be14fdfb407c04dc635844f', 'request_id': 'req-100b8913-f012-4452-afed-db472426b3cc'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:28.588413 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3c3a4012-7364-4a64-9f8d-3f8da1ef5f0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84d601ee25d342e1b8db67caae7bf55c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:28.595670 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-100b8913-f012-4452-afed-db472426b3cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '925dd6ab1be14fdfb407c04dc635844f', 'request_id': 'req-100b8913-f012-4452-afed-db472426b3cc'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:28.614496 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-100b8913-f012-4452-afed-db472426b3cc admin admin] The token cache is being invalidate because project 925dd6ab1be14fdfb407c04dc635844f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:33:28.614786 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-100b8913-f012-4452-afed-db472426b3cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:28.615432 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 869/1743] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:33:28 2022] DELETE /identity/v3/users/84d601ee25d342e1b8db67caae7bf55c => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:28.616459 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a4012-7364-4a64-9f8d-3f8da1ef5f0f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:28.618870 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-100b8913-f012-4452-afed-db472426b3cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:28.619520 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3c3a4012-7364-4a64-9f8d-3f8da1ef5f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:28.620955 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 875/1744] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:33:28 2022] DELETE /identity/v3/projects/925dd6ab1be14fdfb407c04dc635844f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:28.622263 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c45a05-3679-4d76-91a9-6c28df90dc6b None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:28.623098 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c45a05-3679-4d76-91a9-6c28df90dc6b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:28.623371 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c45a05-3679-4d76-91a9-6c28df90dc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:28.646057 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-48c45a05-3679-4d76-91a9-6c28df90dc6b None None] MFA Rules not processed for user `e83de12959394ba5a75f5881741540a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:28.647284 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-48c45a05-3679-4d76-91a9-6c28df90dc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:28.745053 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 876/1745] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:28.776143 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c45a05-3679-4d76-91a9-6c28df90dc6b None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:28.787295 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-48c45a05-3679-4d76-91a9-6c28df90dc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:28.787715 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a4012-7364-4a64-9f8d-3f8da1ef5f0f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:28.803754 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf9367-b40e-4d9f-9066-699a4c9aa19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:28.804461 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf9367-b40e-4d9f-9066-699a4c9aa19b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:28.804739 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf9367-b40e-4d9f-9066-699a4c9aa19b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:28.805009 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf9367-b40e-4d9f-9066-699a4c9aa19b admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:28.805813 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf9367-b40e-4d9f-9066-699a4c9aa19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:28.807452 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf9367-b40e-4d9f-9066-699a4c9aa19b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:28.854371 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 870/1746] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:28.855509 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf9367-b40e-4d9f-9066-699a4c9aa19b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:28.861779 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-1bcf9367-b40e-4d9f-9066-699a4c9aa19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:28.878890 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c45a05-3679-4d76-91a9-6c28df90dc6b None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:28.897882 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf9367-b40e-4d9f-9066-699a4c9aa19b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:28.899909 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df85c7e-0b6a-43a8-8f8e-69db9babac84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:28.901684 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df85c7e-0b6a-43a8-8f8e-69db9babac84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:28.906435 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df85c7e-0b6a-43a8-8f8e-69db9babac84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:28.907308 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df85c7e-0b6a-43a8-8f8e-69db9babac84 admin admin] PATH_INFO: `/v3/users/4dfda98906424b5d9fd8c035ec2d1391` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:28.912125 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df85c7e-0b6a-43a8-8f8e-69db9babac84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dfda98906424b5d9fd8c035ec2d1391)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:28.915291 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df85c7e-0b6a-43a8-8f8e-69db9babac84 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:28.917160 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb67f8-ab42-4371-86c0-feef4faa3e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:28.918115 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb67f8-ab42-4371-86c0-feef4faa3e11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:28.918461 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb67f8-ab42-4371-86c0-feef4faa3e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:28.918737 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb67f8-ab42-4371-86c0-feef4faa3e11 admin admin] PATH_INFO: `/v3/projects/e464e39705274f559ac550b0bb42301d/users/b32b3ff130184b4d87a9e7eed1225f96/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:28.975510 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb67f8-ab42-4371-86c0-feef4faa3e11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e464e39705274f559ac550b0bb42301d, user_id=b32b3ff130184b4d87a9e7eed1225f96, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:28.986250 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb67f8-ab42-4371-86c0-feef4faa3e11 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:29.002823 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4df85c7e-0b6a-43a8-8f8e-69db9babac84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dfda98906424b5d9fd8c035ec2d1391'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:29.015290 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 871/1747] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:28 2022] PUT /identity/v3/projects/e464e39705274f559ac550b0bb42301d/users/b32b3ff130184b4d87a9e7eed1225f96/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:29.020127 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb67f8-ab42-4371-86c0-feef4faa3e11 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:29.029131 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4df85c7e-0b6a-43a8-8f8e-69db9babac84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dfda98906424b5d9fd8c035ec2d1391'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:29.053118 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4df85c7e-0b6a-43a8-8f8e-69db9babac84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dfda98906424b5d9fd8c035ec2d1391'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:29.053980 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4df85c7e-0b6a-43a8-8f8e-69db9babac84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dfda98906424b5d9fd8c035ec2d1391'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:29.054590 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4df85c7e-0b6a-43a8-8f8e-69db9babac84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dfda98906424b5d9fd8c035ec2d1391'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:29.071315 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 877/1748] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:33:28 2022] DELETE /identity/v3/users/4dfda98906424b5d9fd8c035ec2d1391 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:29.126725 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb67f8-ab42-4371-86c0-feef4faa3e11 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:29.218495 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcefb11-8c52-43b4-be17-277cf6c352c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:29.219235 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcefb11-8c52-43b4-be17-277cf6c352c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:29.219702 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcefb11-8c52-43b4-be17-277cf6c352c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:29.219804 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcefb11-8c52-43b4-be17-277cf6c352c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:29.220519 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcefb11-8c52-43b4-be17-277cf6c352c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:29.222794 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcefb11-8c52-43b4-be17-277cf6c352c8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:29.239166 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 872/1749] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:29.241486 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df85c7e-0b6a-43a8-8f8e-69db9babac84 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:29.243422 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4df85c7e-0b6a-43a8-8f8e-69db9babac84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:29.260919 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df85c7e-0b6a-43a8-8f8e-69db9babac84 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:29.266867 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd693f-3cb7-43ca-a3a3-65809c6539d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:29.267974 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd693f-3cb7-43ca-a3a3-65809c6539d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:29.268781 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd693f-3cb7-43ca-a3a3-65809c6539d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:29.269040 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd693f-3cb7-43ca-a3a3-65809c6539d3 admin admin] PATH_INFO: `/v3/projects/e464e39705274f559ac550b0bb42301d/users/b32b3ff130184b4d87a9e7eed1225f96/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:29.271514 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd693f-3cb7-43ca-a3a3-65809c6539d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e464e39705274f559ac550b0bb42301d, user_id=b32b3ff130184b4d87a9e7eed1225f96, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:29.291934 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd693f-3cb7-43ca-a3a3-65809c6539d3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:29.328079 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 878/1750] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:29 2022] PUT /identity/v3/projects/e464e39705274f559ac550b0bb42301d/users/b32b3ff130184b4d87a9e7eed1225f96/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:29.333386 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e671897-d713-41cb-b30a-178ee1325359 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:29.333766 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e671897-d713-41cb-b30a-178ee1325359 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:29.334116 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e671897-d713-41cb-b30a-178ee1325359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:29.374943 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-9e671897-d713-41cb-b30a-178ee1325359 None None] MFA Rules not processed for user `b32b3ff130184b4d87a9e7eed1225f96`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:29.376500 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9e671897-d713-41cb-b30a-178ee1325359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:29.530131 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 873/1751] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:29.540451 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd693f-3cb7-43ca-a3a3-65809c6539d3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:29.542204 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-44fd693f-3cb7-43ca-a3a3-65809c6539d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:29.654402 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd693f-3cb7-43ca-a3a3-65809c6539d3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:29.663683 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74687b1-7fa9-4146-a404-62016d3033ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:29.664448 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74687b1-7fa9-4146-a404-62016d3033ed service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:29.664626 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74687b1-7fa9-4146-a404-62016d3033ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:29.666876 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74687b1-7fa9-4146-a404-62016d3033ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:29.671856 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f74687b1-7fa9-4146-a404-62016d3033ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:29.806299 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74687b1-7fa9-4146-a404-62016d3033ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:29.807821 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74687b1-7fa9-4146-a404-62016d3033ed service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:29.842500 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 879/1752] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:29.855916 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e671897-d713-41cb-b30a-178ee1325359 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:29.857435 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9e671897-d713-41cb-b30a-178ee1325359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:30.004515 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e671897-d713-41cb-b30a-178ee1325359 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:30.015531 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b8566-6c8b-46dd-947d-ed34a524d5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:30.018800 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b8566-6c8b-46dd-947d-ed34a524d5a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:30.019255 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b8566-6c8b-46dd-947d-ed34a524d5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:30.019671 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b8566-6c8b-46dd-947d-ed34a524d5a5 admin admin] PATH_INFO: `/v3/projects/3b963ec7bb8d4cf9a3a08e84cd24dcc8` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:30.022756 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b8566-6c8b-46dd-947d-ed34a524d5a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b963ec7bb8d4cf9a3a08e84cd24dcc8)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:30.026748 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b8566-6c8b-46dd-947d-ed34a524d5a5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:30.133737 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5d9b8566-6c8b-46dd-947d-ed34a524d5a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b963ec7bb8d4cf9a3a08e84cd24dcc8', 'request_id': 'req-5d9b8566-6c8b-46dd-947d-ed34a524d5a5'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:30.159245 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5d9b8566-6c8b-46dd-947d-ed34a524d5a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b963ec7bb8d4cf9a3a08e84cd24dcc8', 'request_id': 'req-5d9b8566-6c8b-46dd-947d-ed34a524d5a5'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:30.175168 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5d9b8566-6c8b-46dd-947d-ed34a524d5a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b963ec7bb8d4cf9a3a08e84cd24dcc8', 'request_id': 'req-5d9b8566-6c8b-46dd-947d-ed34a524d5a5'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:30.194412 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5d9b8566-6c8b-46dd-947d-ed34a524d5a5 admin admin] The token cache is being invalidate because project 3b963ec7bb8d4cf9a3a08e84cd24dcc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:33:30.196042 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5d9b8566-6c8b-46dd-947d-ed34a524d5a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:30.197022 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5d9b8566-6c8b-46dd-947d-ed34a524d5a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:30.198927 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 874/1753] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:33:29 2022] DELETE /identity/v3/projects/3b963ec7bb8d4cf9a3a08e84cd24dcc8 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:33:30.204633 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fe53a-b631-4c37-b9f9-68d8b0d47488 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:30.205455 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fe53a-b631-4c37-b9f9-68d8b0d47488 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:30.205939 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fe53a-b631-4c37-b9f9-68d8b0d47488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:30.257357 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d51fe53a-b631-4c37-b9f9-68d8b0d47488 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:30.262240 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d51fe53a-b631-4c37-b9f9-68d8b0d47488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:30.457074 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 880/1754] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:33:30.457677 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca632779-4220-45b0-9c9b-bd1bfdfbcd21 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:30.458213 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca632779-4220-45b0-9c9b-bd1bfdfbcd21 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:30.458563 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca632779-4220-45b0-9c9b-bd1bfdfbcd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:30.511794 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ca632779-4220-45b0-9c9b-bd1bfdfbcd21 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:30.513474 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ca632779-4220-45b0-9c9b-bd1bfdfbcd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:30.525139 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 875/1755] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:30.531073 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fe53a-b631-4c37-b9f9-68d8b0d47488 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:30.553904 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fe53a-b631-4c37-b9f9-68d8b0d47488 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:30.562764 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7d0af-0815-43ff-b4b9-d0ad25d1fc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:30.564159 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7d0af-0815-43ff-b4b9-d0ad25d1fc02 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:30.565047 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7d0af-0815-43ff-b4b9-d0ad25d1fc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:30.565346 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7d0af-0815-43ff-b4b9-d0ad25d1fc02 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:30.566183 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7d0af-0815-43ff-b4b9-d0ad25d1fc02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:33:30.566486 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7d0af-0815-43ff-b4b9-d0ad25d1fc02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:30.581769 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7d0af-0815-43ff-b4b9-d0ad25d1fc02 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:30.600160 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 881/1756] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:33:30.605521 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca632779-4220-45b0-9c9b-bd1bfdfbcd21 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:30.621767 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca632779-4220-45b0-9c9b-bd1bfdfbcd21 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:30.631853 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00659037-10f9-4d99-9403-b033e0ef32b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:30.634151 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00659037-10f9-4d99-9403-b033e0ef32b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:30.634436 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00659037-10f9-4d99-9403-b033e0ef32b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:30.636373 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00659037-10f9-4d99-9403-b033e0ef32b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:30.639249 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00659037-10f9-4d99-9403-b033e0ef32b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:30.643219 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00659037-10f9-4d99-9403-b033e0ef32b4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:30.698991 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 876/1757] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:33:30 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:30.703523 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7d0af-0815-43ff-b4b9-d0ad25d1fc02 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:30.725019 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7d0af-0815-43ff-b4b9-d0ad25d1fc02 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:30.833887 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29a5c3-30f4-4853-847a-6f441dc7b5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:30.834787 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29a5c3-30f4-4853-847a-6f441dc7b5b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:30.834923 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29a5c3-30f4-4853-847a-6f441dc7b5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:30.835204 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29a5c3-30f4-4853-847a-6f441dc7b5b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:30.835921 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29a5c3-30f4-4853-847a-6f441dc7b5b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:30.838966 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29a5c3-30f4-4853-847a-6f441dc7b5b5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:30.872803 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 882/1758] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:33:30 2022] POST /identity/v3/users => generated 294 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:33:30.878059 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00659037-10f9-4d99-9403-b033e0ef32b4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:30.902855 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00659037-10f9-4d99-9403-b033e0ef32b4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:30.911817 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675f4fb-e550-42c9-9fe2-1335ac15ff72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:30.912702 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675f4fb-e550-42c9-9fe2-1335ac15ff72 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:30.913155 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675f4fb-e550-42c9-9fe2-1335ac15ff72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:30.914065 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675f4fb-e550-42c9-9fe2-1335ac15ff72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:30.915249 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675f4fb-e550-42c9-9fe2-1335ac15ff72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:30.917818 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675f4fb-e550-42c9-9fe2-1335ac15ff72 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:30.936641 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 877/1759] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:30.940331 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29a5c3-30f4-4853-847a-6f441dc7b5b5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:30.957946 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29a5c3-30f4-4853-847a-6f441dc7b5b5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:30.971622 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46ae27-1c80-43a4-9e12-992724b4cc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:30.972549 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46ae27-1c80-43a4-9e12-992724b4cc76 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:30.973167 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46ae27-1c80-43a4-9e12-992724b4cc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:30.974133 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46ae27-1c80-43a4-9e12-992724b4cc76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:30.975035 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46ae27-1c80-43a4-9e12-992724b4cc76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:30.978064 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46ae27-1c80-43a4-9e12-992724b4cc76 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:31.007674 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675f4fb-e550-42c9-9fe2-1335ac15ff72 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:31.015100 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 883/1760] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:31.020942 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675f4fb-e550-42c9-9fe2-1335ac15ff72 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:31.031316 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045d7a4-b7be-4e55-b3b6-75eeb24450a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:31.032403 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045d7a4-b7be-4e55-b3b6-75eeb24450a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:31.032828 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045d7a4-b7be-4e55-b3b6-75eeb24450a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:31.033240 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045d7a4-b7be-4e55-b3b6-75eeb24450a4 admin admin] PATH_INFO: `/v3/projects/040122fb905a4f89a6da69ae7fdc10d9/users/27bdd547827148ff98bd05d997293b34/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:31.053580 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045d7a4-b7be-4e55-b3b6-75eeb24450a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=040122fb905a4f89a6da69ae7fdc10d9, user_id=27bdd547827148ff98bd05d997293b34, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:31.057488 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045d7a4-b7be-4e55-b3b6-75eeb24450a4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:31.096734 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 878/1761] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:31 2022] PUT /identity/v3/projects/040122fb905a4f89a6da69ae7fdc10d9/users/27bdd547827148ff98bd05d997293b34/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:31.099019 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9af191-b9f6-4dbd-990c-a529a1be5cf3 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:31.099314 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9af191-b9f6-4dbd-990c-a529a1be5cf3 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:31.099615 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9af191-b9f6-4dbd-990c-a529a1be5cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:31.173084 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045d7a4-b7be-4e55-b3b6-75eeb24450a4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:31.175719 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f045d7a4-b7be-4e55-b3b6-75eeb24450a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:31.193086 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-fe9af191-b9f6-4dbd-990c-a529a1be5cf3 None None] MFA Rules not processed for user `27bdd547827148ff98bd05d997293b34`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:31.196523 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-fe9af191-b9f6-4dbd-990c-a529a1be5cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:31.313378 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045d7a4-b7be-4e55-b3b6-75eeb24450a4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:31.327532 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eb6dc1-6783-459c-8f6e-ba7515970088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:31.328464 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb6dc1-6783-459c-8f6e-ba7515970088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:31.328739 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb6dc1-6783-459c-8f6e-ba7515970088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:31.329164 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eb6dc1-6783-459c-8f6e-ba7515970088 admin admin] PATH_INFO: `/v3/projects/13d7c90e99184ed19b34a1c4e6c50f8a` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:31.331107 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb6dc1-6783-459c-8f6e-ba7515970088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d7c90e99184ed19b34a1c4e6c50f8a)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:31.333451 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eb6dc1-6783-459c-8f6e-ba7515970088 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:31.362929 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 884/1762] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:31.366403 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9af191-b9f6-4dbd-990c-a529a1be5cf3 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:31.384134 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9af191-b9f6-4dbd-990c-a529a1be5cf3 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:31.393976 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab946fb-43b5-4b70-94f0-6045d021422c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:31.413625 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab946fb-43b5-4b70-94f0-6045d021422c admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:31.414188 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab946fb-43b5-4b70-94f0-6045d021422c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:31.415610 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab946fb-43b5-4b70-94f0-6045d021422c admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:31.416533 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab946fb-43b5-4b70-94f0-6045d021422c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:31.420334 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-85eb6dc1-6783-459c-8f6e-ba7515970088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d7c90e99184ed19b34a1c4e6c50f8a', 'request_id': 'req-85eb6dc1-6783-459c-8f6e-ba7515970088'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:31.423578 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab946fb-43b5-4b70-94f0-6045d021422c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:31.446763 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-85eb6dc1-6783-459c-8f6e-ba7515970088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d7c90e99184ed19b34a1c4e6c50f8a', 'request_id': 'req-85eb6dc1-6783-459c-8f6e-ba7515970088'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:31.472350 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-85eb6dc1-6783-459c-8f6e-ba7515970088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d7c90e99184ed19b34a1c4e6c50f8a', 'request_id': 'req-85eb6dc1-6783-459c-8f6e-ba7515970088'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:31.504816 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 885/1763] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:33:31 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:31.506978 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-85eb6dc1-6783-459c-8f6e-ba7515970088 admin admin] The token cache is being invalidate because project 13d7c90e99184ed19b34a1c4e6c50f8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:33:31.507680 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-85eb6dc1-6783-459c-8f6e-ba7515970088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:31.508382 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab946fb-43b5-4b70-94f0-6045d021422c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:31.508790 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-85eb6dc1-6783-459c-8f6e-ba7515970088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:31.510097 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-fab946fb-43b5-4b70-94f0-6045d021422c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:31.511909 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 879/1764] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:33:31 2022] DELETE /identity/v3/projects/13d7c90e99184ed19b34a1c4e6c50f8a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:33:31.517365 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a58844-9b07-4bc4-af06-a700c996d1ba None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:31.518436 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a58844-9b07-4bc4-af06-a700c996d1ba None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:31.519856 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a58844-9b07-4bc4-af06-a700c996d1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:31.555002 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c7a58844-9b07-4bc4-af06-a700c996d1ba None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:31.556732 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c7a58844-9b07-4bc4-af06-a700c996d1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:31.670728 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 880/1765] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:31.673242 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabc846-deb0-41cd-b8fc-4d98b760f56e None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:31.673677 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabc846-deb0-41cd-b8fc-4d98b760f56e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:31.674144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabc846-deb0-41cd-b8fc-4d98b760f56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:31.705644 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ddabc846-deb0-41cd-b8fc-4d98b760f56e None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:31.707270 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ddabc846-deb0-41cd-b8fc-4d98b760f56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:31.750561 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 881/1766] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:31.764791 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabc846-deb0-41cd-b8fc-4d98b760f56e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:31.807447 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabc846-deb0-41cd-b8fc-4d98b760f56e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:31.823354 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066b0d6-589c-4ad9-90ea-85642f88765d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:31.824301 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066b0d6-589c-4ad9-90ea-85642f88765d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:31.824691 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066b0d6-589c-4ad9-90ea-85642f88765d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:31.825074 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066b0d6-589c-4ad9-90ea-85642f88765d admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:31.829900 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066b0d6-589c-4ad9-90ea-85642f88765d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:33:31.829900 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066b0d6-589c-4ad9-90ea-85642f88765d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:31.830263 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066b0d6-589c-4ad9-90ea-85642f88765d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:31.841829 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab946fb-43b5-4b70-94f0-6045d021422c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:31.862905 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 882/1767] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:33:31.865824 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066b0d6-589c-4ad9-90ea-85642f88765d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:31.882074 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07a2c1-fcaa-4d7d-8684-36dfa8160dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:31.882779 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07a2c1-fcaa-4d7d-8684-36dfa8160dfc admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:31.883066 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07a2c1-fcaa-4d7d-8684-36dfa8160dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:31.883351 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07a2c1-fcaa-4d7d-8684-36dfa8160dfc admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:31.884055 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07a2c1-fcaa-4d7d-8684-36dfa8160dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:31.886998 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066b0d6-589c-4ad9-90ea-85642f88765d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:31.904085 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07a2c1-fcaa-4d7d-8684-36dfa8160dfc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:31.910858 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b85f9b-f7c1-4e74-aeba-c3d7fec65e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:31.911761 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b85f9b-f7c1-4e74-aeba-c3d7fec65e4e admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:31.912768 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b85f9b-f7c1-4e74-aeba-c3d7fec65e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:31.913193 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b85f9b-f7c1-4e74-aeba-c3d7fec65e4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:31.918705 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b85f9b-f7c1-4e74-aeba-c3d7fec65e4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:31.924800 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b85f9b-f7c1-4e74-aeba-c3d7fec65e4e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:31.967733 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 886/1768] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:33:31 2022] POST /identity/v3/users => generated 294 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:33:31.973372 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07a2c1-fcaa-4d7d-8684-36dfa8160dfc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:31.999336 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07a2c1-fcaa-4d7d-8684-36dfa8160dfc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:32.005197 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf637ed0-a2ab-4a13-8a7c-3208293d3cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:32.005945 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf637ed0-a2ab-4a13-8a7c-3208293d3cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:32.006328 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf637ed0-a2ab-4a13-8a7c-3208293d3cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:32.006605 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf637ed0-a2ab-4a13-8a7c-3208293d3cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:32.006823 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 883/1769] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:33:31 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:33:32.011677 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf637ed0-a2ab-4a13-8a7c-3208293d3cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:32.011677 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf637ed0-a2ab-4a13-8a7c-3208293d3cd2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:32.011963 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b85f9b-f7c1-4e74-aeba-c3d7fec65e4e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:32.039871 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 887/1770] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:32.041017 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf637ed0-a2ab-4a13-8a7c-3208293d3cd2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:32.062853 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf637ed0-a2ab-4a13-8a7c-3208293d3cd2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:32.124043 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b85f9b-f7c1-4e74-aeba-c3d7fec65e4e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:32.129302 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4a942-890c-436b-ad83-6b7291c3770b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:32.130159 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4a942-890c-436b-ad83-6b7291c3770b admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:32.130606 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4a942-890c-436b-ad83-6b7291c3770b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:32.131033 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4a942-890c-436b-ad83-6b7291c3770b admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:32.131885 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4a942-890c-436b-ad83-6b7291c3770b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:32.134174 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4a942-890c-436b-ad83-6b7291c3770b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:32.182173 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 884/1771] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:33:32 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:32.188128 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4a942-890c-436b-ad83-6b7291c3770b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:32.220493 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4a942-890c-436b-ad83-6b7291c3770b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:32.223546 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b1502-4ef4-4fe9-8510-3281be33e7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:32.225099 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b1502-4ef4-4fe9-8510-3281be33e7d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:32.225238 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b1502-4ef4-4fe9-8510-3281be33e7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:32.225960 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b1502-4ef4-4fe9-8510-3281be33e7d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:32.228020 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b1502-4ef4-4fe9-8510-3281be33e7d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:32.230226 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b1502-4ef4-4fe9-8510-3281be33e7d3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:32.234197 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396b451-1a5d-4f08-9695-f72ae5ded6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:32.235018 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396b451-1a5d-4f08-9695-f72ae5ded6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:32.235444 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396b451-1a5d-4f08-9695-f72ae5ded6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:32.236130 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396b451-1a5d-4f08-9695-f72ae5ded6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:32.236744 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396b451-1a5d-4f08-9695-f72ae5ded6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:32.238671 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396b451-1a5d-4f08-9695-f72ae5ded6b7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:32.257957 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 888/1772] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:32.262040 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b1502-4ef4-4fe9-8510-3281be33e7d3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:32.271700 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 885/1773] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:32.276161 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396b451-1a5d-4f08-9695-f72ae5ded6b7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:32.276804 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b1502-4ef4-4fe9-8510-3281be33e7d3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:32.288886 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b55ec-cf47-42d7-9973-37091383cdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:32.290699 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b55ec-cf47-42d7-9973-37091383cdc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:32.291458 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b55ec-cf47-42d7-9973-37091383cdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:32.291644 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b55ec-cf47-42d7-9973-37091383cdc2 admin admin] PATH_INFO: `/v3/projects/06bed1100555450aaba0bf776af9abec/users/9895dd191db14edd8b20324deb90ec3f/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:32.297788 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396b451-1a5d-4f08-9695-f72ae5ded6b7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:32.311241 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e526b-36b8-42bd-bdaa-edf6ba395c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:32.312098 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e526b-36b8-42bd-bdaa-edf6ba395c8c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:32.312488 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e526b-36b8-42bd-bdaa-edf6ba395c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:32.314273 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e526b-36b8-42bd-bdaa-edf6ba395c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:32.315216 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e526b-36b8-42bd-bdaa-edf6ba395c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:32.319302 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e526b-36b8-42bd-bdaa-edf6ba395c8c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:32.327725 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b55ec-cf47-42d7-9973-37091383cdc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06bed1100555450aaba0bf776af9abec, user_id=9895dd191db14edd8b20324deb90ec3f, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:32.332561 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b55ec-cf47-42d7-9973-37091383cdc2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:32.343035 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 886/1774] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:33:32.348451 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e526b-36b8-42bd-bdaa-edf6ba395c8c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:32.360764 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 889/1775] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:32 2022] PUT /identity/v3/projects/06bed1100555450aaba0bf776af9abec/users/9895dd191db14edd8b20324deb90ec3f/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:33:32.369955 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e526b-36b8-42bd-bdaa-edf6ba395c8c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:32.373157 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4645ca3-8694-44d4-badd-4fff74512653 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:32.375160 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4645ca3-8694-44d4-badd-4fff74512653 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:32.375726 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4645ca3-8694-44d4-badd-4fff74512653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:32.440801 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d4645ca3-8694-44d4-badd-4fff74512653 None None] MFA Rules not processed for user `9895dd191db14edd8b20324deb90ec3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:32.443223 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac72b6-2ea6-45ee-9556-318fbacaa3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:32.444481 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac72b6-2ea6-45ee-9556-318fbacaa3c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:32.444767 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac72b6-2ea6-45ee-9556-318fbacaa3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:32.445285 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac72b6-2ea6-45ee-9556-318fbacaa3c9 admin admin] PATH_INFO: `/v3/projects/23ed10f97ee6425d95390b8aff623d10/users/97c902509f864b1084201721e55f1bc6/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:32.445399 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d4645ca3-8694-44d4-badd-4fff74512653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:32.467654 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac72b6-2ea6-45ee-9556-318fbacaa3c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ed10f97ee6425d95390b8aff623d10, user_id=97c902509f864b1084201721e55f1bc6, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:32.470881 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac72b6-2ea6-45ee-9556-318fbacaa3c9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:32.491065 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 887/1776] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:32 2022] PUT /identity/v3/projects/23ed10f97ee6425d95390b8aff623d10/users/97c902509f864b1084201721e55f1bc6/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:32.503063 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10f527-588b-424f-87b5-100cca0a841d None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:32.503342 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10f527-588b-424f-87b5-100cca0a841d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:32.503618 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10f527-588b-424f-87b5-100cca0a841d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:32.549528 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-6d10f527-588b-424f-87b5-100cca0a841d None None] MFA Rules not processed for user `97c902509f864b1084201721e55f1bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:32.551277 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6d10f527-588b-424f-87b5-100cca0a841d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:32.587335 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 890/1777] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:32.591693 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4645ca3-8694-44d4-badd-4fff74512653 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:32.607464 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4645ca3-8694-44d4-badd-4fff74512653 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:32.662036 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 888/1778] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:33:32.665039 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10f527-588b-424f-87b5-100cca0a841d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:32.722326 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef8985-0ce2-4c70-940a-30a49a3ad85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:32.723502 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef8985-0ce2-4c70-940a-30a49a3ad85e admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:32.723788 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef8985-0ce2-4c70-940a-30a49a3ad85e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:32.724064 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef8985-0ce2-4c70-940a-30a49a3ad85e admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:32.724803 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef8985-0ce2-4c70-940a-30a49a3ad85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:32.728535 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef8985-0ce2-4c70-940a-30a49a3ad85e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:32.782609 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 891/1779] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:33:32 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:33:32.784978 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d6bf1-3967-4fbe-8808-f71001324f98 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:32.786516 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d6bf1-3967-4fbe-8808-f71001324f98 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:32.787094 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d6bf1-3967-4fbe-8808-f71001324f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:32.820808 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10f527-588b-424f-87b5-100cca0a841d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:32.827392 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-ea6d6bf1-3967-4fbe-8808-f71001324f98 None None] MFA Rules not processed for user `9d3207da0fb24b3f8f329b6837fd9376`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:32.828847 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ea6d6bf1-3967-4fbe-8808-f71001324f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:32.905337 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 892/1780] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:32.905337 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d6bf1-3967-4fbe-8808-f71001324f98 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:32.908145 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b200ee-7484-4df6-87b5-1dfe9b3caa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:32.908827 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b200ee-7484-4df6-87b5-1dfe9b3caa44 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:32.909109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b200ee-7484-4df6-87b5-1dfe9b3caa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:32.909473 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b200ee-7484-4df6-87b5-1dfe9b3caa44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:32.914280 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b200ee-7484-4df6-87b5-1dfe9b3caa44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:32.919961 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d6bf1-3967-4fbe-8808-f71001324f98 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:32.923163 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b200ee-7484-4df6-87b5-1dfe9b3caa44 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:32.927156 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e47e3-4c45-4d16-aa48-c8afabbdc65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:32.927951 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e47e3-4c45-4d16-aa48-c8afabbdc65a admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:32.928283 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e47e3-4c45-4d16-aa48-c8afabbdc65a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:32.928586 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e47e3-4c45-4d16-aa48-c8afabbdc65a admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:32.929404 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e47e3-4c45-4d16-aa48-c8afabbdc65a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:32.931410 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e47e3-4c45-4d16-aa48-c8afabbdc65a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:32.964418 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 893/1781] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:33:32 2022] POST /identity/v3/users => generated 300 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:32.965660 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e47e3-4c45-4d16-aa48-c8afabbdc65a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:32.977317 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 889/1782] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:33:32 2022] POST /identity/v3/projects => generated 381 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:32.990471 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e47e3-4c45-4d16-aa48-c8afabbdc65a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:32.993818 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b200ee-7484-4df6-87b5-1dfe9b3caa44 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:33.100235 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a52667-b469-4b4a-8686-833695995b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:33.100914 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a52667-b469-4b4a-8686-833695995b55 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:33.101713 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a52667-b469-4b4a-8686-833695995b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:33.101713 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a52667-b469-4b4a-8686-833695995b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:33.102506 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a52667-b469-4b4a-8686-833695995b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:33.104300 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a52667-b469-4b4a-8686-833695995b55 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:33.110436 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b200ee-7484-4df6-87b5-1dfe9b3caa44 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:33.126211 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15062b-72b0-4da8-a12c-bc710cf38fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:33.126899 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15062b-72b0-4da8-a12c-bc710cf38fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:33.127183 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15062b-72b0-4da8-a12c-bc710cf38fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:33.127460 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15062b-72b0-4da8-a12c-bc710cf38fb1 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:33.128167 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15062b-72b0-4da8-a12c-bc710cf38fb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:33.128805 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 894/1783] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:33.130232 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15062b-72b0-4da8-a12c-bc710cf38fb1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:33.135782 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a52667-b469-4b4a-8686-833695995b55 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:33.148309 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a52667-b469-4b4a-8686-833695995b55 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:33.159159 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 890/1784] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:33:32 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:33.160904 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c03ad-45ad-44e0-818d-981d0ac251b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:33.161981 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c03ad-45ad-44e0-818d-981d0ac251b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:33.163147 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15062b-72b0-4da8-a12c-bc710cf38fb1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:33.163953 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c03ad-45ad-44e0-818d-981d0ac251b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:33.164257 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c03ad-45ad-44e0-818d-981d0ac251b4 admin admin] PATH_INFO: `/v3/projects/816035c3ec834a13b375e7f7f18c2c56/users/38a6c73305fd4f2c8f95b3aa79566a59/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:33.186872 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c03ad-45ad-44e0-818d-981d0ac251b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=816035c3ec834a13b375e7f7f18c2c56, user_id=38a6c73305fd4f2c8f95b3aa79566a59, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:33.187441 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15062b-72b0-4da8-a12c-bc710cf38fb1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:33.189968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c03ad-45ad-44e0-818d-981d0ac251b4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:33.202797 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c3003-468d-4d5a-8e88-3d45bccb157e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:33.205594 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c3003-468d-4d5a-8e88-3d45bccb157e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:33.206238 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c3003-468d-4d5a-8e88-3d45bccb157e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:33.206587 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c3003-468d-4d5a-8e88-3d45bccb157e admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:33.208148 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c3003-468d-4d5a-8e88-3d45bccb157e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:33.210234 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c3003-468d-4d5a-8e88-3d45bccb157e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:33.216578 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 895/1785] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:33 2022] PUT /identity/v3/projects/816035c3ec834a13b375e7f7f18c2c56/users/38a6c73305fd4f2c8f95b3aa79566a59/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:33.218589 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c03ad-45ad-44e0-818d-981d0ac251b4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:33.224846 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 891/1786] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:33:33.229217 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c3003-468d-4d5a-8e88-3d45bccb157e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:33.244616 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c3003-468d-4d5a-8e88-3d45bccb157e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:33.316105 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c03ad-45ad-44e0-818d-981d0ac251b4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:33.318615 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d5584-a4dd-4e70-bbbe-eb3b0a6bc5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:33.319540 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d5584-a4dd-4e70-bbbe-eb3b0a6bc5c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:33.319820 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d5584-a4dd-4e70-bbbe-eb3b0a6bc5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:33.320690 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d5584-a4dd-4e70-bbbe-eb3b0a6bc5c4 admin admin] PATH_INFO: `/v3/projects/b894209f68184c7b93c5997dd6015286/users/dba19322dcd848d983b0f2d30077a869/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:33.327976 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536af601-d8dd-4257-a940-f4c2ef40040e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:33.329298 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536af601-d8dd-4257-a940-f4c2ef40040e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:33.329644 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536af601-d8dd-4257-a940-f4c2ef40040e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:33.330650 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536af601-d8dd-4257-a940-f4c2ef40040e admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:33.331561 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536af601-d8dd-4257-a940-f4c2ef40040e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:33.334208 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536af601-d8dd-4257-a940-f4c2ef40040e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:33.352429 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 896/1787] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:33.352614 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d5584-a4dd-4e70-bbbe-eb3b0a6bc5c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b894209f68184c7b93c5997dd6015286, user_id=dba19322dcd848d983b0f2d30077a869, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:33.353523 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536af601-d8dd-4257-a940-f4c2ef40040e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:33.355020 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d5584-a4dd-4e70-bbbe-eb3b0a6bc5c4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:33.368643 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536af601-d8dd-4257-a940-f4c2ef40040e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:33.377786 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 892/1788] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:33 2022] PUT /identity/v3/projects/b894209f68184c7b93c5997dd6015286/users/dba19322dcd848d983b0f2d30077a869/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:33.382153 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d5584-a4dd-4e70-bbbe-eb3b0a6bc5c4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:33.444904 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d19be-7e4f-4a31-80c9-7c0ffe64ae72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:33.445904 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d19be-7e4f-4a31-80c9-7c0ffe64ae72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:33.446298 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d19be-7e4f-4a31-80c9-7c0ffe64ae72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:33.449627 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d19be-7e4f-4a31-80c9-7c0ffe64ae72 admin admin] PATH_INFO: `/v3/projects/816035c3ec834a13b375e7f7f18c2c56/users/38a6c73305fd4f2c8f95b3aa79566a59/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:33.451873 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d19be-7e4f-4a31-80c9-7c0ffe64ae72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=816035c3ec834a13b375e7f7f18c2c56, user_id=38a6c73305fd4f2c8f95b3aa79566a59, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:33.456011 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d19be-7e4f-4a31-80c9-7c0ffe64ae72 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:33.464813 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d5584-a4dd-4e70-bbbe-eb3b0a6bc5c4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:33.467538 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 897/1789] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:33 2022] PUT /identity/v3/projects/816035c3ec834a13b375e7f7f18c2c56/users/38a6c73305fd4f2c8f95b3aa79566a59/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:33.477683 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84379e68-ba9f-4959-b251-78f16891563c None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:33.478216 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84379e68-ba9f-4959-b251-78f16891563c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:33.478440 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84379e68-ba9f-4959-b251-78f16891563c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:33.506341 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-84379e68-ba9f-4959-b251-78f16891563c None None] MFA Rules not processed for user `38a6c73305fd4f2c8f95b3aa79566a59`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:33.507723 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-84379e68-ba9f-4959-b251-78f16891563c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:33.525937 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aee8d1-8de1-4e9c-a549-4a1f698eeb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:33.526605 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aee8d1-8de1-4e9c-a549-4a1f698eeb60 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:33.526887 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aee8d1-8de1-4e9c-a549-4a1f698eeb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:33.527160 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aee8d1-8de1-4e9c-a549-4a1f698eeb60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:33.527913 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aee8d1-8de1-4e9c-a549-4a1f698eeb60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:33.529593 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aee8d1-8de1-4e9c-a549-4a1f698eeb60 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:33.540889 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 893/1790] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:33.545156 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aee8d1-8de1-4e9c-a549-4a1f698eeb60 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:33.555059 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aee8d1-8de1-4e9c-a549-4a1f698eeb60 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:33.559797 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551a96d-1132-44a4-a7ad-ba2826e78da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:33.561203 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551a96d-1132-44a4-a7ad-ba2826e78da3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:33.561518 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551a96d-1132-44a4-a7ad-ba2826e78da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:33.561792 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551a96d-1132-44a4-a7ad-ba2826e78da3 admin admin] PATH_INFO: `/v3/projects/b894209f68184c7b93c5997dd6015286/users/dba19322dcd848d983b0f2d30077a869/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:33.563815 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551a96d-1132-44a4-a7ad-ba2826e78da3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b894209f68184c7b93c5997dd6015286, user_id=dba19322dcd848d983b0f2d30077a869, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:33.566526 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551a96d-1132-44a4-a7ad-ba2826e78da3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:33.579034 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 894/1791] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:33 2022] PUT /identity/v3/projects/b894209f68184c7b93c5997dd6015286/users/dba19322dcd848d983b0f2d30077a869/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:33:33.589187 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55267f7-5abf-4669-8f2c-58b8f24fc3e8 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:33.589506 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55267f7-5abf-4669-8f2c-58b8f24fc3e8 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:33.589781 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55267f7-5abf-4669-8f2c-58b8f24fc3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:33.597629 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 898/1792] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:33.607646 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84379e68-ba9f-4959-b251-78f16891563c None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:33.609095 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-84379e68-ba9f-4959-b251-78f16891563c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:33.620442 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-a55267f7-5abf-4669-8f2c-58b8f24fc3e8 None None] MFA Rules not processed for user `dba19322dcd848d983b0f2d30077a869`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:33.621525 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a55267f7-5abf-4669-8f2c-58b8f24fc3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:33.682348 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84379e68-ba9f-4959-b251-78f16891563c None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:33.712442 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 895/1793] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:33:33.729950 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55267f7-5abf-4669-8f2c-58b8f24fc3e8 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:33.732772 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a55267f7-5abf-4669-8f2c-58b8f24fc3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:33.797419 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0eec1-0972-4313-abab-70c0d01692e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:33.798083 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0eec1-0972-4313-abab-70c0d01692e1 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:33.798416 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0eec1-0972-4313-abab-70c0d01692e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:33.798642 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0eec1-0972-4313-abab-70c0d01692e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:33.824704 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55267f7-5abf-4669-8f2c-58b8f24fc3e8 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:33.829773 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdab915-78b9-474e-919f-f3a52032c281 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:33.830703 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdab915-78b9-474e-919f-f3a52032c281 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:33.830983 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdab915-78b9-474e-919f-f3a52032c281 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:33.831256 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdab915-78b9-474e-919f-f3a52032c281 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:33.845159 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdab915-78b9-474e-919f-f3a52032c281 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:33.847939 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdab915-78b9-474e-919f-f3a52032c281 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:33.866658 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0eec1-0972-4313-abab-70c0d01692e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:33.868423 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0eec1-0972-4313-abab-70c0d01692e1 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:33.874773 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 896/1794] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:33.884143 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 899/1795] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:34.008390 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdab915-78b9-474e-919f-f3a52032c281 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:34.016873 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdab915-78b9-474e-919f-f3a52032c281 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:34.020901 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f744d-9ff9-4e0a-983b-0744053d19c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:34.021699 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f744d-9ff9-4e0a-983b-0744053d19c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:34.021981 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f744d-9ff9-4e0a-983b-0744053d19c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:34.022256 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f744d-9ff9-4e0a-983b-0744053d19c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:34.099704 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f744d-9ff9-4e0a-983b-0744053d19c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:34.101173 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f744d-9ff9-4e0a-983b-0744053d19c9 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:34.111470 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 897/1796] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:34.427756 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0eec1-0972-4313-abab-70c0d01692e1 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:34.436580 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0eec1-0972-4313-abab-70c0d01692e1 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:34.440188 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26119f01-5e14-4ebf-9a78-66587dff2210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:34.440821 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26119f01-5e14-4ebf-9a78-66587dff2210 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:34.441102 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26119f01-5e14-4ebf-9a78-66587dff2210 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:34.441421 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26119f01-5e14-4ebf-9a78-66587dff2210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:34.443185 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-26119f01-5e14-4ebf-9a78-66587dff2210 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:34.504310 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26119f01-5e14-4ebf-9a78-66587dff2210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:34.505708 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26119f01-5e14-4ebf-9a78-66587dff2210 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:34.515134 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 900/1797] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:34.960812 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f744d-9ff9-4e0a-983b-0744053d19c9 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:34.973060 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f744d-9ff9-4e0a-983b-0744053d19c9 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:34.985692 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d7617-3f92-48f5-baea-8534a6e19ade service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:34.986016 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d7617-3f92-48f5-baea-8534a6e19ade service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:34.986232 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d7617-3f92-48f5-baea-8534a6e19ade service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:34.986569 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d7617-3f92-48f5-baea-8534a6e19ade service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:34.988695 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-174d7617-3f92-48f5-baea-8534a6e19ade service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:35.075708 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d7617-3f92-48f5-baea-8534a6e19ade service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:35.077443 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d7617-3f92-48f5-baea-8534a6e19ade service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:35.089357 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 898/1798] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:38.742638 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3327069-3313-4dd0-992a-f3b5f822d949 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:38.743944 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3327069-3313-4dd0-992a-f3b5f822d949 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:38.744707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3327069-3313-4dd0-992a-f3b5f822d949 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:38.748295 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 901/1799] 10.222.0.75 () {54 vars in 921 bytes} [Wed Feb 16 05:33:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:33:38.759620 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68538f-55ed-4b72-8655-b73e1d188aa7 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:38.760104 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68538f-55ed-4b72-8655-b73e1d188aa7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:38.760180 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68538f-55ed-4b72-8655-b73e1d188aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:38.782261 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-5f68538f-55ed-4b72-8655-b73e1d188aa7 None None] MFA Rules not processed for user `6522d231532a48ad8dbc9c9e79a021dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:38.784892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5f68538f-55ed-4b72-8655-b73e1d188aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:38.938473 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 899/1800] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Feb 16 05:33:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:38.987847 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3327069-3313-4dd0-992a-f3b5f822d949 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:39.102173 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3327069-3313-4dd0-992a-f3b5f822d949 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:39.109118 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26206c6b-a248-488d-9757-e81f0ad7cf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:39.110608 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26206c6b-a248-488d-9757-e81f0ad7cf72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:39.110894 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26206c6b-a248-488d-9757-e81f0ad7cf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:39.111219 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26206c6b-a248-488d-9757-e81f0ad7cf72 admin admin] PATH_INFO: `/v3/users/97c902509f864b1084201721e55f1bc6` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:39.115388 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26206c6b-a248-488d-9757-e81f0ad7cf72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c902509f864b1084201721e55f1bc6)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:39.120583 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26206c6b-a248-488d-9757-e81f0ad7cf72 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:39.197171 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-26206c6b-a248-488d-9757-e81f0ad7cf72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c902509f864b1084201721e55f1bc6'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:39.210541 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-26206c6b-a248-488d-9757-e81f0ad7cf72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c902509f864b1084201721e55f1bc6'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:39.228868 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-26206c6b-a248-488d-9757-e81f0ad7cf72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c902509f864b1084201721e55f1bc6'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:39.229637 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-26206c6b-a248-488d-9757-e81f0ad7cf72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c902509f864b1084201721e55f1bc6'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:39.230779 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-26206c6b-a248-488d-9757-e81f0ad7cf72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c902509f864b1084201721e55f1bc6'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:39.253696 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 902/1801] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:33:38 2022] DELETE /identity/v3/users/97c902509f864b1084201721e55f1bc6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:39.258317 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc68498-d4af-48f9-87e9-1c02c81ee512 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:39.258602 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc68498-d4af-48f9-87e9-1c02c81ee512 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:39.258888 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc68498-d4af-48f9-87e9-1c02c81ee512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:39.288021 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-6cc68498-d4af-48f9-87e9-1c02c81ee512 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:39.292113 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6cc68498-d4af-48f9-87e9-1c02c81ee512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:39.339281 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26206c6b-a248-488d-9757-e81f0ad7cf72 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:39.344660 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-26206c6b-a248-488d-9757-e81f0ad7cf72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:39.487603 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 900/1802] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:39.521782 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc68498-d4af-48f9-87e9-1c02c81ee512 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:39.523547 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6cc68498-d4af-48f9-87e9-1c02c81ee512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:39.570943 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26206c6b-a248-488d-9757-e81f0ad7cf72 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:39.586035 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610e8e0-ce97-47ac-bdbe-5c7eeba0ae8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:39.588535 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610e8e0-ce97-47ac-bdbe-5c7eeba0ae8e service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:39.589009 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610e8e0-ce97-47ac-bdbe-5c7eeba0ae8e service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:39.589585 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610e8e0-ce97-47ac-bdbe-5c7eeba0ae8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:39.595783 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5610e8e0-ce97-47ac-bdbe-5c7eeba0ae8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:39.629881 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610e8e0-ce97-47ac-bdbe-5c7eeba0ae8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:39.632846 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610e8e0-ce97-47ac-bdbe-5c7eeba0ae8e service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:39.648114 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 903/1803] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:39.661645 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc68498-d4af-48f9-87e9-1c02c81ee512 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:39.668542 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5651918-18bb-404f-9dbb-77de018e7178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:39.670086 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5651918-18bb-404f-9dbb-77de018e7178 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:39.670462 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5651918-18bb-404f-9dbb-77de018e7178 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:39.671021 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5651918-18bb-404f-9dbb-77de018e7178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:39.692734 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5651918-18bb-404f-9dbb-77de018e7178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:39.694517 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5651918-18bb-404f-9dbb-77de018e7178 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:39.735447 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 901/1804] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:40.500318 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795cd3b-7f1c-40f8-9c25-f831f2346cf5 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:40.502158 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795cd3b-7f1c-40f8-9c25-f831f2346cf5 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:40.502868 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795cd3b-7f1c-40f8-9c25-f831f2346cf5 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:40.507576 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 904/1805] 10.222.0.75 () {54 vars in 921 bytes} [Wed Feb 16 05:33:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:33:40.653482 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5651918-18bb-404f-9dbb-77de018e7178 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:40.655051 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e5651918-18bb-404f-9dbb-77de018e7178 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:40.690118 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5651918-18bb-404f-9dbb-77de018e7178 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:40.698463 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4fe90-59a7-408d-8251-1d0b0650eeac None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:40.699348 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4fe90-59a7-408d-8251-1d0b0650eeac None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:40.701372 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4fe90-59a7-408d-8251-1d0b0650eeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:40.708334 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f94ea-47a0-4964-ac6a-904a41aa6a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:40.709523 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f94ea-47a0-4964-ac6a-904a41aa6a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:40.709878 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f94ea-47a0-4964-ac6a-904a41aa6a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:40.710163 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f94ea-47a0-4964-ac6a-904a41aa6a5d admin admin] PATH_INFO: `/v3/projects/23ed10f97ee6425d95390b8aff623d10` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:40.713524 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f94ea-47a0-4964-ac6a-904a41aa6a5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=23ed10f97ee6425d95390b8aff623d10)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:40.715895 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f94ea-47a0-4964-ac6a-904a41aa6a5d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:40.738535 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-6dd4fe90-59a7-408d-8251-1d0b0650eeac None None] MFA Rules not processed for user `6522d231532a48ad8dbc9c9e79a021dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:40.740493 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6dd4fe90-59a7-408d-8251-1d0b0650eeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:40.757698 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 905/1806] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Feb 16 05:33:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:33:40.787894 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-244f94ea-47a0-4964-ac6a-904a41aa6a5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23ed10f97ee6425d95390b8aff623d10', 'request_id': 'req-244f94ea-47a0-4964-ac6a-904a41aa6a5d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:40.789240 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4fe90-59a7-408d-8251-1d0b0650eeac None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:40.806780 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-244f94ea-47a0-4964-ac6a-904a41aa6a5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23ed10f97ee6425d95390b8aff623d10', 'request_id': 'req-244f94ea-47a0-4964-ac6a-904a41aa6a5d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:40.807624 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4fe90-59a7-408d-8251-1d0b0650eeac None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:40.818801 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-244f94ea-47a0-4964-ac6a-904a41aa6a5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23ed10f97ee6425d95390b8aff623d10', 'request_id': 'req-244f94ea-47a0-4964-ac6a-904a41aa6a5d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:40.834556 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-244f94ea-47a0-4964-ac6a-904a41aa6a5d admin admin] The token cache is being invalidate because project 23ed10f97ee6425d95390b8aff623d10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:33:40.835251 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-244f94ea-47a0-4964-ac6a-904a41aa6a5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:40.836399 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-244f94ea-47a0-4964-ac6a-904a41aa6a5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:40.838681 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 902/1807] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:33:40 2022] DELETE /identity/v3/projects/23ed10f97ee6425d95390b8aff623d10 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:40.842292 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f94ea-47a0-4964-ac6a-904a41aa6a5d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:40.845980 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-244f94ea-47a0-4964-ac6a-904a41aa6a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:40.931356 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0418de-354f-4be1-b861-40a062d9d059 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:40.932023 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0418de-354f-4be1-b861-40a062d9d059 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:40.932418 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0418de-354f-4be1-b861-40a062d9d059 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:40.932718 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0418de-354f-4be1-b861-40a062d9d059 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:40.935663 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ab0418de-354f-4be1-b861-40a062d9d059 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:40.936165 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f94ea-47a0-4964-ac6a-904a41aa6a5d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:40.944341 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa458e95-1e48-41e7-91e3-f79bfed73ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:40.945610 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa458e95-1e48-41e7-91e3-f79bfed73ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:40.945943 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa458e95-1e48-41e7-91e3-f79bfed73ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:40.946272 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa458e95-1e48-41e7-91e3-f79bfed73ebb admin admin] PATH_INFO: `/v3/users/dba19322dcd848d983b0f2d30077a869` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:40.947514 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa458e95-1e48-41e7-91e3-f79bfed73ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dba19322dcd848d983b0f2d30077a869)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:40.949856 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa458e95-1e48-41e7-91e3-f79bfed73ebb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:40.950462 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0418de-354f-4be1-b861-40a062d9d059 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:40.952109 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0418de-354f-4be1-b861-40a062d9d059 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:40.962858 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 906/1808] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:33:40.963579 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0418de-354f-4be1-b861-40a062d9d059 service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:40.965129 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ab0418de-354f-4be1-b861-40a062d9d059 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:41.033423 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-fa458e95-1e48-41e7-91e3-f79bfed73ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dba19322dcd848d983b0f2d30077a869'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:41.038269 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0418de-354f-4be1-b861-40a062d9d059 service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:41.045904 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315932d-6cbc-4377-b2b9-52e686558b45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:41.047208 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315932d-6cbc-4377-b2b9-52e686558b45 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:41.048458 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315932d-6cbc-4377-b2b9-52e686558b45 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:41.053645 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-fa458e95-1e48-41e7-91e3-f79bfed73ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dba19322dcd848d983b0f2d30077a869'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:41.056772 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-fa458e95-1e48-41e7-91e3-f79bfed73ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dba19322dcd848d983b0f2d30077a869'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:41.057824 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-fa458e95-1e48-41e7-91e3-f79bfed73ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dba19322dcd848d983b0f2d30077a869'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:41.063847 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315932d-6cbc-4377-b2b9-52e686558b45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:41.071224 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2315932d-6cbc-4377-b2b9-52e686558b45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:41.078747 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-fa458e95-1e48-41e7-91e3-f79bfed73ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dba19322dcd848d983b0f2d30077a869'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:41.093797 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 903/1809] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:33:40 2022] DELETE /identity/v3/users/dba19322dcd848d983b0f2d30077a869 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:33:41.207629 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315932d-6cbc-4377-b2b9-52e686558b45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:41.209683 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315932d-6cbc-4377-b2b9-52e686558b45 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:41.222235 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 907/1810] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:41.923188 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa458e95-1e48-41e7-91e3-f79bfed73ebb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:41.924936 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fa458e95-1e48-41e7-91e3-f79bfed73ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:42.006768 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa458e95-1e48-41e7-91e3-f79bfed73ebb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:42.011781 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107fa34-b869-4249-9d77-b0f54be855b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:42.016918 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107fa34-b869-4249-9d77-b0f54be855b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:42.017072 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107fa34-b869-4249-9d77-b0f54be855b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:42.018025 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107fa34-b869-4249-9d77-b0f54be855b4 admin admin] PATH_INFO: `/v3/projects/b894209f68184c7b93c5997dd6015286` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:42.018943 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107fa34-b869-4249-9d77-b0f54be855b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b894209f68184c7b93c5997dd6015286)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:42.020920 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107fa34-b869-4249-9d77-b0f54be855b4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:42.082524 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7107fa34-b869-4249-9d77-b0f54be855b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b894209f68184c7b93c5997dd6015286', 'request_id': 'req-7107fa34-b869-4249-9d77-b0f54be855b4'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:42.094869 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7107fa34-b869-4249-9d77-b0f54be855b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b894209f68184c7b93c5997dd6015286', 'request_id': 'req-7107fa34-b869-4249-9d77-b0f54be855b4'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:42.113402 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7107fa34-b869-4249-9d77-b0f54be855b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b894209f68184c7b93c5997dd6015286', 'request_id': 'req-7107fa34-b869-4249-9d77-b0f54be855b4'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:42.134835 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7107fa34-b869-4249-9d77-b0f54be855b4 admin admin] The token cache is being invalidate because project b894209f68184c7b93c5997dd6015286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:33:42.135263 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7107fa34-b869-4249-9d77-b0f54be855b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:42.135934 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7107fa34-b869-4249-9d77-b0f54be855b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:42.141433 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 904/1811] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:33:41 2022] DELETE /identity/v3/projects/b894209f68184c7b93c5997dd6015286 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:42.143088 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c67ce-4af8-4d65-8eba-e70ebfb4ee63 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:42.143520 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c67ce-4af8-4d65-8eba-e70ebfb4ee63 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:42.143640 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9c67ce-4af8-4d65-8eba-e70ebfb4ee63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:42.162871 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-cf9c67ce-4af8-4d65-8eba-e70ebfb4ee63 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:42.164085 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cf9c67ce-4af8-4d65-8eba-e70ebfb4ee63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:42.252830 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 908/1812] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:33:42.254131 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c26e7e-230d-4980-85fa-2ee0a385f276 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:42.254612 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c26e7e-230d-4980-85fa-2ee0a385f276 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:42.255194 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c26e7e-230d-4980-85fa-2ee0a385f276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:42.283909 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-77c26e7e-230d-4980-85fa-2ee0a385f276 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:42.285340 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-77c26e7e-230d-4980-85fa-2ee0a385f276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:42.294885 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 905/1813] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:42.299179 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c67ce-4af8-4d65-8eba-e70ebfb4ee63 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:42.309142 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9c67ce-4af8-4d65-8eba-e70ebfb4ee63 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:42.314499 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde27309-ffcf-44ff-8b4e-7d565c149f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:42.315139 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde27309-ffcf-44ff-8b4e-7d565c149f73 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:42.315413 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde27309-ffcf-44ff-8b4e-7d565c149f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:42.315682 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde27309-ffcf-44ff-8b4e-7d565c149f73 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:42.316424 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde27309-ffcf-44ff-8b4e-7d565c149f73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:33:42.316723 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde27309-ffcf-44ff-8b4e-7d565c149f73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:42.318366 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde27309-ffcf-44ff-8b4e-7d565c149f73 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:42.331254 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 909/1814] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:33:42.334825 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c26e7e-230d-4980-85fa-2ee0a385f276 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:42.345755 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c26e7e-230d-4980-85fa-2ee0a385f276 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:42.350354 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b2a20-78ac-4627-8704-60d4a3817d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:42.351035 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b2a20-78ac-4627-8704-60d4a3817d0e admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:42.351308 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b2a20-78ac-4627-8704-60d4a3817d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:42.351584 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b2a20-78ac-4627-8704-60d4a3817d0e admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:42.352286 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b2a20-78ac-4627-8704-60d4a3817d0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:42.354296 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b2a20-78ac-4627-8704-60d4a3817d0e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:42.384823 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 906/1815] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:33:42 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:33:42.389023 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde27309-ffcf-44ff-8b4e-7d565c149f73 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:42.399424 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde27309-ffcf-44ff-8b4e-7d565c149f73 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:42.453815 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76955e-0b03-46f8-93a4-b907e2c906f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:42.454479 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76955e-0b03-46f8-93a4-b907e2c906f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:42.454760 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76955e-0b03-46f8-93a4-b907e2c906f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:42.455036 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76955e-0b03-46f8-93a4-b907e2c906f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:42.455713 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76955e-0b03-46f8-93a4-b907e2c906f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:42.457653 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76955e-0b03-46f8-93a4-b907e2c906f3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:42.476494 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 910/1816] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:33:42 2022] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:42.480437 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b2a20-78ac-4627-8704-60d4a3817d0e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:42.491230 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b2a20-78ac-4627-8704-60d4a3817d0e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:42.495776 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefb3f5-da24-4593-8dab-ee44fb976f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:42.496419 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefb3f5-da24-4593-8dab-ee44fb976f49 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:42.496701 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefb3f5-da24-4593-8dab-ee44fb976f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:42.496976 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefb3f5-da24-4593-8dab-ee44fb976f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:42.498300 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaefb3f5-da24-4593-8dab-ee44fb976f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:42.499902 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaefb3f5-da24-4593-8dab-ee44fb976f49 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:42.509913 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 907/1817] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:42.513715 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76955e-0b03-46f8-93a4-b907e2c906f3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:42.523181 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76955e-0b03-46f8-93a4-b907e2c906f3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:42.527815 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9aeae8-a53d-41ba-8733-8bd431eb759d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:42.528492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9aeae8-a53d-41ba-8733-8bd431eb759d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:42.528775 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9aeae8-a53d-41ba-8733-8bd431eb759d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:42.529053 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9aeae8-a53d-41ba-8733-8bd431eb759d admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:42.529807 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9aeae8-a53d-41ba-8733-8bd431eb759d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:42.531387 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9aeae8-a53d-41ba-8733-8bd431eb759d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:42.541073 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 911/1818] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:42.545478 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefb3f5-da24-4593-8dab-ee44fb976f49 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:42.555705 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefb3f5-da24-4593-8dab-ee44fb976f49 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:42.561186 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096afa8-ea7b-41fd-8c48-d1a9c6ddc249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:42.562122 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096afa8-ea7b-41fd-8c48-d1a9c6ddc249 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:42.562400 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096afa8-ea7b-41fd-8c48-d1a9c6ddc249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:42.562668 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096afa8-ea7b-41fd-8c48-d1a9c6ddc249 admin admin] PATH_INFO: `/v3/projects/b3eb3430b3104f97a5c9d7caa52a25a0/users/ac13b3ef17914481b5e04f30787f233f/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:42.578411 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096afa8-ea7b-41fd-8c48-d1a9c6ddc249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3eb3430b3104f97a5c9d7caa52a25a0, user_id=ac13b3ef17914481b5e04f30787f233f, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:42.581105 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096afa8-ea7b-41fd-8c48-d1a9c6ddc249 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:42.595845 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 908/1819] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:42 2022] PUT /identity/v3/projects/b3eb3430b3104f97a5c9d7caa52a25a0/users/ac13b3ef17914481b5e04f30787f233f/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:42.605961 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a0ed7-c7d3-4977-9006-9c2417814f65 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:42.606252 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a0ed7-c7d3-4977-9006-9c2417814f65 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:42.607067 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a0ed7-c7d3-4977-9006-9c2417814f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:42.633615 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-aa7a0ed7-c7d3-4977-9006-9c2417814f65 None None] MFA Rules not processed for user `ac13b3ef17914481b5e04f30787f233f`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:42.634921 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-aa7a0ed7-c7d3-4977-9006-9c2417814f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:42.709920 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 912/1820] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:42.714403 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096afa8-ea7b-41fd-8c48-d1a9c6ddc249 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:42.778837 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096afa8-ea7b-41fd-8c48-d1a9c6ddc249 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:42.783555 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b48873-91c6-42e1-80ca-83d800cd5841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:42.784210 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b48873-91c6-42e1-80ca-83d800cd5841 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:42.784491 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b48873-91c6-42e1-80ca-83d800cd5841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:42.784766 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b48873-91c6-42e1-80ca-83d800cd5841 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:42.785497 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b48873-91c6-42e1-80ca-83d800cd5841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:42.787423 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b48873-91c6-42e1-80ca-83d800cd5841 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:42.820752 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 909/1821] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:33:42 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:33:42.820894 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a0ed7-c7d3-4977-9006-9c2417814f65 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:42.827904 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a0ed7-c7d3-4977-9006-9c2417814f65 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:42.881535 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b338a6-5475-4a1f-b2f3-b6fad1ff609d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:42.882224 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b338a6-5475-4a1f-b2f3-b6fad1ff609d admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:42.882481 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b338a6-5475-4a1f-b2f3-b6fad1ff609d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:42.882757 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b338a6-5475-4a1f-b2f3-b6fad1ff609d admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:42.883802 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b338a6-5475-4a1f-b2f3-b6fad1ff609d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:42.885768 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b338a6-5475-4a1f-b2f3-b6fad1ff609d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:42.905125 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 913/1822] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:33:42 2022] POST /identity/v3/users => generated 300 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:33:42.909035 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b48873-91c6-42e1-80ca-83d800cd5841 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:42.919581 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b48873-91c6-42e1-80ca-83d800cd5841 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:42.924436 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a34be-38eb-4368-a1b1-ecff9309a7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:42.925080 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a34be-38eb-4368-a1b1-ecff9309a7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:42.925464 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a34be-38eb-4368-a1b1-ecff9309a7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:42.925745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a34be-38eb-4368-a1b1-ecff9309a7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:42.926471 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a34be-38eb-4368-a1b1-ecff9309a7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:42.928072 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a34be-38eb-4368-a1b1-ecff9309a7c5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:42.939578 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 910/1823] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:42.943767 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b338a6-5475-4a1f-b2f3-b6fad1ff609d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:42.953645 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b338a6-5475-4a1f-b2f3-b6fad1ff609d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:42.958229 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f8c53-a2d8-4657-9f85-6d374af10315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:42.959101 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f8c53-a2d8-4657-9f85-6d374af10315 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:42.959379 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f8c53-a2d8-4657-9f85-6d374af10315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:42.959653 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f8c53-a2d8-4657-9f85-6d374af10315 admin admin] PATH_INFO: `/v3/projects/de02aa7bd9854da9ad52e2898cd4cc61/users/f1da10f87a4d46ebacd8e1f03e4630b2/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:42.974490 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f8c53-a2d8-4657-9f85-6d374af10315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de02aa7bd9854da9ad52e2898cd4cc61, user_id=f1da10f87a4d46ebacd8e1f03e4630b2, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:42.977143 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f8c53-a2d8-4657-9f85-6d374af10315 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:42.990813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 914/1824] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:42 2022] PUT /identity/v3/projects/de02aa7bd9854da9ad52e2898cd4cc61/users/f1da10f87a4d46ebacd8e1f03e4630b2/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:42.994719 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a34be-38eb-4368-a1b1-ecff9309a7c5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:43.004633 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a34be-38eb-4368-a1b1-ecff9309a7c5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:43.064342 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6479987-017c-49f1-8389-b31438363d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:43.065001 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6479987-017c-49f1-8389-b31438363d72 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:43.065302 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6479987-017c-49f1-8389-b31438363d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:43.065575 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6479987-017c-49f1-8389-b31438363d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:43.066287 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6479987-017c-49f1-8389-b31438363d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:43.067882 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6479987-017c-49f1-8389-b31438363d72 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:43.080786 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 911/1825] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:43.082038 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f8c53-a2d8-4657-9f85-6d374af10315 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:43.093034 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f8c53-a2d8-4657-9f85-6d374af10315 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:43.097688 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec1640-7377-40ff-8b69-3dabe076d67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:43.098561 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec1640-7377-40ff-8b69-3dabe076d67e admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:43.098837 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec1640-7377-40ff-8b69-3dabe076d67e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:43.099109 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec1640-7377-40ff-8b69-3dabe076d67e admin admin] PATH_INFO: `/v3/projects/de02aa7bd9854da9ad52e2898cd4cc61/users/f1da10f87a4d46ebacd8e1f03e4630b2/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:43.101065 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec1640-7377-40ff-8b69-3dabe076d67e admin admin] RBAC: Authorizing `identity:create_grant(project_id=de02aa7bd9854da9ad52e2898cd4cc61, user_id=f1da10f87a4d46ebacd8e1f03e4630b2, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:43.103984 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec1640-7377-40ff-8b69-3dabe076d67e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:43.115612 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 915/1826] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:43 2022] PUT /identity/v3/projects/de02aa7bd9854da9ad52e2898cd4cc61/users/f1da10f87a4d46ebacd8e1f03e4630b2/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:43.125737 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bd489-d88f-4a21-a4f7-e71b2ccfc669 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:43.126256 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bd489-d88f-4a21-a4f7-e71b2ccfc669 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:43.126659 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bd489-d88f-4a21-a4f7-e71b2ccfc669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:43.157599 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ff9bd489-d88f-4a21-a4f7-e71b2ccfc669 None None] MFA Rules not processed for user `f1da10f87a4d46ebacd8e1f03e4630b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:43.158928 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ff9bd489-d88f-4a21-a4f7-e71b2ccfc669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:43.225020 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 912/1827] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:43.239058 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec1640-7377-40ff-8b69-3dabe076d67e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:43.242653 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-65ec1640-7377-40ff-8b69-3dabe076d67e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:43.307352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec1640-7377-40ff-8b69-3dabe076d67e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:43.311054 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc589b-dcc4-42d2-82b6-6de6bb02442a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:43.311698 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc589b-dcc4-42d2-82b6-6de6bb02442a service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:43.311980 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc589b-dcc4-42d2-82b6-6de6bb02442a service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:43.312254 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc589b-dcc4-42d2-82b6-6de6bb02442a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:43.321383 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc589b-dcc4-42d2-82b6-6de6bb02442a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:43.322811 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc589b-dcc4-42d2-82b6-6de6bb02442a service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:43.332947 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 916/1828] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:43.458659 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bd489-d88f-4a21-a4f7-e71b2ccfc669 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:43.518715 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bd489-d88f-4a21-a4f7-e71b2ccfc669 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:43.525947 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f405b-a618-4f9c-a4f8-4ad38de8d240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:43.527476 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f405b-a618-4f9c-a4f8-4ad38de8d240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:43.527938 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f405b-a618-4f9c-a4f8-4ad38de8d240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:43.528479 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f405b-a618-4f9c-a4f8-4ad38de8d240 admin admin] PATH_INFO: `/v3/users/ac13b3ef17914481b5e04f30787f233f` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:43.530610 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f405b-a618-4f9c-a4f8-4ad38de8d240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac13b3ef17914481b5e04f30787f233f)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:43.532618 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f405b-a618-4f9c-a4f8-4ad38de8d240 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:43.586868 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f15f405b-a618-4f9c-a4f8-4ad38de8d240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac13b3ef17914481b5e04f30787f233f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:43.599122 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f15f405b-a618-4f9c-a4f8-4ad38de8d240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac13b3ef17914481b5e04f30787f233f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:43.599928 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f15f405b-a618-4f9c-a4f8-4ad38de8d240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac13b3ef17914481b5e04f30787f233f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:43.600630 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f15f405b-a618-4f9c-a4f8-4ad38de8d240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac13b3ef17914481b5e04f30787f233f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:43.608372 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f15f405b-a618-4f9c-a4f8-4ad38de8d240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac13b3ef17914481b5e04f30787f233f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:43.620218 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 913/1829] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:33:43 2022] DELETE /identity/v3/users/ac13b3ef17914481b5e04f30787f233f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:43.625225 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469dae-0f92-432a-8b5b-6a38d0ed2221 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:43.625568 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469dae-0f92-432a-8b5b-6a38d0ed2221 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:43.625846 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469dae-0f92-432a-8b5b-6a38d0ed2221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:43.643619 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-7a469dae-0f92-432a-8b5b-6a38d0ed2221 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:43.644813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7a469dae-0f92-432a-8b5b-6a38d0ed2221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:43.704095 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 917/1830] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:43.713736 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f405b-a618-4f9c-a4f8-4ad38de8d240 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:43.715154 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f15f405b-a618-4f9c-a4f8-4ad38de8d240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:43.769943 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f405b-a618-4f9c-a4f8-4ad38de8d240 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:43.773612 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33a70a-a654-42de-8e68-2362c8c94844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:43.774255 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33a70a-a654-42de-8e68-2362c8c94844 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:43.774539 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33a70a-a654-42de-8e68-2362c8c94844 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:43.774818 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33a70a-a654-42de-8e68-2362c8c94844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:43.783865 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33a70a-a654-42de-8e68-2362c8c94844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:43.785342 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33a70a-a654-42de-8e68-2362c8c94844 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:43.795418 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 914/1831] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:44.129189 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a469dae-0f92-432a-8b5b-6a38d0ed2221 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:44.130749 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7a469dae-0f92-432a-8b5b-6a38d0ed2221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:44.159035 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a469dae-0f92-432a-8b5b-6a38d0ed2221 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:44.163913 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0b45f-5035-46f7-b785-13278d8bc3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:44.164793 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0b45f-5035-46f7-b785-13278d8bc3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:44.165072 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0b45f-5035-46f7-b785-13278d8bc3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:44.165373 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0b45f-5035-46f7-b785-13278d8bc3f8 admin admin] PATH_INFO: `/v3/projects/b3eb3430b3104f97a5c9d7caa52a25a0` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:44.166553 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0b45f-5035-46f7-b785-13278d8bc3f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3eb3430b3104f97a5c9d7caa52a25a0)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:44.168463 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0b45f-5035-46f7-b785-13278d8bc3f8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:44.214611 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-64d0b45f-5035-46f7-b785-13278d8bc3f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3eb3430b3104f97a5c9d7caa52a25a0', 'request_id': 'req-64d0b45f-5035-46f7-b785-13278d8bc3f8'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:44.222061 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-64d0b45f-5035-46f7-b785-13278d8bc3f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3eb3430b3104f97a5c9d7caa52a25a0', 'request_id': 'req-64d0b45f-5035-46f7-b785-13278d8bc3f8'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:44.227469 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-64d0b45f-5035-46f7-b785-13278d8bc3f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3eb3430b3104f97a5c9d7caa52a25a0', 'request_id': 'req-64d0b45f-5035-46f7-b785-13278d8bc3f8'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:44.238583 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-64d0b45f-5035-46f7-b785-13278d8bc3f8 admin admin] The token cache is being invalidate because project b3eb3430b3104f97a5c9d7caa52a25a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:33:44.238867 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-64d0b45f-5035-46f7-b785-13278d8bc3f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:44.239494 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-64d0b45f-5035-46f7-b785-13278d8bc3f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:44.240999 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 918/1832] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:33:44 2022] DELETE /identity/v3/projects/b3eb3430b3104f97a5c9d7caa52a25a0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:44.244814 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33a70a-a654-42de-8e68-2362c8c94844 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:44.254022 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33a70a-a654-42de-8e68-2362c8c94844 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:44.314428 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdbca9-52a4-4645-9d88-489f4820449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:44.315810 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdbca9-52a4-4645-9d88-489f4820449d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:44.316591 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdbca9-52a4-4645-9d88-489f4820449d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:44.316868 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdbca9-52a4-4645-9d88-489f4820449d admin admin] PATH_INFO: `/v3/users/f1da10f87a4d46ebacd8e1f03e4630b2` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:44.318142 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdbca9-52a4-4645-9d88-489f4820449d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1da10f87a4d46ebacd8e1f03e4630b2)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:44.320123 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdbca9-52a4-4645-9d88-489f4820449d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:44.386055 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e5fdbca9-52a4-4645-9d88-489f4820449d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1da10f87a4d46ebacd8e1f03e4630b2'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:44.399769 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e5fdbca9-52a4-4645-9d88-489f4820449d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1da10f87a4d46ebacd8e1f03e4630b2'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:44.401723 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e5fdbca9-52a4-4645-9d88-489f4820449d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1da10f87a4d46ebacd8e1f03e4630b2'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:44.402645 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e5fdbca9-52a4-4645-9d88-489f4820449d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1da10f87a4d46ebacd8e1f03e4630b2'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:44.423263 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e5fdbca9-52a4-4645-9d88-489f4820449d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1da10f87a4d46ebacd8e1f03e4630b2'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:44.464425 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 915/1833] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:33:44 2022] DELETE /identity/v3/users/f1da10f87a4d46ebacd8e1f03e4630b2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:45.369266 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0b45f-5035-46f7-b785-13278d8bc3f8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:45.370930 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-64d0b45f-5035-46f7-b785-13278d8bc3f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:45.388820 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0b45f-5035-46f7-b785-13278d8bc3f8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:45.451320 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5947c70-02f1-4c12-978a-477fb31fab8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:45.452303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5947c70-02f1-4c12-978a-477fb31fab8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:45.452650 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5947c70-02f1-4c12-978a-477fb31fab8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:45.452994 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5947c70-02f1-4c12-978a-477fb31fab8e admin admin] PATH_INFO: `/v3/projects/de02aa7bd9854da9ad52e2898cd4cc61` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:45.454343 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5947c70-02f1-4c12-978a-477fb31fab8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=de02aa7bd9854da9ad52e2898cd4cc61)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:45.456354 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5947c70-02f1-4c12-978a-477fb31fab8e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:45.545000 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b5947c70-02f1-4c12-978a-477fb31fab8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de02aa7bd9854da9ad52e2898cd4cc61', 'request_id': 'req-b5947c70-02f1-4c12-978a-477fb31fab8e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:45.568654 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b5947c70-02f1-4c12-978a-477fb31fab8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de02aa7bd9854da9ad52e2898cd4cc61', 'request_id': 'req-b5947c70-02f1-4c12-978a-477fb31fab8e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:45.586147 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b5947c70-02f1-4c12-978a-477fb31fab8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de02aa7bd9854da9ad52e2898cd4cc61', 'request_id': 'req-b5947c70-02f1-4c12-978a-477fb31fab8e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:45.604366 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b5947c70-02f1-4c12-978a-477fb31fab8e admin admin] The token cache is being invalidate because project de02aa7bd9854da9ad52e2898cd4cc61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:33:45.604713 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b5947c70-02f1-4c12-978a-477fb31fab8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:45.605857 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b5947c70-02f1-4c12-978a-477fb31fab8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:45.617431 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 919/1834] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:33:45 2022] DELETE /identity/v3/projects/de02aa7bd9854da9ad52e2898cd4cc61 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:45.622730 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962bfb9-98ea-4e92-8291-3d0bcc9c6c2f None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:45.623197 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962bfb9-98ea-4e92-8291-3d0bcc9c6c2f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:45.623329 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962bfb9-98ea-4e92-8291-3d0bcc9c6c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:45.658842 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-8962bfb9-98ea-4e92-8291-3d0bcc9c6c2f None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:45.661225 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8962bfb9-98ea-4e92-8291-3d0bcc9c6c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:45.709211 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5947c70-02f1-4c12-978a-477fb31fab8e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:45.710897 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b5947c70-02f1-4c12-978a-477fb31fab8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:45.765404 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 916/1835] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:45.769700 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f13861-baea-4826-a1af-a8afe8b26c13 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:45.769985 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f13861-baea-4826-a1af-a8afe8b26c13 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:45.770281 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f13861-baea-4826-a1af-a8afe8b26c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:45.789782 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-83f13861-baea-4826-a1af-a8afe8b26c13 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:45.790993 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-83f13861-baea-4826-a1af-a8afe8b26c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:45.799701 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5947c70-02f1-4c12-978a-477fb31fab8e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:45.803871 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 917/1836] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:33:45.809984 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ea6a1-e3e2-4f41-be08-cbe50952549d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:45.810888 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ea6a1-e3e2-4f41-be08-cbe50952549d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:45.811195 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ea6a1-e3e2-4f41-be08-cbe50952549d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:45.811491 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ea6a1-e3e2-4f41-be08-cbe50952549d admin admin] PATH_INFO: `/v3/users/27bdd547827148ff98bd05d997293b34` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:45.812726 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ea6a1-e3e2-4f41-be08-cbe50952549d admin admin] RBAC: Authorizing `identity:delete_user(user_id=27bdd547827148ff98bd05d997293b34)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:45.814357 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f13861-baea-4826-a1af-a8afe8b26c13 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:45.814853 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6ea6a1-e3e2-4f41-be08-cbe50952549d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:45.824112 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f13861-baea-4826-a1af-a8afe8b26c13 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:45.828834 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d63cc9-a7ab-4d89-aa44-a2d8fa0e53be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:45.829519 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d63cc9-a7ab-4d89-aa44-a2d8fa0e53be admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:45.829796 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d63cc9-a7ab-4d89-aa44-a2d8fa0e53be admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:45.830064 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d63cc9-a7ab-4d89-aa44-a2d8fa0e53be admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:45.830806 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d63cc9-a7ab-4d89-aa44-a2d8fa0e53be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:33:45.831136 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d63cc9-a7ab-4d89-aa44-a2d8fa0e53be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:45.832729 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d63cc9-a7ab-4d89-aa44-a2d8fa0e53be admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:45.845679 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 918/1837] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:33:45.850269 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d63cc9-a7ab-4d89-aa44-a2d8fa0e53be admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:45.863205 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d63cc9-a7ab-4d89-aa44-a2d8fa0e53be admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:45.868322 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3e95e-bf46-4457-a2f8-7b1bb1319345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:45.869052 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3e95e-bf46-4457-a2f8-7b1bb1319345 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:45.869570 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3e95e-bf46-4457-a2f8-7b1bb1319345 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:45.869845 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3e95e-bf46-4457-a2f8-7b1bb1319345 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:45.870704 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3e95e-bf46-4457-a2f8-7b1bb1319345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:45.871915 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1a6ea6a1-e3e2-4f41-be08-cbe50952549d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27bdd547827148ff98bd05d997293b34'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:45.872665 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3e95e-bf46-4457-a2f8-7b1bb1319345 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:45.880001 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1a6ea6a1-e3e2-4f41-be08-cbe50952549d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27bdd547827148ff98bd05d997293b34'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:45.897207 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1a6ea6a1-e3e2-4f41-be08-cbe50952549d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27bdd547827148ff98bd05d997293b34'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:45.897961 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1a6ea6a1-e3e2-4f41-be08-cbe50952549d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27bdd547827148ff98bd05d997293b34'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:45.898634 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1a6ea6a1-e3e2-4f41-be08-cbe50952549d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27bdd547827148ff98bd05d997293b34'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:45.908008 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 919/1838] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:33:45 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:33:45.914100 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3e95e-bf46-4457-a2f8-7b1bb1319345 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:45.916943 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a9b3e95e-bf46-4457-a2f8-7b1bb1319345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:45.920829 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 920/1839] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:33:45 2022] DELETE /identity/v3/users/27bdd547827148ff98bd05d997293b34 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:45.925642 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29f42b-b938-49a7-9445-f349f70ce675 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:45.925928 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29f42b-b938-49a7-9445-f349f70ce675 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:45.926207 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a29f42b-b938-49a7-9445-f349f70ce675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:45.948006 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-6a29f42b-b938-49a7-9445-f349f70ce675 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:45.949493 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6a29f42b-b938-49a7-9445-f349f70ce675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:45.987139 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3e95e-bf46-4457-a2f8-7b1bb1319345 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:46.011663 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 921/1840] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:33:46.020960 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29f42b-b938-49a7-9445-f349f70ce675 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:46.022753 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6a29f42b-b938-49a7-9445-f349f70ce675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:46.046825 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fb833-efda-4e1b-a61d-b94bd17f07c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:46.047786 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fb833-efda-4e1b-a61d-b94bd17f07c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:46.047905 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fb833-efda-4e1b-a61d-b94bd17f07c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:46.048144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fb833-efda-4e1b-a61d-b94bd17f07c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:46.048886 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845fb833-efda-4e1b-a61d-b94bd17f07c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:46.051123 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845fb833-efda-4e1b-a61d-b94bd17f07c7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:46.073342 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 920/1841] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:33:45 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:46.078364 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fb833-efda-4e1b-a61d-b94bd17f07c7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:46.088575 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fb833-efda-4e1b-a61d-b94bd17f07c7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:46.091821 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a29f42b-b938-49a7-9445-f349f70ce675 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:46.094817 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd742350-dcc6-459a-af84-0f0d0c7be5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:46.094817 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd742350-dcc6-459a-af84-0f0d0c7be5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:46.095060 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd742350-dcc6-459a-af84-0f0d0c7be5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:46.095268 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd742350-dcc6-459a-af84-0f0d0c7be5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:46.096144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd742350-dcc6-459a-af84-0f0d0c7be5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:46.097634 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53956d7-283f-456b-bc55-97977cf7b9d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:46.097796 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd742350-dcc6-459a-af84-0f0d0c7be5e8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:46.098594 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53956d7-283f-456b-bc55-97977cf7b9d2 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:46.099195 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53956d7-283f-456b-bc55-97977cf7b9d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:46.099618 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53956d7-283f-456b-bc55-97977cf7b9d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:46.108653 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 921/1842] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:33:46.113720 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53956d7-283f-456b-bc55-97977cf7b9d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:46.114090 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd742350-dcc6-459a-af84-0f0d0c7be5e8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:46.115932 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53956d7-283f-456b-bc55-97977cf7b9d2 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:46.124646 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd742350-dcc6-459a-af84-0f0d0c7be5e8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:46.127095 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 922/1843] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:33:46.136936 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c7863-3c8a-428e-9af3-689582b7c19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:46.138376 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c7863-3c8a-428e-9af3-689582b7c19a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:46.138853 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c7863-3c8a-428e-9af3-689582b7c19a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:46.139272 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c7863-3c8a-428e-9af3-689582b7c19a admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:46.140152 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c7863-3c8a-428e-9af3-689582b7c19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:46.142571 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c7863-3c8a-428e-9af3-689582b7c19a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:46.162108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 922/1844] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:46.165915 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53956d7-283f-456b-bc55-97977cf7b9d2 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:46.176816 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53956d7-283f-456b-bc55-97977cf7b9d2 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:46.182489 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3406e5-de98-4b65-92e0-09b5d87d180a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:46.183533 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3406e5-de98-4b65-92e0-09b5d87d180a admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:46.184004 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3406e5-de98-4b65-92e0-09b5d87d180a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:46.184287 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3406e5-de98-4b65-92e0-09b5d87d180a admin admin] PATH_INFO: `/v3/projects/d7dc9a2399504f35be3470331eddc4df/users/144223bd18724cbe8d06d28f6b0d30c7/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:46.208896 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3406e5-de98-4b65-92e0-09b5d87d180a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7dc9a2399504f35be3470331eddc4df, user_id=144223bd18724cbe8d06d28f6b0d30c7, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:46.211877 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3406e5-de98-4b65-92e0-09b5d87d180a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:46.229877 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 923/1845] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:46 2022] PUT /identity/v3/projects/d7dc9a2399504f35be3470331eddc4df/users/144223bd18724cbe8d06d28f6b0d30c7/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:46.237222 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327436bf-3472-4a0a-b2c6-004691977ab2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:46.237222 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327436bf-3472-4a0a-b2c6-004691977ab2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:46.237669 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327436bf-3472-4a0a-b2c6-004691977ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:46.258008 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-327436bf-3472-4a0a-b2c6-004691977ab2 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:46.259729 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-327436bf-3472-4a0a-b2c6-004691977ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:46.345447 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 923/1846] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:46.359989 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3406e5-de98-4b65-92e0-09b5d87d180a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:46.362605 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2a3406e5-de98-4b65-92e0-09b5d87d180a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:46.442755 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3406e5-de98-4b65-92e0-09b5d87d180a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:46.449224 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88df301-7a07-40bc-a126-15d00541b638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:46.450723 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88df301-7a07-40bc-a126-15d00541b638 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:46.451192 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88df301-7a07-40bc-a126-15d00541b638 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:46.451617 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88df301-7a07-40bc-a126-15d00541b638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:46.502453 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88df301-7a07-40bc-a126-15d00541b638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:46.505772 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88df301-7a07-40bc-a126-15d00541b638 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:46.530128 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 924/1847] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:46.671789 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327436bf-3472-4a0a-b2c6-004691977ab2 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:46.673306 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-327436bf-3472-4a0a-b2c6-004691977ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:46.702861 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327436bf-3472-4a0a-b2c6-004691977ab2 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:46.714747 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf3139-05a5-43d6-9e18-e369bf62825a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:46.716795 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf3139-05a5-43d6-9e18-e369bf62825a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:46.717320 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf3139-05a5-43d6-9e18-e369bf62825a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:46.718485 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf3139-05a5-43d6-9e18-e369bf62825a admin admin] PATH_INFO: `/v3/projects/040122fb905a4f89a6da69ae7fdc10d9` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:46.720873 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf3139-05a5-43d6-9e18-e369bf62825a admin admin] RBAC: Authorizing `identity:delete_project(project_id=040122fb905a4f89a6da69ae7fdc10d9)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:46.725320 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf3139-05a5-43d6-9e18-e369bf62825a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:46.817823 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5fdf3139-05a5-43d6-9e18-e369bf62825a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '040122fb905a4f89a6da69ae7fdc10d9', 'request_id': 'req-5fdf3139-05a5-43d6-9e18-e369bf62825a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:46.842720 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5fdf3139-05a5-43d6-9e18-e369bf62825a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '040122fb905a4f89a6da69ae7fdc10d9', 'request_id': 'req-5fdf3139-05a5-43d6-9e18-e369bf62825a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:46.851638 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5fdf3139-05a5-43d6-9e18-e369bf62825a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '040122fb905a4f89a6da69ae7fdc10d9', 'request_id': 'req-5fdf3139-05a5-43d6-9e18-e369bf62825a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:46.879674 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5fdf3139-05a5-43d6-9e18-e369bf62825a admin admin] The token cache is being invalidate because project 040122fb905a4f89a6da69ae7fdc10d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:33:46.880268 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5fdf3139-05a5-43d6-9e18-e369bf62825a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:46.881716 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5fdf3139-05a5-43d6-9e18-e369bf62825a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:46.886679 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 924/1848] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:33:46 2022] DELETE /identity/v3/projects/040122fb905a4f89a6da69ae7fdc10d9 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:46.891538 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88df301-7a07-40bc-a126-15d00541b638 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:46.907649 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88df301-7a07-40bc-a126-15d00541b638 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:47.010457 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b70ea4-8d70-4630-b8b2-c9bb47b6730b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:47.011668 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b70ea4-8d70-4630-b8b2-c9bb47b6730b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:47.012207 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b70ea4-8d70-4630-b8b2-c9bb47b6730b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:47.013321 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b70ea4-8d70-4630-b8b2-c9bb47b6730b admin admin] PATH_INFO: `/v3/users/9895dd191db14edd8b20324deb90ec3f` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:47.014722 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b70ea4-8d70-4630-b8b2-c9bb47b6730b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9895dd191db14edd8b20324deb90ec3f)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:47.017331 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b70ea4-8d70-4630-b8b2-c9bb47b6730b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:47.108778 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-10b70ea4-8d70-4630-b8b2-c9bb47b6730b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9895dd191db14edd8b20324deb90ec3f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:47.142356 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-10b70ea4-8d70-4630-b8b2-c9bb47b6730b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9895dd191db14edd8b20324deb90ec3f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:47.165084 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-10b70ea4-8d70-4630-b8b2-c9bb47b6730b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9895dd191db14edd8b20324deb90ec3f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:47.166412 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-10b70ea4-8d70-4630-b8b2-c9bb47b6730b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9895dd191db14edd8b20324deb90ec3f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:47.167442 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-10b70ea4-8d70-4630-b8b2-c9bb47b6730b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9895dd191db14edd8b20324deb90ec3f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:47.196396 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 925/1849] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:33:46 2022] DELETE /identity/v3/users/9895dd191db14edd8b20324deb90ec3f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:47.688264 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf3139-05a5-43d6-9e18-e369bf62825a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:47.690672 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5fdf3139-05a5-43d6-9e18-e369bf62825a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:47.724637 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf3139-05a5-43d6-9e18-e369bf62825a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:47.810260 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22564709-9460-4140-8f61-745aa9802a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:47.811374 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22564709-9460-4140-8f61-745aa9802a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:47.812087 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22564709-9460-4140-8f61-745aa9802a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:47.812510 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22564709-9460-4140-8f61-745aa9802a68 admin admin] PATH_INFO: `/v3/projects/06bed1100555450aaba0bf776af9abec` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:47.814078 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22564709-9460-4140-8f61-745aa9802a68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06bed1100555450aaba0bf776af9abec)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:47.816218 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22564709-9460-4140-8f61-745aa9802a68 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:47.875706 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-22564709-9460-4140-8f61-745aa9802a68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06bed1100555450aaba0bf776af9abec', 'request_id': 'req-22564709-9460-4140-8f61-745aa9802a68'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:47.884605 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-22564709-9460-4140-8f61-745aa9802a68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06bed1100555450aaba0bf776af9abec', 'request_id': 'req-22564709-9460-4140-8f61-745aa9802a68'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:47.894285 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-22564709-9460-4140-8f61-745aa9802a68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06bed1100555450aaba0bf776af9abec', 'request_id': 'req-22564709-9460-4140-8f61-745aa9802a68'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:47.907888 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-22564709-9460-4140-8f61-745aa9802a68 admin admin] The token cache is being invalidate because project 06bed1100555450aaba0bf776af9abec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:33:47.908213 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-22564709-9460-4140-8f61-745aa9802a68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:47.909027 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-22564709-9460-4140-8f61-745aa9802a68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:47.914017 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 925/1850] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:33:47 2022] DELETE /identity/v3/projects/06bed1100555450aaba0bf776af9abec => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:47.915170 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b70ea4-8d70-4630-b8b2-c9bb47b6730b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:47.916694 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-10b70ea4-8d70-4630-b8b2-c9bb47b6730b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:47.931834 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b70ea4-8d70-4630-b8b2-c9bb47b6730b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:48.003003 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786f75e-2750-45fa-a6ca-4b0c249fe731 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:48.003369 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786f75e-2750-45fa-a6ca-4b0c249fe731 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:48.003947 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786f75e-2750-45fa-a6ca-4b0c249fe731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:48.021153 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863fdb9-fe98-462a-a066-3459397d354e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:48.022178 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863fdb9-fe98-462a-a066-3459397d354e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:48.022671 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863fdb9-fe98-462a-a066-3459397d354e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:48.023087 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863fdb9-fe98-462a-a066-3459397d354e admin admin] PATH_INFO: `/v3/users/38a6c73305fd4f2c8f95b3aa79566a59` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:48.024417 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863fdb9-fe98-462a-a066-3459397d354e admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a6c73305fd4f2c8f95b3aa79566a59)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:48.027027 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863fdb9-fe98-462a-a066-3459397d354e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:48.041491 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c786f75e-2750-45fa-a6ca-4b0c249fe731 None None] MFA Rules not processed for user `144223bd18724cbe8d06d28f6b0d30c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:48.044054 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c786f75e-2750-45fa-a6ca-4b0c249fe731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:48.101468 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4863fdb9-fe98-462a-a066-3459397d354e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a6c73305fd4f2c8f95b3aa79566a59'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:48.123283 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4863fdb9-fe98-462a-a066-3459397d354e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a6c73305fd4f2c8f95b3aa79566a59'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:48.139749 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4863fdb9-fe98-462a-a066-3459397d354e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a6c73305fd4f2c8f95b3aa79566a59'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:48.140465 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4863fdb9-fe98-462a-a066-3459397d354e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a6c73305fd4f2c8f95b3aa79566a59'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:48.141396 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4863fdb9-fe98-462a-a066-3459397d354e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a6c73305fd4f2c8f95b3aa79566a59'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:48.147700 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 926/1851] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:33:48.152063 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786f75e-2750-45fa-a6ca-4b0c249fe731 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:48.153902 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c786f75e-2750-45fa-a6ca-4b0c249fe731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:48.167030 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 926/1852] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:33:47 2022] DELETE /identity/v3/users/38a6c73305fd4f2c8f95b3aa79566a59 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:33:48.193441 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786f75e-2750-45fa-a6ca-4b0c249fe731 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:48.270077 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e912f6b-c68f-41cf-8528-a5bba5f4511c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:48.270746 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e912f6b-c68f-41cf-8528-a5bba5f4511c admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:48.271023 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e912f6b-c68f-41cf-8528-a5bba5f4511c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:48.271296 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e912f6b-c68f-41cf-8528-a5bba5f4511c admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:48.272031 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e912f6b-c68f-41cf-8528-a5bba5f4511c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:48.274005 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e912f6b-c68f-41cf-8528-a5bba5f4511c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:48.303550 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 927/1853] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:33:48 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:33:48.304673 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863fdb9-fe98-462a-a066-3459397d354e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:48.306258 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4863fdb9-fe98-462a-a066-3459397d354e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:48.320839 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863fdb9-fe98-462a-a066-3459397d354e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:48.386645 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a6ba8-2023-4729-b83c-b88b7017912e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:48.387652 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a6ba8-2023-4729-b83c-b88b7017912e admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:48.387927 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a6ba8-2023-4729-b83c-b88b7017912e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:48.388284 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a6ba8-2023-4729-b83c-b88b7017912e admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:48.389111 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a6ba8-2023-4729-b83c-b88b7017912e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:48.391243 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a6ba8-2023-4729-b83c-b88b7017912e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:48.415326 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 927/1854] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:33:48 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:33:48.420472 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e912f6b-c68f-41cf-8528-a5bba5f4511c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:48.432831 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e912f6b-c68f-41cf-8528-a5bba5f4511c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:48.438456 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcce893-7b87-4550-a4de-33288cc6a29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:48.439182 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcce893-7b87-4550-a4de-33288cc6a29d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:48.439534 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcce893-7b87-4550-a4de-33288cc6a29d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:48.439875 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcce893-7b87-4550-a4de-33288cc6a29d admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:48.440698 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcce893-7b87-4550-a4de-33288cc6a29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:48.442482 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcce893-7b87-4550-a4de-33288cc6a29d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:48.453047 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 928/1855] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:48.457313 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a6ba8-2023-4729-b83c-b88b7017912e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:48.467428 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a6ba8-2023-4729-b83c-b88b7017912e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:48.472249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e8927-ef13-4a38-bdfb-e4da3cf35703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:48.473195 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e8927-ef13-4a38-bdfb-e4da3cf35703 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:48.473525 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e8927-ef13-4a38-bdfb-e4da3cf35703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:48.473821 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e8927-ef13-4a38-bdfb-e4da3cf35703 admin admin] PATH_INFO: `/v3/projects/7abca0ffaea04cf7ad742d93d68da08a/users/8a2cb9622b1e42c9a0b5b275321c5c47/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:48.488677 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e8927-ef13-4a38-bdfb-e4da3cf35703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7abca0ffaea04cf7ad742d93d68da08a, user_id=8a2cb9622b1e42c9a0b5b275321c5c47, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:48.491376 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1e8927-ef13-4a38-bdfb-e4da3cf35703 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:48.506858 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 928/1856] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:48 2022] PUT /identity/v3/projects/7abca0ffaea04cf7ad742d93d68da08a/users/8a2cb9622b1e42c9a0b5b275321c5c47/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:48.510630 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcce893-7b87-4550-a4de-33288cc6a29d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:48.524622 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcce893-7b87-4550-a4de-33288cc6a29d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:48.553730 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e8927-ef13-4a38-bdfb-e4da3cf35703 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:48.555435 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-bc1e8927-ef13-4a38-bdfb-e4da3cf35703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:48.609756 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a3cc0-8c0e-4e27-9ff0-b8a3238c4c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:48.610784 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a3cc0-8c0e-4e27-9ff0-b8a3238c4c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:48.611139 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a3cc0-8c0e-4e27-9ff0-b8a3238c4c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:48.611487 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a3cc0-8c0e-4e27-9ff0-b8a3238c4c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:48.612300 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a3cc0-8c0e-4e27-9ff0-b8a3238c4c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:48.614010 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a3cc0-8c0e-4e27-9ff0-b8a3238c4c69 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:48.625389 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 929/1857] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:48 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:48.629202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a3cc0-8c0e-4e27-9ff0-b8a3238c4c69 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:48.631491 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1e8927-ef13-4a38-bdfb-e4da3cf35703 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:48.636327 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b387a0-bdff-4f50-817b-68f1be361487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:48.637194 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b387a0-bdff-4f50-817b-68f1be361487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:48.637531 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b387a0-bdff-4f50-817b-68f1be361487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:48.637804 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b387a0-bdff-4f50-817b-68f1be361487 admin admin] PATH_INFO: `/v3/projects/816035c3ec834a13b375e7f7f18c2c56` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:48.638979 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a3cc0-8c0e-4e27-9ff0-b8a3238c4c69 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:48.639100 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b387a0-bdff-4f50-817b-68f1be361487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=816035c3ec834a13b375e7f7f18c2c56)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:48.641366 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b387a0-bdff-4f50-817b-68f1be361487 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:48.644027 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc366e-f6d4-46ce-ae56-f71e46fa1073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:48.644897 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc366e-f6d4-46ce-ae56-f71e46fa1073 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:48.645177 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc366e-f6d4-46ce-ae56-f71e46fa1073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:48.645472 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc366e-f6d4-46ce-ae56-f71e46fa1073 admin admin] PATH_INFO: `/v3/projects/7abca0ffaea04cf7ad742d93d68da08a/users/8a2cb9622b1e42c9a0b5b275321c5c47/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:48.647430 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc366e-f6d4-46ce-ae56-f71e46fa1073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7abca0ffaea04cf7ad742d93d68da08a, user_id=8a2cb9622b1e42c9a0b5b275321c5c47, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:48.650231 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc366e-f6d4-46ce-ae56-f71e46fa1073 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:48.661194 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 930/1858] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:48 2022] PUT /identity/v3/projects/7abca0ffaea04cf7ad742d93d68da08a/users/8a2cb9622b1e42c9a0b5b275321c5c47/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:33:48.702777 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5b387a0-bdff-4f50-817b-68f1be361487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816035c3ec834a13b375e7f7f18c2c56', 'request_id': 'req-c5b387a0-bdff-4f50-817b-68f1be361487'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:48.715296 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5b387a0-bdff-4f50-817b-68f1be361487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816035c3ec834a13b375e7f7f18c2c56', 'request_id': 'req-c5b387a0-bdff-4f50-817b-68f1be361487'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:48.723100 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5b387a0-bdff-4f50-817b-68f1be361487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816035c3ec834a13b375e7f7f18c2c56', 'request_id': 'req-c5b387a0-bdff-4f50-817b-68f1be361487'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:48.737284 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5b387a0-bdff-4f50-817b-68f1be361487 admin admin] The token cache is being invalidate because project 816035c3ec834a13b375e7f7f18c2c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:33:48.741369 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5b387a0-bdff-4f50-817b-68f1be361487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:48.742097 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5b387a0-bdff-4f50-817b-68f1be361487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:33:48.743997 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 929/1859] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:33:48 2022] DELETE /identity/v3/projects/816035c3ec834a13b375e7f7f18c2c56 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:48.749962 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb20a8d-0c40-4bf0-8440-6f4dc782cd40 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:48.750458 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb20a8d-0c40-4bf0-8440-6f4dc782cd40 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:48.751175 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb20a8d-0c40-4bf0-8440-6f4dc782cd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:48.772452 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ddb20a8d-0c40-4bf0-8440-6f4dc782cd40 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:48.773814 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ddb20a8d-0c40-4bf0-8440-6f4dc782cd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:48.837515 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 931/1860] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:48.847696 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193ea66-9392-4671-bccb-8cf9e66318cd None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:48.847900 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193ea66-9392-4671-bccb-8cf9e66318cd None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:48.848185 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193ea66-9392-4671-bccb-8cf9e66318cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:48.868817 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-3193ea66-9392-4671-bccb-8cf9e66318cd None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:48.870103 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3193ea66-9392-4671-bccb-8cf9e66318cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:48.878673 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 930/1861] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:48.882915 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb20a8d-0c40-4bf0-8440-6f4dc782cd40 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:48.893203 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb20a8d-0c40-4bf0-8440-6f4dc782cd40 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:48.898135 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b7e30-78af-47f3-b2dc-810de2c76210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:48.898792 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b7e30-78af-47f3-b2dc-810de2c76210 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:48.899204 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b7e30-78af-47f3-b2dc-810de2c76210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:48.899486 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b7e30-78af-47f3-b2dc-810de2c76210 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:48.900215 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b7e30-78af-47f3-b2dc-810de2c76210 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:33:48.900515 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b7e30-78af-47f3-b2dc-810de2c76210 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:48.902333 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b7e30-78af-47f3-b2dc-810de2c76210 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:48.914891 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 932/1862] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:33:48.919885 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193ea66-9392-4671-bccb-8cf9e66318cd None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:48.929156 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193ea66-9392-4671-bccb-8cf9e66318cd None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:48.934341 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071b41c-e9a5-4355-8651-f5a5db1290aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:48.934993 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071b41c-e9a5-4355-8651-f5a5db1290aa admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:48.935272 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071b41c-e9a5-4355-8651-f5a5db1290aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:48.935545 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071b41c-e9a5-4355-8651-f5a5db1290aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:48.936246 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071b41c-e9a5-4355-8651-f5a5db1290aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:48.938186 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071b41c-e9a5-4355-8651-f5a5db1290aa admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:48.967938 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 931/1863] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:33:48 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:33:48.969473 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b7e30-78af-47f3-b2dc-810de2c76210 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:48.979573 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b7e30-78af-47f3-b2dc-810de2c76210 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:49.042730 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1e055-8d46-4b91-8dc6-6beee6079f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:49.044315 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1e055-8d46-4b91-8dc6-6beee6079f88 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:49.044315 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1e055-8d46-4b91-8dc6-6beee6079f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:49.044642 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1e055-8d46-4b91-8dc6-6beee6079f88 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:49.045239 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1e055-8d46-4b91-8dc6-6beee6079f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:49.047662 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1e055-8d46-4b91-8dc6-6beee6079f88 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:49.073535 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 933/1864] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:33:48 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:49.075543 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071b41c-e9a5-4355-8651-f5a5db1290aa admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:49.095135 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071b41c-e9a5-4355-8651-f5a5db1290aa admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:49.104422 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed07c78-954a-4bb8-b14d-4ddd7a2723cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:49.105098 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed07c78-954a-4bb8-b14d-4ddd7a2723cd admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:49.105409 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed07c78-954a-4bb8-b14d-4ddd7a2723cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:49.105685 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed07c78-954a-4bb8-b14d-4ddd7a2723cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:49.106447 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed07c78-954a-4bb8-b14d-4ddd7a2723cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:49.108058 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed07c78-954a-4bb8-b14d-4ddd7a2723cd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:49.127358 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 932/1865] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:49.131794 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1e055-8d46-4b91-8dc6-6beee6079f88 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:49.142704 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1e055-8d46-4b91-8dc6-6beee6079f88 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:49.147542 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907a4ff-bf61-4442-b550-7a54b681e560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:49.148207 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907a4ff-bf61-4442-b550-7a54b681e560 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:49.148489 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907a4ff-bf61-4442-b550-7a54b681e560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:49.148760 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907a4ff-bf61-4442-b550-7a54b681e560 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:49.149520 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907a4ff-bf61-4442-b550-7a54b681e560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:49.151146 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f907a4ff-bf61-4442-b550-7a54b681e560 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:49.162120 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 934/1866] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:49.166412 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed07c78-954a-4bb8-b14d-4ddd7a2723cd admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:49.178691 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed07c78-954a-4bb8-b14d-4ddd7a2723cd admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:49.182384 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cc6f4-cad8-451c-9c44-c1dd2b5abce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:49.183354 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cc6f4-cad8-451c-9c44-c1dd2b5abce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:49.183904 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cc6f4-cad8-451c-9c44-c1dd2b5abce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:49.184079 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cc6f4-cad8-451c-9c44-c1dd2b5abce0 admin admin] PATH_INFO: `/v3/projects/8a48f89f7c84462cb3a83d0c73737bef/users/14999da93f744ccb9aa7d42bba675f0a/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:49.199716 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cc6f4-cad8-451c-9c44-c1dd2b5abce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a48f89f7c84462cb3a83d0c73737bef, user_id=14999da93f744ccb9aa7d42bba675f0a, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:49.203249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1cc6f4-cad8-451c-9c44-c1dd2b5abce0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:49.225504 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 933/1867] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:49 2022] PUT /identity/v3/projects/8a48f89f7c84462cb3a83d0c73737bef/users/14999da93f744ccb9aa7d42bba675f0a/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:49.231743 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedc58e-88e4-4920-b34b-758ef67ef723 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:49.232038 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedc58e-88e4-4920-b34b-758ef67ef723 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:49.232316 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedc58e-88e4-4920-b34b-758ef67ef723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:49.258184 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-efedc58e-88e4-4920-b34b-758ef67ef723 None None] MFA Rules not processed for user `14999da93f744ccb9aa7d42bba675f0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:49.259391 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-efedc58e-88e4-4920-b34b-758ef67ef723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:49.330997 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 935/1868] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:49.335138 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cc6f4-cad8-451c-9c44-c1dd2b5abce0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:49.389312 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56b586-2cd5-439c-984d-8d1af4c0955c None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:49.389610 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56b586-2cd5-439c-984d-8d1af4c0955c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:49.389884 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56b586-2cd5-439c-984d-8d1af4c0955c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:49.418006 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ba56b586-2cd5-439c-984d-8d1af4c0955c None None] MFA Rules not processed for user `8a2cb9622b1e42c9a0b5b275321c5c47`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:49.418217 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cc6f4-cad8-451c-9c44-c1dd2b5abce0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:49.420542 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ba56b586-2cd5-439c-984d-8d1af4c0955c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:49.423694 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b8219-e263-4e36-9e3c-ff44cc044400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:49.424356 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b8219-e263-4e36-9e3c-ff44cc044400 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:49.424637 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b8219-e263-4e36-9e3c-ff44cc044400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:49.424910 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b8219-e263-4e36-9e3c-ff44cc044400 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:49.425644 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b8219-e263-4e36-9e3c-ff44cc044400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:49.427540 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827b8219-e263-4e36-9e3c-ff44cc044400 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:49.464109 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 934/1869] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:33:49 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:49.465010 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b8219-e263-4e36-9e3c-ff44cc044400 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:49.507746 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 936/1870] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:49 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:33:49.517735 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56b586-2cd5-439c-984d-8d1af4c0955c None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:49.520013 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ba56b586-2cd5-439c-984d-8d1af4c0955c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:49.533056 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b8219-e263-4e36-9e3c-ff44cc044400 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:49.538596 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2146c2d-b9e1-4352-a242-ebf20774231f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:49.539381 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2146c2d-b9e1-4352-a242-ebf20774231f admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:49.539792 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2146c2d-b9e1-4352-a242-ebf20774231f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:49.540188 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2146c2d-b9e1-4352-a242-ebf20774231f admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:49.541414 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2146c2d-b9e1-4352-a242-ebf20774231f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:49.543044 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2146c2d-b9e1-4352-a242-ebf20774231f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:49.564666 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 935/1871] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:33:49 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:49.568550 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2146c2d-b9e1-4352-a242-ebf20774231f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:49.578466 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2146c2d-b9e1-4352-a242-ebf20774231f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:49.581461 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56b586-2cd5-439c-984d-8d1af4c0955c None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:49.584575 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15662a13-ebfd-4ef9-b139-f9a05769aa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:49.585322 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15662a13-ebfd-4ef9-b139-f9a05769aa0a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:49.585681 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15662a13-ebfd-4ef9-b139-f9a05769aa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:49.586028 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15662a13-ebfd-4ef9-b139-f9a05769aa0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:49.586820 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15662a13-ebfd-4ef9-b139-f9a05769aa0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:49.588476 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15662a13-ebfd-4ef9-b139-f9a05769aa0a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:49.599295 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 936/1872] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:33:49.603212 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15662a13-ebfd-4ef9-b139-f9a05769aa0a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:49.613435 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15662a13-ebfd-4ef9-b139-f9a05769aa0a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:49.618109 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4385d00-64bb-4a93-9b42-7fe41540d93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:49.618763 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4385d00-64bb-4a93-9b42-7fe41540d93f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:49.619045 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4385d00-64bb-4a93-9b42-7fe41540d93f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:49.619431 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4385d00-64bb-4a93-9b42-7fe41540d93f admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:49.620153 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4385d00-64bb-4a93-9b42-7fe41540d93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:49.621975 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4385d00-64bb-4a93-9b42-7fe41540d93f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:49.631500 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ce3ec-402d-43d2-bb7f-760c78d899b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:49.632173 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ce3ec-402d-43d2-bb7f-760c78d899b3 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:49.632554 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ce3ec-402d-43d2-bb7f-760c78d899b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:49.632722 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ce3ec-402d-43d2-bb7f-760c78d899b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:49.633289 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 937/1873] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:33:49.634623 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0f0ce3ec-402d-43d2-bb7f-760c78d899b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:49.637591 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4385d00-64bb-4a93-9b42-7fe41540d93f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:49.647293 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4385d00-64bb-4a93-9b42-7fe41540d93f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:49.654477 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b7181-34ef-4892-8396-f5e113930909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:49.655439 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b7181-34ef-4892-8396-f5e113930909 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:49.655782 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b7181-34ef-4892-8396-f5e113930909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:49.656142 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b7181-34ef-4892-8396-f5e113930909 admin admin] PATH_INFO: `/v3/projects/9a8fbd7550bd457481787f68978fdcb6/users/02c1c984d7cf4b7dacfd801269cd4def/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:49.674002 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b7181-34ef-4892-8396-f5e113930909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a8fbd7550bd457481787f68978fdcb6, user_id=02c1c984d7cf4b7dacfd801269cd4def, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:49.676640 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b7181-34ef-4892-8396-f5e113930909 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:49.691493 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 938/1874] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:49 2022] PUT /identity/v3/projects/9a8fbd7550bd457481787f68978fdcb6/users/02c1c984d7cf4b7dacfd801269cd4def/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:49.701405 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b4ccc-490c-43a8-a026-15673158b6d2 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:49.701711 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b4ccc-490c-43a8-a026-15673158b6d2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:49.702049 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b4ccc-490c-43a8-a026-15673158b6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:49.704016 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ce3ec-402d-43d2-bb7f-760c78d899b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:49.705782 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ce3ec-402d-43d2-bb7f-760c78d899b3 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:49.720588 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 937/1875] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:33:49.735923 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d72b4ccc-490c-43a8-a026-15673158b6d2 None None] MFA Rules not processed for user `02c1c984d7cf4b7dacfd801269cd4def`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:49.737131 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d72b4ccc-490c-43a8-a026-15673158b6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:49.806465 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 939/1876] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:49.810670 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ce3ec-402d-43d2-bb7f-760c78d899b3 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:49.822893 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ce3ec-402d-43d2-bb7f-760c78d899b3 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:49.885133 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ca3b0-ed98-4f8e-b939-4420025fb3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:49.885828 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ca3b0-ed98-4f8e-b939-4420025fb3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:49.886104 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ca3b0-ed98-4f8e-b939-4420025fb3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:49.886556 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ca3b0-ed98-4f8e-b939-4420025fb3d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:49.887933 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ca3b0-ed98-4f8e-b939-4420025fb3d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:49.889897 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ca3b0-ed98-4f8e-b939-4420025fb3d7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:49.924303 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 938/1877] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:33:49 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:49.928693 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b4ccc-490c-43a8-a026-15673158b6d2 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:49.944528 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b4ccc-490c-43a8-a026-15673158b6d2 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:50.023855 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94f5de-1bdd-4367-898b-dd41b6a5c53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:50.024533 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94f5de-1bdd-4367-898b-dd41b6a5c53d admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:50.024915 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94f5de-1bdd-4367-898b-dd41b6a5c53d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:50.025376 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94f5de-1bdd-4367-898b-dd41b6a5c53d admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:50.025872 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f94f5de-1bdd-4367-898b-dd41b6a5c53d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:50.027748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f94f5de-1bdd-4367-898b-dd41b6a5c53d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:50.050054 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 940/1878] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:33:49 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:33:50.053948 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ca3b0-ed98-4f8e-b939-4420025fb3d7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:50.064187 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ca3b0-ed98-4f8e-b939-4420025fb3d7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:50.068853 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b657ae7-daa8-4a64-a0a2-a5b35b06dc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:50.069518 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b657ae7-daa8-4a64-a0a2-a5b35b06dc90 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:50.069799 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b657ae7-daa8-4a64-a0a2-a5b35b06dc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:50.070068 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b657ae7-daa8-4a64-a0a2-a5b35b06dc90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:50.070792 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b657ae7-daa8-4a64-a0a2-a5b35b06dc90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:50.072392 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b657ae7-daa8-4a64-a0a2-a5b35b06dc90 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:50.083315 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 939/1879] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:33:50.087553 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94f5de-1bdd-4367-898b-dd41b6a5c53d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:50.098400 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94f5de-1bdd-4367-898b-dd41b6a5c53d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:50.103217 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ce785-5437-4628-bbfc-2fff6d68dc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:50.104077 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ce785-5437-4628-bbfc-2fff6d68dc67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:50.104353 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ce785-5437-4628-bbfc-2fff6d68dc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:50.104620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ce785-5437-4628-bbfc-2fff6d68dc67 admin admin] PATH_INFO: `/v3/projects/753f2092ddcf4d7695a725ff7c9fc370/users/4ba63799c8174b12b5a62797a69fc999/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:50.118526 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ce785-5437-4628-bbfc-2fff6d68dc67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=753f2092ddcf4d7695a725ff7c9fc370, user_id=4ba63799c8174b12b5a62797a69fc999, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:50.121158 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ce785-5437-4628-bbfc-2fff6d68dc67 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:50.134496 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 941/1880] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:50 2022] PUT /identity/v3/projects/753f2092ddcf4d7695a725ff7c9fc370/users/4ba63799c8174b12b5a62797a69fc999/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:50.138987 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b657ae7-daa8-4a64-a0a2-a5b35b06dc90 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:50.148917 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b657ae7-daa8-4a64-a0a2-a5b35b06dc90 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:50.203365 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265592f-b9cc-41f8-ac54-b8bf345d79c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:50.204121 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265592f-b9cc-41f8-ac54-b8bf345d79c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:50.204468 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265592f-b9cc-41f8-ac54-b8bf345d79c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:50.204737 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265592f-b9cc-41f8-ac54-b8bf345d79c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:50.205582 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265592f-b9cc-41f8-ac54-b8bf345d79c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:50.207301 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265592f-b9cc-41f8-ac54-b8bf345d79c5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:50.217837 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 940/1881] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:33:50.221954 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ce785-5437-4628-bbfc-2fff6d68dc67 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:50.232167 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ce785-5437-4628-bbfc-2fff6d68dc67 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:50.243313 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45c3c0-116e-4e88-9a48-3d8fbb99a4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:50.244564 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45c3c0-116e-4e88-9a48-3d8fbb99a4f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:50.244921 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45c3c0-116e-4e88-9a48-3d8fbb99a4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:50.245284 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45c3c0-116e-4e88-9a48-3d8fbb99a4f9 admin admin] PATH_INFO: `/v3/projects/753f2092ddcf4d7695a725ff7c9fc370/users/4ba63799c8174b12b5a62797a69fc999/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:50.249083 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45c3c0-116e-4e88-9a48-3d8fbb99a4f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=753f2092ddcf4d7695a725ff7c9fc370, user_id=4ba63799c8174b12b5a62797a69fc999, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:50.253581 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45c3c0-116e-4e88-9a48-3d8fbb99a4f9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:50.276137 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 942/1882] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:33:50 2022] PUT /identity/v3/projects/753f2092ddcf4d7695a725ff7c9fc370/users/4ba63799c8174b12b5a62797a69fc999/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:33:50.278755 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0de9a-7fff-478a-bf0a-de64e45347bb None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:50.279215 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0de9a-7fff-478a-bf0a-de64e45347bb None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:50.279629 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0de9a-7fff-478a-bf0a-de64e45347bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:50.314204 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-46f0de9a-7fff-478a-bf0a-de64e45347bb None None] MFA Rules not processed for user `4ba63799c8174b12b5a62797a69fc999`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:33:50.315422 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-46f0de9a-7fff-478a-bf0a-de64e45347bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:50.384373 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 941/1883] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:33:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:33:50.394942 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45c3c0-116e-4e88-9a48-3d8fbb99a4f9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:50.396685 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1a45c3c0-116e-4e88-9a48-3d8fbb99a4f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:33:50.450429 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45c3c0-116e-4e88-9a48-3d8fbb99a4f9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:50.454020 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583e40c-ebfe-4fa9-9530-c1374b25ba69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:50.454636 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583e40c-ebfe-4fa9-9530-c1374b25ba69 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:50.454911 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583e40c-ebfe-4fa9-9530-c1374b25ba69 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:50.455179 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583e40c-ebfe-4fa9-9530-c1374b25ba69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:50.508588 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583e40c-ebfe-4fa9-9530-c1374b25ba69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:50.510123 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583e40c-ebfe-4fa9-9530-c1374b25ba69 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:50.519876 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 943/1884] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:52.144963 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0de9a-7fff-478a-bf0a-de64e45347bb None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:52.154046 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0de9a-7fff-478a-bf0a-de64e45347bb None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:52.157656 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd0fb2-4fcd-4640-bc3b-4f89c57b1b72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:52.158287 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd0fb2-4fcd-4640-bc3b-4f89c57b1b72 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:52.158566 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd0fb2-4fcd-4640-bc3b-4f89c57b1b72 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:52.158836 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd0fb2-4fcd-4640-bc3b-4f89c57b1b72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:52.218726 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd0fb2-4fcd-4640-bc3b-4f89c57b1b72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:52.220327 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd0fb2-4fcd-4640-bc3b-4f89c57b1b72 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:52.229880 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 942/1885] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:52 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:53.361659 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583e40c-ebfe-4fa9-9530-c1374b25ba69 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:53.371456 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583e40c-ebfe-4fa9-9530-c1374b25ba69 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:53.375350 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169b677-15ab-4b7a-9cb1-0e15753fc8d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:53.376092 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169b677-15ab-4b7a-9cb1-0e15753fc8d8 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:53.376435 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169b677-15ab-4b7a-9cb1-0e15753fc8d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:53.376780 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169b677-15ab-4b7a-9cb1-0e15753fc8d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:53.442177 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169b677-15ab-4b7a-9cb1-0e15753fc8d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:53.443779 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c169b677-15ab-4b7a-9cb1-0e15753fc8d8 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:53.453681 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 944/1886] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:33:56.101471 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd0fb2-4fcd-4640-bc3b-4f89c57b1b72 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:33:56.110848 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd0fb2-4fcd-4640-bc3b-4f89c57b1b72 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:33:56.114688 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ffa10-6ea9-4897-ac4f-1a754f7e55fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:33:56.115335 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ffa10-6ea9-4897-ac4f-1a754f7e55fe service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:33:56.115610 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ffa10-6ea9-4897-ac4f-1a754f7e55fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:33:56.115883 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ffa10-6ea9-4897-ac4f-1a754f7e55fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:33:56.126319 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ffa10-6ea9-4897-ac4f-1a754f7e55fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:33:56.127780 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ffa10-6ea9-4897-ac4f-1a754f7e55fe service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:33:56.137338 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 943/1887] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:33:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:00.003036 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169b677-15ab-4b7a-9cb1-0e15753fc8d8 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:00.065487 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169b677-15ab-4b7a-9cb1-0e15753fc8d8 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:00.070028 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce677c-1cd2-4481-8f05-71569b1b6135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:00.070882 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce677c-1cd2-4481-8f05-71569b1b6135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:00.071162 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce677c-1cd2-4481-8f05-71569b1b6135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:00.071432 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce677c-1cd2-4481-8f05-71569b1b6135 admin admin] PATH_INFO: `/v3/users/14999da93f744ccb9aa7d42bba675f0a` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:00.072718 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce677c-1cd2-4481-8f05-71569b1b6135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14999da93f744ccb9aa7d42bba675f0a)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:00.074656 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce677c-1cd2-4481-8f05-71569b1b6135 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:00.119715 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-46ce677c-1cd2-4481-8f05-71569b1b6135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14999da93f744ccb9aa7d42bba675f0a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:00.126394 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-46ce677c-1cd2-4481-8f05-71569b1b6135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14999da93f744ccb9aa7d42bba675f0a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:00.137981 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-46ce677c-1cd2-4481-8f05-71569b1b6135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14999da93f744ccb9aa7d42bba675f0a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:00.138682 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-46ce677c-1cd2-4481-8f05-71569b1b6135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14999da93f744ccb9aa7d42bba675f0a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:00.139292 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-46ce677c-1cd2-4481-8f05-71569b1b6135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14999da93f744ccb9aa7d42bba675f0a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:00.152291 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 945/1888] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:00 2022] DELETE /identity/v3/users/14999da93f744ccb9aa7d42bba675f0a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:00.157288 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e4515-07d4-4762-922e-e8f1f57cf003 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:00.157755 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e4515-07d4-4762-922e-e8f1f57cf003 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:00.157882 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e4515-07d4-4762-922e-e8f1f57cf003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:00.175381 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-fc2e4515-07d4-4762-922e-e8f1f57cf003 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:00.176597 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fc2e4515-07d4-4762-922e-e8f1f57cf003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:00.240647 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 944/1889] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:00.250920 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce677c-1cd2-4481-8f05-71569b1b6135 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:00.252370 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-46ce677c-1cd2-4481-8f05-71569b1b6135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:00.311588 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce677c-1cd2-4481-8f05-71569b1b6135 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:00.315288 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd14049-a2d4-4063-a1d5-b127c99cfb99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:00.315975 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd14049-a2d4-4063-a1d5-b127c99cfb99 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:00.316221 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd14049-a2d4-4063-a1d5-b127c99cfb99 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:00.316502 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd14049-a2d4-4063-a1d5-b127c99cfb99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:00.325479 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd14049-a2d4-4063-a1d5-b127c99cfb99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:00.326902 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd14049-a2d4-4063-a1d5-b127c99cfb99 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:00.336440 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 946/1890] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:00.616302 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e4515-07d4-4762-922e-e8f1f57cf003 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:00.617828 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fc2e4515-07d4-4762-922e-e8f1f57cf003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:00.634888 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e4515-07d4-4762-922e-e8f1f57cf003 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:00.641546 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a531d-c72f-4380-ab52-257b56d195f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:00.642528 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a531d-c72f-4380-ab52-257b56d195f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:00.642953 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a531d-c72f-4380-ab52-257b56d195f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:00.643762 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a531d-c72f-4380-ab52-257b56d195f6 admin admin] PATH_INFO: `/v3/projects/8a48f89f7c84462cb3a83d0c73737bef` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:00.656703 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a531d-c72f-4380-ab52-257b56d195f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a48f89f7c84462cb3a83d0c73737bef)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:00.660228 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a531d-c72f-4380-ab52-257b56d195f6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:00.719275 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e61a531d-c72f-4380-ab52-257b56d195f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a48f89f7c84462cb3a83d0c73737bef', 'request_id': 'req-e61a531d-c72f-4380-ab52-257b56d195f6'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:00.730102 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e61a531d-c72f-4380-ab52-257b56d195f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a48f89f7c84462cb3a83d0c73737bef', 'request_id': 'req-e61a531d-c72f-4380-ab52-257b56d195f6'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:00.735845 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e61a531d-c72f-4380-ab52-257b56d195f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a48f89f7c84462cb3a83d0c73737bef', 'request_id': 'req-e61a531d-c72f-4380-ab52-257b56d195f6'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:00.746928 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e61a531d-c72f-4380-ab52-257b56d195f6 admin admin] The token cache is being invalidate because project 8a48f89f7c84462cb3a83d0c73737bef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:00.747771 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e61a531d-c72f-4380-ab52-257b56d195f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:00.748725 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e61a531d-c72f-4380-ab52-257b56d195f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:00.750331 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 945/1891] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:00 2022] DELETE /identity/v3/projects/8a48f89f7c84462cb3a83d0c73737bef => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:00.754333 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd14049-a2d4-4063-a1d5-b127c99cfb99 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:00.766803 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd14049-a2d4-4063-a1d5-b127c99cfb99 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:00.823207 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edc024-8fc9-4ddf-9c1d-79f06bb81c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:00.824153 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edc024-8fc9-4ddf-9c1d-79f06bb81c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:00.824533 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edc024-8fc9-4ddf-9c1d-79f06bb81c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:00.824796 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edc024-8fc9-4ddf-9c1d-79f06bb81c36 admin admin] PATH_INFO: `/v3/users/02c1c984d7cf4b7dacfd801269cd4def` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:00.826651 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edc024-8fc9-4ddf-9c1d-79f06bb81c36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c1c984d7cf4b7dacfd801269cd4def)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:00.828797 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edc024-8fc9-4ddf-9c1d-79f06bb81c36 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:00.875400 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e5edc024-8fc9-4ddf-9c1d-79f06bb81c36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c1c984d7cf4b7dacfd801269cd4def'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:00.884354 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e5edc024-8fc9-4ddf-9c1d-79f06bb81c36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c1c984d7cf4b7dacfd801269cd4def'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:00.896204 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e5edc024-8fc9-4ddf-9c1d-79f06bb81c36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c1c984d7cf4b7dacfd801269cd4def'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:00.897510 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e5edc024-8fc9-4ddf-9c1d-79f06bb81c36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c1c984d7cf4b7dacfd801269cd4def'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:00.898118 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e5edc024-8fc9-4ddf-9c1d-79f06bb81c36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c1c984d7cf4b7dacfd801269cd4def'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:00.914604 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 947/1892] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:00 2022] DELETE /identity/v3/users/02c1c984d7cf4b7dacfd801269cd4def => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:00.974123 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a531d-c72f-4380-ab52-257b56d195f6 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:00.975558 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e61a531d-c72f-4380-ab52-257b56d195f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:00.993566 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a531d-c72f-4380-ab52-257b56d195f6 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:01.062749 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26e0f9-cff2-4649-947b-ad998cd031eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:01.063765 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26e0f9-cff2-4649-947b-ad998cd031eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:01.064347 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26e0f9-cff2-4649-947b-ad998cd031eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:01.064814 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26e0f9-cff2-4649-947b-ad998cd031eb admin admin] PATH_INFO: `/v3/users/98e2edf749084c34a65d46a8834a0441` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:01.066758 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26e0f9-cff2-4649-947b-ad998cd031eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e2edf749084c34a65d46a8834a0441)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:01.069222 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26e0f9-cff2-4649-947b-ad998cd031eb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:01.141693 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9c26e0f9-cff2-4649-947b-ad998cd031eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e2edf749084c34a65d46a8834a0441'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:01.162155 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9c26e0f9-cff2-4649-947b-ad998cd031eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e2edf749084c34a65d46a8834a0441'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:01.163510 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9c26e0f9-cff2-4649-947b-ad998cd031eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e2edf749084c34a65d46a8834a0441'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:01.164253 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9c26e0f9-cff2-4649-947b-ad998cd031eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e2edf749084c34a65d46a8834a0441'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:01.176103 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9c26e0f9-cff2-4649-947b-ad998cd031eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e2edf749084c34a65d46a8834a0441'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:01.196478 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 946/1893] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:00 2022] DELETE /identity/v3/users/98e2edf749084c34a65d46a8834a0441 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:01.201305 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66320c-0c65-413d-9ee0-6b06b204ea3a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:01.202113 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66320c-0c65-413d-9ee0-6b06b204ea3a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:01.202522 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a66320c-0c65-413d-9ee0-6b06b204ea3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:01.246385 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-8a66320c-0c65-413d-9ee0-6b06b204ea3a None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:01.249711 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8a66320c-0c65-413d-9ee0-6b06b204ea3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:01.354007 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 948/1894] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:01.366878 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26e0f9-cff2-4649-947b-ad998cd031eb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:01.368974 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9c26e0f9-cff2-4649-947b-ad998cd031eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:01.392973 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66320c-0c65-413d-9ee0-6b06b204ea3a None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:01.394499 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8a66320c-0c65-413d-9ee0-6b06b204ea3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:01.409539 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a66320c-0c65-413d-9ee0-6b06b204ea3a None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:01.426065 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52817ab4-bfa8-4aeb-ace1-8cbe96fc0927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:01.427284 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52817ab4-bfa8-4aeb-ace1-8cbe96fc0927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:01.427711 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52817ab4-bfa8-4aeb-ace1-8cbe96fc0927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:01.428153 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52817ab4-bfa8-4aeb-ace1-8cbe96fc0927 admin admin] PATH_INFO: `/v3/projects/9a8fbd7550bd457481787f68978fdcb6` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:01.429641 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52817ab4-bfa8-4aeb-ace1-8cbe96fc0927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a8fbd7550bd457481787f68978fdcb6)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:01.433597 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52817ab4-bfa8-4aeb-ace1-8cbe96fc0927 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:01.457567 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26e0f9-cff2-4649-947b-ad998cd031eb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:01.461708 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5bfbdb-8581-4fb5-a78f-5b9796c52c9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:01.462494 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bfbdb-8581-4fb5-a78f-5b9796c52c9c service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:01.462871 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bfbdb-8581-4fb5-a78f-5b9796c52c9c service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:01.463471 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bfbdb-8581-4fb5-a78f-5b9796c52c9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:01.473663 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5bfbdb-8581-4fb5-a78f-5b9796c52c9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:01.475465 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5bfbdb-8581-4fb5-a78f-5b9796c52c9c service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:01.486309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 947/1895] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:01.503427 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-52817ab4-bfa8-4aeb-ace1-8cbe96fc0927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a8fbd7550bd457481787f68978fdcb6', 'request_id': 'req-52817ab4-bfa8-4aeb-ace1-8cbe96fc0927'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:01.514226 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-52817ab4-bfa8-4aeb-ace1-8cbe96fc0927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a8fbd7550bd457481787f68978fdcb6', 'request_id': 'req-52817ab4-bfa8-4aeb-ace1-8cbe96fc0927'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:01.521018 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-52817ab4-bfa8-4aeb-ace1-8cbe96fc0927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a8fbd7550bd457481787f68978fdcb6', 'request_id': 'req-52817ab4-bfa8-4aeb-ace1-8cbe96fc0927'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:01.533677 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-52817ab4-bfa8-4aeb-ace1-8cbe96fc0927 admin admin] The token cache is being invalidate because project 9a8fbd7550bd457481787f68978fdcb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:01.533925 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-52817ab4-bfa8-4aeb-ace1-8cbe96fc0927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:01.534829 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-52817ab4-bfa8-4aeb-ace1-8cbe96fc0927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:01.537155 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 949/1896] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:01 2022] DELETE /identity/v3/projects/9a8fbd7550bd457481787f68978fdcb6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:01.541498 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5bfbdb-8581-4fb5-a78f-5b9796c52c9c service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:01.553939 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5bfbdb-8581-4fb5-a78f-5b9796c52c9c service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:01.624656 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211af57a-de31-4562-ad65-63934d74fe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:01.626341 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211af57a-de31-4562-ad65-63934d74fe56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:01.626624 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211af57a-de31-4562-ad65-63934d74fe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:01.626923 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211af57a-de31-4562-ad65-63934d74fe56 admin admin] PATH_INFO: `/v3/users/4ba63799c8174b12b5a62797a69fc999` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:01.628191 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211af57a-de31-4562-ad65-63934d74fe56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba63799c8174b12b5a62797a69fc999)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:01.630199 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211af57a-de31-4562-ad65-63934d74fe56 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:01.705021 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-211af57a-de31-4562-ad65-63934d74fe56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba63799c8174b12b5a62797a69fc999'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:01.728187 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-211af57a-de31-4562-ad65-63934d74fe56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba63799c8174b12b5a62797a69fc999'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:01.729512 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-211af57a-de31-4562-ad65-63934d74fe56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba63799c8174b12b5a62797a69fc999'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:01.730417 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-211af57a-de31-4562-ad65-63934d74fe56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba63799c8174b12b5a62797a69fc999'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:01.748737 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-211af57a-de31-4562-ad65-63934d74fe56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba63799c8174b12b5a62797a69fc999'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:01.766388 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 948/1897] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:01 2022] DELETE /identity/v3/users/4ba63799c8174b12b5a62797a69fc999 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:01.833123 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52817ab4-bfa8-4aeb-ace1-8cbe96fc0927 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:01.834775 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-52817ab4-bfa8-4aeb-ace1-8cbe96fc0927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:01.852095 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52817ab4-bfa8-4aeb-ace1-8cbe96fc0927 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:01.923332 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829a1ea-5fae-4cec-be1a-a8c1374687f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:01.924638 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829a1ea-5fae-4cec-be1a-a8c1374687f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:01.925664 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829a1ea-5fae-4cec-be1a-a8c1374687f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:01.926120 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7829a1ea-5fae-4cec-be1a-a8c1374687f9 admin admin] PATH_INFO: `/v3/projects/775bc73e70d64e63acd9a277aa9e2bcc` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:01.927750 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829a1ea-5fae-4cec-be1a-a8c1374687f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=775bc73e70d64e63acd9a277aa9e2bcc)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:01.930242 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7829a1ea-5fae-4cec-be1a-a8c1374687f9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:01.988130 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7829a1ea-5fae-4cec-be1a-a8c1374687f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '775bc73e70d64e63acd9a277aa9e2bcc', 'request_id': 'req-7829a1ea-5fae-4cec-be1a-a8c1374687f9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:01.998318 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7829a1ea-5fae-4cec-be1a-a8c1374687f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '775bc73e70d64e63acd9a277aa9e2bcc', 'request_id': 'req-7829a1ea-5fae-4cec-be1a-a8c1374687f9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:02.004541 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7829a1ea-5fae-4cec-be1a-a8c1374687f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '775bc73e70d64e63acd9a277aa9e2bcc', 'request_id': 'req-7829a1ea-5fae-4cec-be1a-a8c1374687f9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:02.022191 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7829a1ea-5fae-4cec-be1a-a8c1374687f9 admin admin] The token cache is being invalidate because project 775bc73e70d64e63acd9a277aa9e2bcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:02.022478 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7829a1ea-5fae-4cec-be1a-a8c1374687f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:02.023149 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7829a1ea-5fae-4cec-be1a-a8c1374687f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:02.024954 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 950/1898] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:01 2022] DELETE /identity/v3/projects/775bc73e70d64e63acd9a277aa9e2bcc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:02.029198 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211af57a-de31-4562-ad65-63934d74fe56 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:02.030772 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-211af57a-de31-4562-ad65-63934d74fe56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:02.045686 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211af57a-de31-4562-ad65-63934d74fe56 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:02.110530 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829a1ea-5fae-4cec-be1a-a8c1374687f9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:02.112045 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7829a1ea-5fae-4cec-be1a-a8c1374687f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:02.151566 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45818043-5966-4e29-a9ae-eaceba6d4343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:02.152619 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45818043-5966-4e29-a9ae-eaceba6d4343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:02.152895 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45818043-5966-4e29-a9ae-eaceba6d4343 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:02.153173 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45818043-5966-4e29-a9ae-eaceba6d4343 admin admin] PATH_INFO: `/v3/users/b32b3ff130184b4d87a9e7eed1225f96` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:02.155066 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45818043-5966-4e29-a9ae-eaceba6d4343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b32b3ff130184b4d87a9e7eed1225f96)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:02.157356 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45818043-5966-4e29-a9ae-eaceba6d4343 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:02.194334 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7829a1ea-5fae-4cec-be1a-a8c1374687f9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:02.200260 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e197c37-e8b1-4f2a-bd77-ec944c82f09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:02.201462 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e197c37-e8b1-4f2a-bd77-ec944c82f09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:02.202007 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e197c37-e8b1-4f2a-bd77-ec944c82f09c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:02.202097 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e197c37-e8b1-4f2a-bd77-ec944c82f09c admin admin] PATH_INFO: `/v3/projects/753f2092ddcf4d7695a725ff7c9fc370` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:02.203728 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e197c37-e8b1-4f2a-bd77-ec944c82f09c admin admin] RBAC: Authorizing `identity:delete_project(project_id=753f2092ddcf4d7695a725ff7c9fc370)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:02.205659 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e197c37-e8b1-4f2a-bd77-ec944c82f09c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:02.211039 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-45818043-5966-4e29-a9ae-eaceba6d4343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b32b3ff130184b4d87a9e7eed1225f96'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:02.224003 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-45818043-5966-4e29-a9ae-eaceba6d4343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b32b3ff130184b4d87a9e7eed1225f96'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:02.226097 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-45818043-5966-4e29-a9ae-eaceba6d4343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b32b3ff130184b4d87a9e7eed1225f96'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:02.226574 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-45818043-5966-4e29-a9ae-eaceba6d4343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b32b3ff130184b4d87a9e7eed1225f96'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:02.236310 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-45818043-5966-4e29-a9ae-eaceba6d4343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b32b3ff130184b4d87a9e7eed1225f96'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:02.254762 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 949/1899] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:02 2022] DELETE /identity/v3/users/b32b3ff130184b4d87a9e7eed1225f96 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:34:02.281724 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7e197c37-e8b1-4f2a-bd77-ec944c82f09c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '753f2092ddcf4d7695a725ff7c9fc370', 'request_id': 'req-7e197c37-e8b1-4f2a-bd77-ec944c82f09c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:02.292893 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7e197c37-e8b1-4f2a-bd77-ec944c82f09c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '753f2092ddcf4d7695a725ff7c9fc370', 'request_id': 'req-7e197c37-e8b1-4f2a-bd77-ec944c82f09c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:02.302168 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7e197c37-e8b1-4f2a-bd77-ec944c82f09c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '753f2092ddcf4d7695a725ff7c9fc370', 'request_id': 'req-7e197c37-e8b1-4f2a-bd77-ec944c82f09c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:02.321213 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7e197c37-e8b1-4f2a-bd77-ec944c82f09c admin admin] The token cache is being invalidate because project 753f2092ddcf4d7695a725ff7c9fc370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:02.321904 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7e197c37-e8b1-4f2a-bd77-ec944c82f09c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:02.322693 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7e197c37-e8b1-4f2a-bd77-ec944c82f09c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:02.325072 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 951/1900] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:02 2022] DELETE /identity/v3/projects/753f2092ddcf4d7695a725ff7c9fc370 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:34:02.332553 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83945242-f307-431d-a3d6-18dc510bc742 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:02.332825 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83945242-f307-431d-a3d6-18dc510bc742 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:02.333026 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83945242-f307-431d-a3d6-18dc510bc742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:02.355535 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-83945242-f307-431d-a3d6-18dc510bc742 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:02.357417 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-83945242-f307-431d-a3d6-18dc510bc742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:02.432205 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 950/1901] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:34:02.440346 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94400f20-7f01-4812-91a6-977c209bd61c None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:02.440662 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94400f20-7f01-4812-91a6-977c209bd61c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:02.440941 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94400f20-7f01-4812-91a6-977c209bd61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:02.489231 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-94400f20-7f01-4812-91a6-977c209bd61c None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:02.490520 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-94400f20-7f01-4812-91a6-977c209bd61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:02.514552 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 952/1902] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:02.514633 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83945242-f307-431d-a3d6-18dc510bc742 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:02.522464 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83945242-f307-431d-a3d6-18dc510bc742 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:02.536041 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89e28f-4ab7-4924-95b3-d1b429413595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:02.536990 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89e28f-4ab7-4924-95b3-d1b429413595 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:02.537406 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89e28f-4ab7-4924-95b3-d1b429413595 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:02.537686 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89e28f-4ab7-4924-95b3-d1b429413595 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:02.538425 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89e28f-4ab7-4924-95b3-d1b429413595 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:34:02.539300 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89e28f-4ab7-4924-95b3-d1b429413595 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:02.541986 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89e28f-4ab7-4924-95b3-d1b429413595 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:02.559190 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 951/1903] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:34:02.560782 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94400f20-7f01-4812-91a6-977c209bd61c None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:02.572731 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94400f20-7f01-4812-91a6-977c209bd61c None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:02.579500 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89d89b-35ae-44c6-bc88-8639cccdb380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:02.580358 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89d89b-35ae-44c6-bc88-8639cccdb380 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:02.581366 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89d89b-35ae-44c6-bc88-8639cccdb380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:02.581652 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89d89b-35ae-44c6-bc88-8639cccdb380 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:02.582416 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89d89b-35ae-44c6-bc88-8639cccdb380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:02.584410 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89d89b-35ae-44c6-bc88-8639cccdb380 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:02.615729 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 953/1904] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:34:02 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:34:02.621969 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89e28f-4ab7-4924-95b3-d1b429413595 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:02.647192 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89e28f-4ab7-4924-95b3-d1b429413595 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:02.649023 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89d89b-35ae-44c6-bc88-8639cccdb380 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:02.651514 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4a89d89b-35ae-44c6-bc88-8639cccdb380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:02.743317 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66d712-c3e4-4bfb-915e-3ddcf7768157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:02.744173 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66d712-c3e4-4bfb-915e-3ddcf7768157 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:02.744712 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66d712-c3e4-4bfb-915e-3ddcf7768157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:02.745041 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66d712-c3e4-4bfb-915e-3ddcf7768157 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:02.745867 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66d712-c3e4-4bfb-915e-3ddcf7768157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:02.748013 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66d712-c3e4-4bfb-915e-3ddcf7768157 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:02.774395 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 952/1905] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:34:02 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:34:02.780838 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66d712-c3e4-4bfb-915e-3ddcf7768157 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:02.785632 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89d89b-35ae-44c6-bc88-8639cccdb380 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:02.798702 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095145a9-720b-40ad-a2d3-3b421e9ca7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:02.799828 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095145a9-720b-40ad-a2d3-3b421e9ca7f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:02.800351 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095145a9-720b-40ad-a2d3-3b421e9ca7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:02.800773 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66d712-c3e4-4bfb-915e-3ddcf7768157 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:02.800987 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095145a9-720b-40ad-a2d3-3b421e9ca7f0 admin admin] PATH_INFO: `/v3/projects/e464e39705274f559ac550b0bb42301d` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:02.802386 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095145a9-720b-40ad-a2d3-3b421e9ca7f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e464e39705274f559ac550b0bb42301d)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:02.804609 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095145a9-720b-40ad-a2d3-3b421e9ca7f0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:02.809135 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca7ee6-b7ea-48bb-ae7e-9c10a23b157c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:02.810406 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca7ee6-b7ea-48bb-ae7e-9c10a23b157c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:02.811013 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca7ee6-b7ea-48bb-ae7e-9c10a23b157c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:02.811475 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca7ee6-b7ea-48bb-ae7e-9c10a23b157c admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:02.813226 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca7ee6-b7ea-48bb-ae7e-9c10a23b157c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:02.817699 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca7ee6-b7ea-48bb-ae7e-9c10a23b157c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:02.844811 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 953/1906] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:02.847022 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca7ee6-b7ea-48bb-ae7e-9c10a23b157c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:02.864107 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca7ee6-b7ea-48bb-ae7e-9c10a23b157c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:02.873668 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-095145a9-720b-40ad-a2d3-3b421e9ca7f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e464e39705274f559ac550b0bb42301d', 'request_id': 'req-095145a9-720b-40ad-a2d3-3b421e9ca7f0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:02.882532 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-095145a9-720b-40ad-a2d3-3b421e9ca7f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e464e39705274f559ac550b0bb42301d', 'request_id': 'req-095145a9-720b-40ad-a2d3-3b421e9ca7f0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:02.899363 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-095145a9-720b-40ad-a2d3-3b421e9ca7f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e464e39705274f559ac550b0bb42301d', 'request_id': 'req-095145a9-720b-40ad-a2d3-3b421e9ca7f0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:02.925366 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-095145a9-720b-40ad-a2d3-3b421e9ca7f0 admin admin] The token cache is being invalidate because project e464e39705274f559ac550b0bb42301d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:02.926521 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-095145a9-720b-40ad-a2d3-3b421e9ca7f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:02.927961 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-095145a9-720b-40ad-a2d3-3b421e9ca7f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:02.932687 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 954/1907] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:02 2022] DELETE /identity/v3/projects/e464e39705274f559ac550b0bb42301d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:02.938476 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb6c35-2785-4f6d-bda4-eaace6e01970 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:02.938922 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb6c35-2785-4f6d-bda4-eaace6e01970 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:02.939294 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb6c35-2785-4f6d-bda4-eaace6e01970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:02.942882 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b45bd-d40b-446a-86b1-144a65ba7c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:02.943580 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b45bd-d40b-446a-86b1-144a65ba7c3a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:02.943890 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b45bd-d40b-446a-86b1-144a65ba7c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:02.944241 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b45bd-d40b-446a-86b1-144a65ba7c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:02.945010 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b45bd-d40b-446a-86b1-144a65ba7c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:02.946893 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b45bd-d40b-446a-86b1-144a65ba7c3a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:02.962794 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 954/1908] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:34:02.963943 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b45bd-d40b-446a-86b1-144a65ba7c3a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:02.969019 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-94eb6c35-2785-4f6d-bda4-eaace6e01970 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:02.969840 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-eb4b45bd-d40b-446a-86b1-144a65ba7c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:02.970344 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-94eb6c35-2785-4f6d-bda4-eaace6e01970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:02.980223 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 955/1909] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:34:02.987418 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b45bd-d40b-446a-86b1-144a65ba7c3a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:02.988740 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c22b4d-a1b1-437d-9d3a-8db34bd3a6d3 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:02.989032 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c22b4d-a1b1-437d-9d3a-8db34bd3a6d3 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:02.989453 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c22b4d-a1b1-437d-9d3a-8db34bd3a6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:02.994108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c2a77-6855-4115-b00a-8d3316075101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:02.995066 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c2a77-6855-4115-b00a-8d3316075101 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:02.995343 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c2a77-6855-4115-b00a-8d3316075101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:02.995670 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c2a77-6855-4115-b00a-8d3316075101 admin admin] PATH_INFO: `/v3/projects/434acd7d54a24e18a504c01b72599c36/users/7e792fde8d97434b95de7a9b58a41d14/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:03.014276 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d7c22b4d-a1b1-437d-9d3a-8db34bd3a6d3 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:03.017149 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d7c22b4d-a1b1-437d-9d3a-8db34bd3a6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:03.017327 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c2a77-6855-4115-b00a-8d3316075101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=434acd7d54a24e18a504c01b72599c36, user_id=7e792fde8d97434b95de7a9b58a41d14, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:03.022404 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c2a77-6855-4115-b00a-8d3316075101 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:03.032002 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 956/1910] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:03.036666 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c22b4d-a1b1-437d-9d3a-8db34bd3a6d3 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:03.048858 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c22b4d-a1b1-437d-9d3a-8db34bd3a6d3 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:03.061309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 955/1911] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:02 2022] PUT /identity/v3/projects/434acd7d54a24e18a504c01b72599c36/users/7e792fde8d97434b95de7a9b58a41d14/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:03.063046 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e1d8f-1a95-4f1b-ba20-00045c8c80c0 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:03.064232 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e1d8f-1a95-4f1b-ba20-00045c8c80c0 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:03.064746 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314e1d8f-1a95-4f1b-ba20-00045c8c80c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:03.104564 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-314e1d8f-1a95-4f1b-ba20-00045c8c80c0 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:03.106149 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-314e1d8f-1a95-4f1b-ba20-00045c8c80c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:03.134400 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b0e41-0ace-451a-9988-f803b1b8496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:03.135090 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b0e41-0ace-451a-9988-f803b1b8496f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:03.135444 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b0e41-0ace-451a-9988-f803b1b8496f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:03.135791 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b0e41-0ace-451a-9988-f803b1b8496f admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:03.136591 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b0e41-0ace-451a-9988-f803b1b8496f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:34:03.136972 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b0e41-0ace-451a-9988-f803b1b8496f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:03.138734 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b0e41-0ace-451a-9988-f803b1b8496f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:03.155853 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 957/1912] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:34:03.156948 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b0e41-0ace-451a-9988-f803b1b8496f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:03.182332 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b0e41-0ace-451a-9988-f803b1b8496f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:03.198956 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49204c4f-ef25-4a44-ac0a-ee4b25779029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:03.199642 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49204c4f-ef25-4a44-ac0a-ee4b25779029 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:03.200595 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49204c4f-ef25-4a44-ac0a-ee4b25779029 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:03.200898 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49204c4f-ef25-4a44-ac0a-ee4b25779029 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:03.202087 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 956/1913] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:03.202296 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49204c4f-ef25-4a44-ac0a-ee4b25779029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:03.204300 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49204c4f-ef25-4a44-ac0a-ee4b25779029 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:03.205621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e1d8f-1a95-4f1b-ba20-00045c8c80c0 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:03.208551 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-314e1d8f-1a95-4f1b-ba20-00045c8c80c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:03.241850 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 958/1914] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:34:03 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:03.246519 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49204c4f-ef25-4a44-ac0a-ee4b25779029 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:03.283128 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314e1d8f-1a95-4f1b-ba20-00045c8c80c0 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:03.345334 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49204c4f-ef25-4a44-ac0a-ee4b25779029 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:03.352667 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254d805-264f-4c43-a6e8-87b74029e0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:03.354036 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254d805-264f-4c43-a6e8-87b74029e0b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:03.354316 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03735406-04dc-4588-ab31-c68fe75bdf23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:03.354729 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254d805-264f-4c43-a6e8-87b74029e0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:03.355000 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254d805-264f-4c43-a6e8-87b74029e0b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:03.355239 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735406-04dc-4588-ab31-c68fe75bdf23 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:03.355617 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735406-04dc-4588-ab31-c68fe75bdf23 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:03.355735 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254d805-264f-4c43-a6e8-87b74029e0b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:03.356082 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03735406-04dc-4588-ab31-c68fe75bdf23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:03.358953 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254d805-264f-4c43-a6e8-87b74029e0b5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:03.367175 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03735406-04dc-4588-ab31-c68fe75bdf23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:03.368981 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03735406-04dc-4588-ab31-c68fe75bdf23 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:03.381344 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 957/1915] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:03.389195 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 959/1916] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:34:03 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:03.394231 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03735406-04dc-4588-ab31-c68fe75bdf23 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:03.408586 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03735406-04dc-4588-ab31-c68fe75bdf23 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:03.417069 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464a7be-1a71-4cc7-948f-b809cd7f8431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:03.418345 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464a7be-1a71-4cc7-948f-b809cd7f8431 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:03.418780 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464a7be-1a71-4cc7-948f-b809cd7f8431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:03.419340 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464a7be-1a71-4cc7-948f-b809cd7f8431 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:03.420558 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464a7be-1a71-4cc7-948f-b809cd7f8431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:03.423220 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464a7be-1a71-4cc7-948f-b809cd7f8431 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:03.437278 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 958/1917] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:03.441007 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254d805-264f-4c43-a6e8-87b74029e0b5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:03.458186 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254d805-264f-4c43-a6e8-87b74029e0b5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:03.469979 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee654a4b-84f0-4c59-aa94-a7af002ea5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:03.470698 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee654a4b-84f0-4c59-aa94-a7af002ea5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:03.471001 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee654a4b-84f0-4c59-aa94-a7af002ea5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:03.471270 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee654a4b-84f0-4c59-aa94-a7af002ea5e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:03.472049 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee654a4b-84f0-4c59-aa94-a7af002ea5e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:03.474869 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee654a4b-84f0-4c59-aa94-a7af002ea5e5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:03.492865 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 960/1918] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:03.496740 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464a7be-1a71-4cc7-948f-b809cd7f8431 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:03.512852 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464a7be-1a71-4cc7-948f-b809cd7f8431 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:03.524601 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68cdd0-8cee-403f-8768-d1e21d49cdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:03.525705 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68cdd0-8cee-403f-8768-d1e21d49cdcc admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:03.525990 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68cdd0-8cee-403f-8768-d1e21d49cdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:03.526360 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68cdd0-8cee-403f-8768-d1e21d49cdcc admin admin] PATH_INFO: `/v3/projects/8d24de2307be4999bb4b486fe55438fb/users/4b993de511e5492a8baca36262dd59e8/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:03.557967 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68cdd0-8cee-403f-8768-d1e21d49cdcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d24de2307be4999bb4b486fe55438fb, user_id=4b993de511e5492a8baca36262dd59e8, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:03.562751 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68cdd0-8cee-403f-8768-d1e21d49cdcc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:03.589706 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 959/1919] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:03 2022] PUT /identity/v3/projects/8d24de2307be4999bb4b486fe55438fb/users/4b993de511e5492a8baca36262dd59e8/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:03.601313 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e4bc0-39f1-4d87-b5ea-1d5ad9357d06 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:03.601706 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e4bc0-39f1-4d87-b5ea-1d5ad9357d06 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:03.602238 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e4bc0-39f1-4d87-b5ea-1d5ad9357d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:03.669833 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-803e4bc0-39f1-4d87-b5ea-1d5ad9357d06 None None] MFA Rules not processed for user `4b993de511e5492a8baca36262dd59e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:03.671561 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-803e4bc0-39f1-4d87-b5ea-1d5ad9357d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:03.831783 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 961/1920] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:03.835886 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68cdd0-8cee-403f-8768-d1e21d49cdcc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:03.994199 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68cdd0-8cee-403f-8768-d1e21d49cdcc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:04.005014 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fae96-d87a-47b7-a9db-d7dd889afcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:04.006583 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fae96-d87a-47b7-a9db-d7dd889afcd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:04.006878 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fae96-d87a-47b7-a9db-d7dd889afcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:04.007158 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fae96-d87a-47b7-a9db-d7dd889afcd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:04.008853 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fae96-d87a-47b7-a9db-d7dd889afcd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:04.013773 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fae96-d87a-47b7-a9db-d7dd889afcd7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:04.100042 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 960/1921] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:34:03 2022] POST /identity/v3/projects => generated 385 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:04.103869 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e4bc0-39f1-4d87-b5ea-1d5ad9357d06 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:04.128321 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e4bc0-39f1-4d87-b5ea-1d5ad9357d06 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:04.259311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2abae6-dee9-4c93-8a8e-b56dec6fe45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:04.260728 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2abae6-dee9-4c93-8a8e-b56dec6fe45c admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:04.261219 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2abae6-dee9-4c93-8a8e-b56dec6fe45c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:04.261708 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2abae6-dee9-4c93-8a8e-b56dec6fe45c admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:04.262571 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2abae6-dee9-4c93-8a8e-b56dec6fe45c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:04.265429 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2abae6-dee9-4c93-8a8e-b56dec6fe45c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:04.291376 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 962/1922] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:34:04 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:04.294981 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fae96-d87a-47b7-a9db-d7dd889afcd7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:04.313529 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fae96-d87a-47b7-a9db-d7dd889afcd7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:04.319018 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640cf92-22db-428b-990d-dfd2cafc9f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:04.319926 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640cf92-22db-428b-990d-dfd2cafc9f14 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:04.320410 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640cf92-22db-428b-990d-dfd2cafc9f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:04.320864 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640cf92-22db-428b-990d-dfd2cafc9f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:04.321829 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640cf92-22db-428b-990d-dfd2cafc9f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:04.323961 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640cf92-22db-428b-990d-dfd2cafc9f14 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:04.336062 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 961/1923] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:04.340559 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2abae6-dee9-4c93-8a8e-b56dec6fe45c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:04.368766 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2abae6-dee9-4c93-8a8e-b56dec6fe45c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:04.380459 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec013f6-5f0a-460c-a61d-7489d4dd4b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:04.381622 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec013f6-5f0a-460c-a61d-7489d4dd4b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:04.381992 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec013f6-5f0a-460c-a61d-7489d4dd4b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:04.382368 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec013f6-5f0a-460c-a61d-7489d4dd4b7e admin admin] PATH_INFO: `/v3/projects/487ebc15290546acb3eddeb80ef5eebc/users/867d2893da4147c1afe9e91ac2701105/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:04.404648 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec013f6-5f0a-460c-a61d-7489d4dd4b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=487ebc15290546acb3eddeb80ef5eebc, user_id=867d2893da4147c1afe9e91ac2701105, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:04.407865 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec013f6-5f0a-460c-a61d-7489d4dd4b7e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:04.438175 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 963/1924] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:04 2022] PUT /identity/v3/projects/487ebc15290546acb3eddeb80ef5eebc/users/867d2893da4147c1afe9e91ac2701105/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:04.441905 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640cf92-22db-428b-990d-dfd2cafc9f14 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:04.452116 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640cf92-22db-428b-990d-dfd2cafc9f14 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:04.519559 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc501f81-67f3-46b7-96a9-aa69d43fdddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:04.520215 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc501f81-67f3-46b7-96a9-aa69d43fdddd admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:04.520490 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc501f81-67f3-46b7-96a9-aa69d43fdddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:04.520757 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc501f81-67f3-46b7-96a9-aa69d43fdddd admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:04.521513 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc501f81-67f3-46b7-96a9-aa69d43fdddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:04.523130 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc501f81-67f3-46b7-96a9-aa69d43fdddd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:04.535483 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 962/1925] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:34:04.539377 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec013f6-5f0a-460c-a61d-7489d4dd4b7e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:04.551604 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec013f6-5f0a-460c-a61d-7489d4dd4b7e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:04.560855 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25828765-488c-4e67-9f7c-75180f10b3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:04.561846 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25828765-488c-4e67-9f7c-75180f10b3b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:04.562125 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25828765-488c-4e67-9f7c-75180f10b3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:04.562444 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25828765-488c-4e67-9f7c-75180f10b3b0 admin admin] PATH_INFO: `/v3/projects/487ebc15290546acb3eddeb80ef5eebc/users/867d2893da4147c1afe9e91ac2701105/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:04.564834 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25828765-488c-4e67-9f7c-75180f10b3b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=487ebc15290546acb3eddeb80ef5eebc, user_id=867d2893da4147c1afe9e91ac2701105, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:04.567720 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25828765-488c-4e67-9f7c-75180f10b3b0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:04.580359 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 964/1926] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:04 2022] PUT /identity/v3/projects/487ebc15290546acb3eddeb80ef5eebc/users/867d2893da4147c1afe9e91ac2701105/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:04.593926 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f03bbf-696d-4e2e-b6f9-61e82018fd1d None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:04.594314 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f03bbf-696d-4e2e-b6f9-61e82018fd1d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:04.594590 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f03bbf-696d-4e2e-b6f9-61e82018fd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:04.607221 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b04b0-5605-4dd2-aa77-c133ac8a00c4 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:04.607797 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b04b0-5605-4dd2-aa77-c133ac8a00c4 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:04.608272 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b04b0-5605-4dd2-aa77-c133ac8a00c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:04.635561 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-30f03bbf-696d-4e2e-b6f9-61e82018fd1d None None] MFA Rules not processed for user `867d2893da4147c1afe9e91ac2701105`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:04.636840 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-30f03bbf-696d-4e2e-b6f9-61e82018fd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:04.642394 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-6d9b04b0-5605-4dd2-aa77-c133ac8a00c4 None None] MFA Rules not processed for user `7e792fde8d97434b95de7a9b58a41d14`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:04.644665 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6d9b04b0-5605-4dd2-aa77-c133ac8a00c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:04.727750 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 963/1927] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:04.738148 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f03bbf-696d-4e2e-b6f9-61e82018fd1d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:04.740120 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-30f03bbf-696d-4e2e-b6f9-61e82018fd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:04.742627 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 965/1928] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:34:04.798835 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f03bbf-696d-4e2e-b6f9-61e82018fd1d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:04.802921 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffd13b-e91b-4f99-af38-33989f58b538 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:04.803714 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffd13b-e91b-4f99-af38-33989f58b538 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:04.804205 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffd13b-e91b-4f99-af38-33989f58b538 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:04.804547 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffd13b-e91b-4f99-af38-33989f58b538 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:04.814669 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffd13b-e91b-4f99-af38-33989f58b538 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:04.816559 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffd13b-e91b-4f99-af38-33989f58b538 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:04.826896 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 964/1929] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:34:04.914738 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b04b0-5605-4dd2-aa77-c133ac8a00c4 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:04.927413 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b04b0-5605-4dd2-aa77-c133ac8a00c4 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:04.935937 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1524c17-eb14-4ced-85ea-cd70359103f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:04.936592 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1524c17-eb14-4ced-85ea-cd70359103f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:04.936871 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1524c17-eb14-4ced-85ea-cd70359103f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:04.937144 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1524c17-eb14-4ced-85ea-cd70359103f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:04.946457 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1524c17-eb14-4ced-85ea-cd70359103f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:04.947949 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1524c17-eb14-4ced-85ea-cd70359103f7 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:04.957195 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 966/1930] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:05.256609 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffd13b-e91b-4f99-af38-33989f58b538 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:05.324031 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffd13b-e91b-4f99-af38-33989f58b538 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:05.328435 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bc88e-d5a0-41a0-953d-b355e2880b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:05.329809 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bc88e-d5a0-41a0-953d-b355e2880b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:05.330002 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bc88e-d5a0-41a0-953d-b355e2880b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:05.330403 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bc88e-d5a0-41a0-953d-b355e2880b92 admin admin] PATH_INFO: `/v3/users/4b993de511e5492a8baca36262dd59e8` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:05.331577 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bc88e-d5a0-41a0-953d-b355e2880b92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b993de511e5492a8baca36262dd59e8)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:05.342291 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bc88e-d5a0-41a0-953d-b355e2880b92 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:05.398653 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3f5bc88e-d5a0-41a0-953d-b355e2880b92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b993de511e5492a8baca36262dd59e8'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:05.410681 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3f5bc88e-d5a0-41a0-953d-b355e2880b92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b993de511e5492a8baca36262dd59e8'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:05.411356 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3f5bc88e-d5a0-41a0-953d-b355e2880b92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b993de511e5492a8baca36262dd59e8'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:05.412144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3f5bc88e-d5a0-41a0-953d-b355e2880b92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b993de511e5492a8baca36262dd59e8'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:05.430766 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22352c5c-8b05-4c17-ab55-7664a671b17b None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:05.430766 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22352c5c-8b05-4c17-ab55-7664a671b17b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:05.430766 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22352c5c-8b05-4c17-ab55-7664a671b17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:05.432326 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3f5bc88e-d5a0-41a0-953d-b355e2880b92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b993de511e5492a8baca36262dd59e8'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:05.452418 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-22352c5c-8b05-4c17-ab55-7664a671b17b None None] MFA Rules not processed for user `65045a2a88084c12aeb9133bf0162193`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:05.454452 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-22352c5c-8b05-4c17-ab55-7664a671b17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:05.458572 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 965/1931] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:05 2022] DELETE /identity/v3/users/4b993de511e5492a8baca36262dd59e8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:05.466190 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b00d1-3e83-45de-931a-a1dcc944918b None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:05.466621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b00d1-3e83-45de-931a-a1dcc944918b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:05.467029 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b00d1-3e83-45de-931a-a1dcc944918b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:05.490995 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-0e1b00d1-3e83-45de-931a-a1dcc944918b None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:05.492333 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0e1b00d1-3e83-45de-931a-a1dcc944918b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:05.531264 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 967/1932] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:05.577854 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 966/1933] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:34:05.588340 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22352c5c-8b05-4c17-ab55-7664a671b17b None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:05.590019 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-22352c5c-8b05-4c17-ab55-7664a671b17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:05.655976 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22352c5c-8b05-4c17-ab55-7664a671b17b None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:05.730228 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8adb72-cad5-464c-92d4-1d5a368412a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:05.731185 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8adb72-cad5-464c-92d4-1d5a368412a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:05.732165 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8adb72-cad5-464c-92d4-1d5a368412a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:05.732450 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8adb72-cad5-464c-92d4-1d5a368412a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:05.754072 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8adb72-cad5-464c-92d4-1d5a368412a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:05.754287 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8adb72-cad5-464c-92d4-1d5a368412a2 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:05.766164 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 968/1934] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:06.314908 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b00d1-3e83-45de-931a-a1dcc944918b None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:06.316869 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0e1b00d1-3e83-45de-931a-a1dcc944918b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:06.339915 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b00d1-3e83-45de-931a-a1dcc944918b None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:06.362816 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a1793-bed5-431e-b2bd-869f70f46bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:06.363870 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a1793-bed5-431e-b2bd-869f70f46bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:06.364723 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a1793-bed5-431e-b2bd-869f70f46bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:06.364723 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a1793-bed5-431e-b2bd-869f70f46bbf admin admin] PATH_INFO: `/v3/projects/8d24de2307be4999bb4b486fe55438fb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:06.366115 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a1793-bed5-431e-b2bd-869f70f46bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d24de2307be4999bb4b486fe55438fb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:06.368938 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a1793-bed5-431e-b2bd-869f70f46bbf admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:06.437048 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0a6a1793-bed5-431e-b2bd-869f70f46bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d24de2307be4999bb4b486fe55438fb', 'request_id': 'req-0a6a1793-bed5-431e-b2bd-869f70f46bbf'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:06.440448 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595d2ef-2d07-4b9e-9a4b-4375ab4b7a6e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:06.441239 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595d2ef-2d07-4b9e-9a4b-4375ab4b7a6e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:06.441653 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595d2ef-2d07-4b9e-9a4b-4375ab4b7a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:06.446833 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0a6a1793-bed5-431e-b2bd-869f70f46bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d24de2307be4999bb4b486fe55438fb', 'request_id': 'req-0a6a1793-bed5-431e-b2bd-869f70f46bbf'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:06.453827 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0a6a1793-bed5-431e-b2bd-869f70f46bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d24de2307be4999bb4b486fe55438fb', 'request_id': 'req-0a6a1793-bed5-431e-b2bd-869f70f46bbf'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:06.464356 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2595d2ef-2d07-4b9e-9a4b-4375ab4b7a6e None None] MFA Rules not processed for user `7e792fde8d97434b95de7a9b58a41d14`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:06.465434 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0a6a1793-bed5-431e-b2bd-869f70f46bbf admin admin] The token cache is being invalidate because project 8d24de2307be4999bb4b486fe55438fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:06.466087 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0a6a1793-bed5-431e-b2bd-869f70f46bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:06.467243 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0a6a1793-bed5-431e-b2bd-869f70f46bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:06.468739 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2595d2ef-2d07-4b9e-9a4b-4375ab4b7a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:06.469144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 967/1935] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:06 2022] DELETE /identity/v3/projects/8d24de2307be4999bb4b486fe55438fb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:06.473034 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a1793-bed5-431e-b2bd-869f70f46bbf admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:06.474403 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0a6a1793-bed5-431e-b2bd-869f70f46bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:06.536641 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 969/1936] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:34:06.547777 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a1793-bed5-431e-b2bd-869f70f46bbf admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:06.552769 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea8781-8e3e-4761-b7f0-80de8b037ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:06.553796 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea8781-8e3e-4761-b7f0-80de8b037ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:06.554075 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea8781-8e3e-4761-b7f0-80de8b037ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:06.554490 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea8781-8e3e-4761-b7f0-80de8b037ae4 admin admin] PATH_INFO: `/v3/users/867d2893da4147c1afe9e91ac2701105` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:06.555786 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea8781-8e3e-4761-b7f0-80de8b037ae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=867d2893da4147c1afe9e91ac2701105)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:06.557858 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea8781-8e3e-4761-b7f0-80de8b037ae4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:06.607559 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-abea8781-8e3e-4761-b7f0-80de8b037ae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '867d2893da4147c1afe9e91ac2701105'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:06.621016 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-abea8781-8e3e-4761-b7f0-80de8b037ae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '867d2893da4147c1afe9e91ac2701105'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:06.621862 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-abea8781-8e3e-4761-b7f0-80de8b037ae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '867d2893da4147c1afe9e91ac2701105'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:06.623111 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-abea8781-8e3e-4761-b7f0-80de8b037ae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '867d2893da4147c1afe9e91ac2701105'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:06.631332 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-abea8781-8e3e-4761-b7f0-80de8b037ae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '867d2893da4147c1afe9e91ac2701105'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:06.649310 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 968/1937] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:06 2022] DELETE /identity/v3/users/867d2893da4147c1afe9e91ac2701105 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:07.103110 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595d2ef-2d07-4b9e-9a4b-4375ab4b7a6e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:07.128341 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595d2ef-2d07-4b9e-9a4b-4375ab4b7a6e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:07.243818 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ea8b4-35fa-4f1b-b742-2765807c1bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:07.244979 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ea8b4-35fa-4f1b-b742-2765807c1bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:07.245370 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ea8b4-35fa-4f1b-b742-2765807c1bef admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:07.245661 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ea8b4-35fa-4f1b-b742-2765807c1bef admin admin] PATH_INFO: `/v3/projects/487ebc15290546acb3eddeb80ef5eebc` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:07.247221 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ea8b4-35fa-4f1b-b742-2765807c1bef admin admin] RBAC: Authorizing `identity:delete_project(project_id=487ebc15290546acb3eddeb80ef5eebc)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:07.249371 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ea8b4-35fa-4f1b-b742-2765807c1bef admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:07.318089 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-527ea8b4-35fa-4f1b-b742-2765807c1bef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '487ebc15290546acb3eddeb80ef5eebc', 'request_id': 'req-527ea8b4-35fa-4f1b-b742-2765807c1bef'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:07.331760 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-527ea8b4-35fa-4f1b-b742-2765807c1bef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '487ebc15290546acb3eddeb80ef5eebc', 'request_id': 'req-527ea8b4-35fa-4f1b-b742-2765807c1bef'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:07.364923 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-527ea8b4-35fa-4f1b-b742-2765807c1bef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '487ebc15290546acb3eddeb80ef5eebc', 'request_id': 'req-527ea8b4-35fa-4f1b-b742-2765807c1bef'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:07.383781 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-527ea8b4-35fa-4f1b-b742-2765807c1bef admin admin] The token cache is being invalidate because project 487ebc15290546acb3eddeb80ef5eebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:07.384074 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-527ea8b4-35fa-4f1b-b742-2765807c1bef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:07.384736 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-527ea8b4-35fa-4f1b-b742-2765807c1bef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:07.389027 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 970/1938] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:07 2022] DELETE /identity/v3/projects/487ebc15290546acb3eddeb80ef5eebc => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:34:07.395809 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ded01-2237-4a79-afba-e7f88ee56056 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:07.396685 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ded01-2237-4a79-afba-e7f88ee56056 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:07.397021 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ded01-2237-4a79-afba-e7f88ee56056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:07.425717 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-359ded01-2237-4a79-afba-e7f88ee56056 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:07.427103 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-359ded01-2237-4a79-afba-e7f88ee56056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:07.533007 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 969/1939] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:07.536987 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a7f88-048e-4cd9-9825-5ed1c3fb0e58 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:07.538072 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a7f88-048e-4cd9-9825-5ed1c3fb0e58 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:07.538560 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a7f88-048e-4cd9-9825-5ed1c3fb0e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:07.561713 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-ec6a7f88-048e-4cd9-9825-5ed1c3fb0e58 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:07.563208 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ec6a7f88-048e-4cd9-9825-5ed1c3fb0e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:07.573762 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 971/1940] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:07.578570 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ded01-2237-4a79-afba-e7f88ee56056 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:07.589374 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ded01-2237-4a79-afba-e7f88ee56056 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:07.594921 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfff104-860f-4200-aebf-582f9db3e4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:07.595792 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfff104-860f-4200-aebf-582f9db3e4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:07.596568 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfff104-860f-4200-aebf-582f9db3e4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:07.596851 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfff104-860f-4200-aebf-582f9db3e4e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:07.597681 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfff104-860f-4200-aebf-582f9db3e4e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:34:07.598142 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfff104-860f-4200-aebf-582f9db3e4e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:07.600002 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfff104-860f-4200-aebf-582f9db3e4e4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:07.612585 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 970/1941] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:34:07.618521 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a7f88-048e-4cd9-9825-5ed1c3fb0e58 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:07.638856 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a7f88-048e-4cd9-9825-5ed1c3fb0e58 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:07.648292 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9038f1-19c9-455a-8e43-59268c7a4357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:07.650457 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9038f1-19c9-455a-8e43-59268c7a4357 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:07.651077 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9038f1-19c9-455a-8e43-59268c7a4357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:07.651670 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9038f1-19c9-455a-8e43-59268c7a4357 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:07.653691 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9038f1-19c9-455a-8e43-59268c7a4357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:07.658983 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9038f1-19c9-455a-8e43-59268c7a4357 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:07.710808 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 972/1942] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:34:07 2022] POST /identity/v3/projects => generated 407 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:07.714622 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfff104-860f-4200-aebf-582f9db3e4e4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:07.729760 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfff104-860f-4200-aebf-582f9db3e4e4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:07.808070 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408dd46-c69e-4482-b3ef-b86333f233ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:07.808834 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408dd46-c69e-4482-b3ef-b86333f233ef admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:07.809423 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408dd46-c69e-4482-b3ef-b86333f233ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:07.810384 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408dd46-c69e-4482-b3ef-b86333f233ef admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:07.811386 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408dd46-c69e-4482-b3ef-b86333f233ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:07.815780 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408dd46-c69e-4482-b3ef-b86333f233ef admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:07.843545 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 971/1943] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:34:07 2022] POST /identity/v3/users => generated 304 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:07.847928 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9038f1-19c9-455a-8e43-59268c7a4357 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:07.862791 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9038f1-19c9-455a-8e43-59268c7a4357 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:07.871171 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7c856-6184-4a01-ac38-00e344efb49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:07.872679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7c856-6184-4a01-ac38-00e344efb49a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:07.873155 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7c856-6184-4a01-ac38-00e344efb49a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:07.873552 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7c856-6184-4a01-ac38-00e344efb49a admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:07.875489 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7c856-6184-4a01-ac38-00e344efb49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:07.878560 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7c856-6184-4a01-ac38-00e344efb49a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:07.897376 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 973/1944] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:34:07.898865 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408dd46-c69e-4482-b3ef-b86333f233ef admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:07.919661 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408dd46-c69e-4482-b3ef-b86333f233ef admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:07.927267 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a122a-ab8a-4ceb-96a9-fdcbe917a9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:07.928144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a122a-ab8a-4ceb-96a9-fdcbe917a9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:07.928573 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a122a-ab8a-4ceb-96a9-fdcbe917a9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:07.929225 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a122a-ab8a-4ceb-96a9-fdcbe917a9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:07.931032 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a122a-ab8a-4ceb-96a9-fdcbe917a9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:07.934071 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a122a-ab8a-4ceb-96a9-fdcbe917a9a2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:07.948876 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 972/1945] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:07.953707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7c856-6184-4a01-ac38-00e344efb49a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:07.973311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7c856-6184-4a01-ac38-00e344efb49a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:07.978628 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1100783-7089-43b9-ad7f-dc73a3585224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:07.979515 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1100783-7089-43b9-ad7f-dc73a3585224 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:07.979800 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1100783-7089-43b9-ad7f-dc73a3585224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:07.980077 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1100783-7089-43b9-ad7f-dc73a3585224 admin admin] PATH_INFO: `/v3/projects/45f30c74f6574140afeda317063bbd4e/users/57bcfb4a6bcb40d4a5b41bbc37cd8ed1/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:07.997682 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1100783-7089-43b9-ad7f-dc73a3585224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f30c74f6574140afeda317063bbd4e, user_id=57bcfb4a6bcb40d4a5b41bbc37cd8ed1, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:08.000410 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1100783-7089-43b9-ad7f-dc73a3585224 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:08.014101 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 974/1946] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:07 2022] PUT /identity/v3/projects/45f30c74f6574140afeda317063bbd4e/users/57bcfb4a6bcb40d4a5b41bbc37cd8ed1/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:08.024472 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064568a9-d870-4e49-811c-153889e6ae71 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:08.024764 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064568a9-d870-4e49-811c-153889e6ae71 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:08.025041 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064568a9-d870-4e49-811c-153889e6ae71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:08.059161 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-064568a9-d870-4e49-811c-153889e6ae71 None None] MFA Rules not processed for user `57bcfb4a6bcb40d4a5b41bbc37cd8ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:08.061171 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-064568a9-d870-4e49-811c-153889e6ae71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:08.173622 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 973/1947] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:08 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:08.174939 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1100783-7089-43b9-ad7f-dc73a3585224 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:08.237771 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1100783-7089-43b9-ad7f-dc73a3585224 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:08.243510 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa392b-9ad0-414e-840e-e909b99ae059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:08.244487 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa392b-9ad0-414e-840e-e909b99ae059 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:08.244604 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa392b-9ad0-414e-840e-e909b99ae059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:08.244983 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa392b-9ad0-414e-840e-e909b99ae059 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:08.245970 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa392b-9ad0-414e-840e-e909b99ae059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:08.248541 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa392b-9ad0-414e-840e-e909b99ae059 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:08.277322 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 975/1948] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:34:08 2022] POST /identity/v3/projects => generated 409 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:08.281735 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064568a9-d870-4e49-811c-153889e6ae71 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:08.293605 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064568a9-d870-4e49-811c-153889e6ae71 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:08.362037 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058eea18-8226-43b2-b13d-43fb7cef7d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:08.363197 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058eea18-8226-43b2-b13d-43fb7cef7d20 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:08.363197 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058eea18-8226-43b2-b13d-43fb7cef7d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:08.363398 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058eea18-8226-43b2-b13d-43fb7cef7d20 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:08.364075 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058eea18-8226-43b2-b13d-43fb7cef7d20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:08.374281 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058eea18-8226-43b2-b13d-43fb7cef7d20 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:08.397817 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 974/1949] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:34:08 2022] POST /identity/v3/users => generated 311 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:34:08.401878 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa392b-9ad0-414e-840e-e909b99ae059 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:08.413755 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa392b-9ad0-414e-840e-e909b99ae059 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:08.420769 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949873b-fd04-4cc6-97e3-ba583bbd6fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:08.421728 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949873b-fd04-4cc6-97e3-ba583bbd6fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:08.422007 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949873b-fd04-4cc6-97e3-ba583bbd6fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:08.422278 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949873b-fd04-4cc6-97e3-ba583bbd6fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:08.423010 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949873b-fd04-4cc6-97e3-ba583bbd6fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:08.424603 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949873b-fd04-4cc6-97e3-ba583bbd6fe4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:08.438534 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 976/1950] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:08.439727 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058eea18-8226-43b2-b13d-43fb7cef7d20 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:08.449577 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058eea18-8226-43b2-b13d-43fb7cef7d20 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:08.454411 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe73a2-fb03-4b9e-a062-0b70f5b12c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:08.455293 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe73a2-fb03-4b9e-a062-0b70f5b12c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:08.455571 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe73a2-fb03-4b9e-a062-0b70f5b12c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:08.455841 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe73a2-fb03-4b9e-a062-0b70f5b12c62 admin admin] PATH_INFO: `/v3/projects/cc3a18fc19e64ab6b1cc1483c2b14963/users/d45002c105e7462cac6212badea78e9b/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:08.473393 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe73a2-fb03-4b9e-a062-0b70f5b12c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc3a18fc19e64ab6b1cc1483c2b14963, user_id=d45002c105e7462cac6212badea78e9b, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:08.476060 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe73a2-fb03-4b9e-a062-0b70f5b12c62 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:08.492132 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 975/1951] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:08 2022] PUT /identity/v3/projects/cc3a18fc19e64ab6b1cc1483c2b14963/users/d45002c105e7462cac6212badea78e9b/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:08.497663 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949873b-fd04-4cc6-97e3-ba583bbd6fe4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:08.509713 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949873b-fd04-4cc6-97e3-ba583bbd6fe4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:08.597341 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f76cd-a802-4f64-a2b6-63482c64d9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:08.598153 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f76cd-a802-4f64-a2b6-63482c64d9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:08.598510 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f76cd-a802-4f64-a2b6-63482c64d9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:08.598846 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f76cd-a802-4f64-a2b6-63482c64d9d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:08.599634 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f76cd-a802-4f64-a2b6-63482c64d9d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:08.601369 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f76cd-a802-4f64-a2b6-63482c64d9d6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:08.611853 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 977/1952] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:08.616653 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe73a2-fb03-4b9e-a062-0b70f5b12c62 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:08.630604 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe73a2-fb03-4b9e-a062-0b70f5b12c62 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:08.637110 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484fd41-95bd-4b3b-b3b3-a1867a9eb9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:08.638068 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484fd41-95bd-4b3b-b3b3-a1867a9eb9f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:08.638348 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484fd41-95bd-4b3b-b3b3-a1867a9eb9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:08.638765 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484fd41-95bd-4b3b-b3b3-a1867a9eb9f4 admin admin] PATH_INFO: `/v3/projects/cc3a18fc19e64ab6b1cc1483c2b14963/users/d45002c105e7462cac6212badea78e9b/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:08.640707 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484fd41-95bd-4b3b-b3b3-a1867a9eb9f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc3a18fc19e64ab6b1cc1483c2b14963, user_id=d45002c105e7462cac6212badea78e9b, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:08.643379 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484fd41-95bd-4b3b-b3b3-a1867a9eb9f4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:08.658385 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 976/1953] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:08 2022] PUT /identity/v3/projects/cc3a18fc19e64ab6b1cc1483c2b14963/users/d45002c105e7462cac6212badea78e9b/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:08.670053 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d063544-7ed3-44e0-83e4-0c62d63fbf80 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:08.670341 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d063544-7ed3-44e0-83e4-0c62d63fbf80 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:08.670619 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d063544-7ed3-44e0-83e4-0c62d63fbf80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:08.701504 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-9d063544-7ed3-44e0-83e4-0c62d63fbf80 None None] MFA Rules not processed for user `d45002c105e7462cac6212badea78e9b`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:08.702888 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9d063544-7ed3-44e0-83e4-0c62d63fbf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:08.804651 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 978/1954] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:08 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:08.815317 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484fd41-95bd-4b3b-b3b3-a1867a9eb9f4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:08.820887 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2484fd41-95bd-4b3b-b3b3-a1867a9eb9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:08.891601 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484fd41-95bd-4b3b-b3b3-a1867a9eb9f4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:08.902645 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae714619-624e-4758-88d1-c0b2f49477f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:08.904320 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae714619-624e-4758-88d1-c0b2f49477f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:08.904605 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae714619-624e-4758-88d1-c0b2f49477f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:08.904912 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae714619-624e-4758-88d1-c0b2f49477f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:08.916780 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae714619-624e-4758-88d1-c0b2f49477f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:08.918653 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae714619-624e-4758-88d1-c0b2f49477f3 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:08.933365 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 977/1955] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:08 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:08.938520 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d063544-7ed3-44e0-83e4-0c62d63fbf80 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:08.940278 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9d063544-7ed3-44e0-83e4-0c62d63fbf80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:09.048426 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d063544-7ed3-44e0-83e4-0c62d63fbf80 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:09.054924 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba956f0-2b5d-4186-bb90-e993e2b28b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:09.055887 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba956f0-2b5d-4186-bb90-e993e2b28b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:09.056188 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba956f0-2b5d-4186-bb90-e993e2b28b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:09.056450 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba956f0-2b5d-4186-bb90-e993e2b28b84 admin admin] PATH_INFO: `/v3/users/144223bd18724cbe8d06d28f6b0d30c7` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:09.057873 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba956f0-2b5d-4186-bb90-e993e2b28b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=144223bd18724cbe8d06d28f6b0d30c7)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:09.060479 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba956f0-2b5d-4186-bb90-e993e2b28b84 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:09.126533 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3ba956f0-2b5d-4186-bb90-e993e2b28b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144223bd18724cbe8d06d28f6b0d30c7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:09.138850 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae714619-624e-4758-88d1-c0b2f49477f3 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:09.140565 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3ba956f0-2b5d-4186-bb90-e993e2b28b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144223bd18724cbe8d06d28f6b0d30c7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:09.156047 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3ba956f0-2b5d-4186-bb90-e993e2b28b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144223bd18724cbe8d06d28f6b0d30c7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:09.156849 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae714619-624e-4758-88d1-c0b2f49477f3 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:09.156969 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3ba956f0-2b5d-4186-bb90-e993e2b28b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144223bd18724cbe8d06d28f6b0d30c7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:09.157655 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3ba956f0-2b5d-4186-bb90-e993e2b28b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144223bd18724cbe8d06d28f6b0d30c7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:09.162969 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74f68b-bcc3-4c88-b330-758991380607 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:09.166378 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74f68b-bcc3-4c88-b330-758991380607 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:09.166907 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74f68b-bcc3-4c88-b330-758991380607 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:09.167458 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f74f68b-bcc3-4c88-b330-758991380607 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:09.170460 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7f74f68b-bcc3-4c88-b330-758991380607 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:09.183416 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 979/1956] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:08 2022] DELETE /identity/v3/users/144223bd18724cbe8d06d28f6b0d30c7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:34:09.270001 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74f68b-bcc3-4c88-b330-758991380607 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:09.272688 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f74f68b-bcc3-4c88-b330-758991380607 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:09.285185 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 978/1957] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:09 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:34:09.704274 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba956f0-2b5d-4186-bb90-e993e2b28b84 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:09.705574 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3ba956f0-2b5d-4186-bb90-e993e2b28b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:09.792756 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba956f0-2b5d-4186-bb90-e993e2b28b84 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:09.800342 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c0286-21e1-4d7b-8399-2e7c62eb1a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:09.801480 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c0286-21e1-4d7b-8399-2e7c62eb1a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:09.801601 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c0286-21e1-4d7b-8399-2e7c62eb1a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:09.801854 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c0286-21e1-4d7b-8399-2e7c62eb1a95 admin admin] PATH_INFO: `/v3/projects/d7dc9a2399504f35be3470331eddc4df` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:09.803192 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c0286-21e1-4d7b-8399-2e7c62eb1a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7dc9a2399504f35be3470331eddc4df)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:09.805151 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c0286-21e1-4d7b-8399-2e7c62eb1a95 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:09.877671 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7b2c0286-21e1-4d7b-8399-2e7c62eb1a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7dc9a2399504f35be3470331eddc4df', 'request_id': 'req-7b2c0286-21e1-4d7b-8399-2e7c62eb1a95'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:09.889643 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7b2c0286-21e1-4d7b-8399-2e7c62eb1a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7dc9a2399504f35be3470331eddc4df', 'request_id': 'req-7b2c0286-21e1-4d7b-8399-2e7c62eb1a95'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:09.896532 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7b2c0286-21e1-4d7b-8399-2e7c62eb1a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7dc9a2399504f35be3470331eddc4df', 'request_id': 'req-7b2c0286-21e1-4d7b-8399-2e7c62eb1a95'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:09.910067 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7b2c0286-21e1-4d7b-8399-2e7c62eb1a95 admin admin] The token cache is being invalidate because project d7dc9a2399504f35be3470331eddc4df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:09.910435 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7b2c0286-21e1-4d7b-8399-2e7c62eb1a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:09.911319 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7b2c0286-21e1-4d7b-8399-2e7c62eb1a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:09.912978 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 980/1958] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:09 2022] DELETE /identity/v3/projects/d7dc9a2399504f35be3470331eddc4df => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:09.916873 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74f68b-bcc3-4c88-b330-758991380607 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:09.931767 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f74f68b-bcc3-4c88-b330-758991380607 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:10.016752 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c33efa-6f46-4d4c-9843-384c72de9517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:10.018261 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c33efa-6f46-4d4c-9843-384c72de9517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:10.018551 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c33efa-6f46-4d4c-9843-384c72de9517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:10.018878 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c33efa-6f46-4d4c-9843-384c72de9517 admin admin] PATH_INFO: `/v3/users/8a2cb9622b1e42c9a0b5b275321c5c47` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:10.020115 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c33efa-6f46-4d4c-9843-384c72de9517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a2cb9622b1e42c9a0b5b275321c5c47)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:10.022142 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c33efa-6f46-4d4c-9843-384c72de9517 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:10.083098 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b2c33efa-6f46-4d4c-9843-384c72de9517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a2cb9622b1e42c9a0b5b275321c5c47'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:10.107286 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b2c33efa-6f46-4d4c-9843-384c72de9517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a2cb9622b1e42c9a0b5b275321c5c47'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:10.108204 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b2c33efa-6f46-4d4c-9843-384c72de9517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a2cb9622b1e42c9a0b5b275321c5c47'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:10.108837 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b2c33efa-6f46-4d4c-9843-384c72de9517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a2cb9622b1e42c9a0b5b275321c5c47'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:10.120176 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b2c33efa-6f46-4d4c-9843-384c72de9517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a2cb9622b1e42c9a0b5b275321c5c47'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:10.145801 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 979/1959] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:09 2022] DELETE /identity/v3/users/8a2cb9622b1e42c9a0b5b275321c5c47 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:10.359971 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c0286-21e1-4d7b-8399-2e7c62eb1a95 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:10.362139 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7b2c0286-21e1-4d7b-8399-2e7c62eb1a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:10.378328 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c0286-21e1-4d7b-8399-2e7c62eb1a95 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:10.463164 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1f0e6-8299-4775-9208-29bf29840159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:10.464473 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1f0e6-8299-4775-9208-29bf29840159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:10.464473 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1f0e6-8299-4775-9208-29bf29840159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:10.464713 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1f0e6-8299-4775-9208-29bf29840159 admin admin] PATH_INFO: `/v3/projects/7abca0ffaea04cf7ad742d93d68da08a` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:10.466635 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1f0e6-8299-4775-9208-29bf29840159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7abca0ffaea04cf7ad742d93d68da08a)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:10.468665 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1f0e6-8299-4775-9208-29bf29840159 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:10.517813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-99a1f0e6-8299-4775-9208-29bf29840159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7abca0ffaea04cf7ad742d93d68da08a', 'request_id': 'req-99a1f0e6-8299-4775-9208-29bf29840159'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:10.531364 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-99a1f0e6-8299-4775-9208-29bf29840159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7abca0ffaea04cf7ad742d93d68da08a', 'request_id': 'req-99a1f0e6-8299-4775-9208-29bf29840159'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:10.537609 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-99a1f0e6-8299-4775-9208-29bf29840159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7abca0ffaea04cf7ad742d93d68da08a', 'request_id': 'req-99a1f0e6-8299-4775-9208-29bf29840159'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:10.551041 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-99a1f0e6-8299-4775-9208-29bf29840159 admin admin] The token cache is being invalidate because project 7abca0ffaea04cf7ad742d93d68da08a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:10.551298 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-99a1f0e6-8299-4775-9208-29bf29840159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:10.551931 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-99a1f0e6-8299-4775-9208-29bf29840159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:10.553724 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 981/1960] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:10 2022] DELETE /identity/v3/projects/7abca0ffaea04cf7ad742d93d68da08a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:10.558520 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d45f1e-ef6d-4428-afba-90892154073c None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:10.558812 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d45f1e-ef6d-4428-afba-90892154073c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:10.559087 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d45f1e-ef6d-4428-afba-90892154073c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:10.577459 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-83d45f1e-ef6d-4428-afba-90892154073c None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:10.578729 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-83d45f1e-ef6d-4428-afba-90892154073c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:10.653733 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 980/1961] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:10.657595 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efda7fa-76e5-4a96-80c4-d20e33393394 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:10.657820 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efda7fa-76e5-4a96-80c4-d20e33393394 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:10.658036 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efda7fa-76e5-4a96-80c4-d20e33393394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:10.693425 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-9efda7fa-76e5-4a96-80c4-d20e33393394 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:10.694931 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9efda7fa-76e5-4a96-80c4-d20e33393394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:10.707209 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 982/1962] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:34:10.712016 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d45f1e-ef6d-4428-afba-90892154073c None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:10.736420 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d45f1e-ef6d-4428-afba-90892154073c None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:10.752593 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de335af-d147-4ece-a63d-3f503090e2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:10.753292 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de335af-d147-4ece-a63d-3f503090e2bc admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:10.753575 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de335af-d147-4ece-a63d-3f503090e2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:10.753845 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de335af-d147-4ece-a63d-3f503090e2bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:10.754573 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de335af-d147-4ece-a63d-3f503090e2bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:34:10.754875 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de335af-d147-4ece-a63d-3f503090e2bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:10.756488 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de335af-d147-4ece-a63d-3f503090e2bc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:10.777734 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 981/1963] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:34:10.781405 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efda7fa-76e5-4a96-80c4-d20e33393394 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:10.793098 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efda7fa-76e5-4a96-80c4-d20e33393394 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:10.802075 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e62f8-6619-402b-98b4-21b0986043ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:10.802802 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e62f8-6619-402b-98b4-21b0986043ef admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:10.803153 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e62f8-6619-402b-98b4-21b0986043ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:10.803502 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e62f8-6619-402b-98b4-21b0986043ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:10.804940 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e62f8-6619-402b-98b4-21b0986043ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:10.807268 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e62f8-6619-402b-98b4-21b0986043ef admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:10.842584 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 983/1964] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:34:10 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:10.847632 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de335af-d147-4ece-a63d-3f503090e2bc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:10.859586 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de335af-d147-4ece-a63d-3f503090e2bc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:10.934401 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae1e89-0610-4393-911c-c3fdd3fd28bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:10.935600 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae1e89-0610-4393-911c-c3fdd3fd28bb admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:10.936050 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae1e89-0610-4393-911c-c3fdd3fd28bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:10.936476 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae1e89-0610-4393-911c-c3fdd3fd28bb admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:10.937534 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae1e89-0610-4393-911c-c3fdd3fd28bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:10.943160 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae1e89-0610-4393-911c-c3fdd3fd28bb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:10.974774 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 982/1965] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:34:10 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:10.979368 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e62f8-6619-402b-98b4-21b0986043ef admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:10.991035 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e62f8-6619-402b-98b4-21b0986043ef admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:10.997184 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818cf60-e158-4a59-bacf-8b8724c30543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:10.997997 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818cf60-e158-4a59-bacf-8b8724c30543 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:10.998536 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818cf60-e158-4a59-bacf-8b8724c30543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:10.998866 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818cf60-e158-4a59-bacf-8b8724c30543 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:10.999592 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818cf60-e158-4a59-bacf-8b8724c30543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:11.001519 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818cf60-e158-4a59-bacf-8b8724c30543 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:11.020452 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 984/1966] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:11.024687 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae1e89-0610-4393-911c-c3fdd3fd28bb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:11.036380 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae1e89-0610-4393-911c-c3fdd3fd28bb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:11.043132 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4218e-b228-4d2f-8c58-293227e0daf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:11.044553 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4218e-b228-4d2f-8c58-293227e0daf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:11.045066 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4218e-b228-4d2f-8c58-293227e0daf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:11.045488 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4218e-b228-4d2f-8c58-293227e0daf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:11.047368 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4218e-b228-4d2f-8c58-293227e0daf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:11.049792 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4218e-b228-4d2f-8c58-293227e0daf9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:11.081427 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 983/1967] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:11.083256 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818cf60-e158-4a59-bacf-8b8724c30543 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:11.093978 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818cf60-e158-4a59-bacf-8b8724c30543 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:11.099093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac08718-3167-498f-b9db-5426d6b3e1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:11.099982 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac08718-3167-498f-b9db-5426d6b3e1cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:11.100264 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac08718-3167-498f-b9db-5426d6b3e1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:11.100540 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac08718-3167-498f-b9db-5426d6b3e1cc admin admin] PATH_INFO: `/v3/projects/c5bff3be281640dbbc05e8eaaaac2f58/users/231f548c5f23496289c60836eb57c99c/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:11.116222 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac08718-3167-498f-b9db-5426d6b3e1cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5bff3be281640dbbc05e8eaaaac2f58, user_id=231f548c5f23496289c60836eb57c99c, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:11.118988 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac08718-3167-498f-b9db-5426d6b3e1cc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:11.132987 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 985/1968] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:11 2022] PUT /identity/v3/projects/c5bff3be281640dbbc05e8eaaaac2f58/users/231f548c5f23496289c60836eb57c99c/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:34:11.143866 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adc2c3-5d04-45a8-adbb-c033483450c1 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:11.144155 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adc2c3-5d04-45a8-adbb-c033483450c1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:11.144432 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adc2c3-5d04-45a8-adbb-c033483450c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:11.171731 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f8adc2c3-5d04-45a8-adbb-c033483450c1 None None] MFA Rules not processed for user `231f548c5f23496289c60836eb57c99c`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:11.172947 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f8adc2c3-5d04-45a8-adbb-c033483450c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:11.246589 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 984/1969] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:11.253934 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac08718-3167-498f-b9db-5426d6b3e1cc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:11.329143 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac08718-3167-498f-b9db-5426d6b3e1cc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:11.334013 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87047ce9-6b55-4814-910a-6df7960d2022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:11.334711 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87047ce9-6b55-4814-910a-6df7960d2022 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:11.334996 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87047ce9-6b55-4814-910a-6df7960d2022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:11.335270 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87047ce9-6b55-4814-910a-6df7960d2022 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:11.335974 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87047ce9-6b55-4814-910a-6df7960d2022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:11.337957 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87047ce9-6b55-4814-910a-6df7960d2022 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:11.370146 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 986/1970] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:34:11 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:11.374308 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8adc2c3-5d04-45a8-adbb-c033483450c1 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:11.385992 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8adc2c3-5d04-45a8-adbb-c033483450c1 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:11.444500 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb4388-d3d7-470e-964b-4d6753b1758a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:11.445167 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb4388-d3d7-470e-964b-4d6753b1758a admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:11.445510 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb4388-d3d7-470e-964b-4d6753b1758a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:11.445786 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb4388-d3d7-470e-964b-4d6753b1758a admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:11.446665 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb4388-d3d7-470e-964b-4d6753b1758a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:11.448599 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb4388-d3d7-470e-964b-4d6753b1758a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:11.473283 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 985/1971] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:34:11 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:11.474956 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87047ce9-6b55-4814-910a-6df7960d2022 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:11.485722 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87047ce9-6b55-4814-910a-6df7960d2022 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:11.490463 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafbd50-e3eb-477e-88ee-2639aa8b5134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:11.491023 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafbd50-e3eb-477e-88ee-2639aa8b5134 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:11.491305 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafbd50-e3eb-477e-88ee-2639aa8b5134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:11.491578 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafbd50-e3eb-477e-88ee-2639aa8b5134 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:11.492326 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafbd50-e3eb-477e-88ee-2639aa8b5134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:11.493973 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafbd50-e3eb-477e-88ee-2639aa8b5134 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:11.504287 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 987/1972] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:11.508404 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb4388-d3d7-470e-964b-4d6753b1758a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:11.518694 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb4388-d3d7-470e-964b-4d6753b1758a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:11.523350 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fe8c6-f4e7-4b0d-aafe-6a0e59abe39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:11.524212 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fe8c6-f4e7-4b0d-aafe-6a0e59abe39a admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:11.524493 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fe8c6-f4e7-4b0d-aafe-6a0e59abe39a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:11.524769 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fe8c6-f4e7-4b0d-aafe-6a0e59abe39a admin admin] PATH_INFO: `/v3/projects/9a812fb685ec4116832d31e2fcdc774e/users/3d836297c6774e10ab68615182745be9/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:11.539629 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fe8c6-f4e7-4b0d-aafe-6a0e59abe39a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a812fb685ec4116832d31e2fcdc774e, user_id=3d836297c6774e10ab68615182745be9, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:11.542431 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fe8c6-f4e7-4b0d-aafe-6a0e59abe39a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:11.555167 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 986/1973] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:11 2022] PUT /identity/v3/projects/9a812fb685ec4116832d31e2fcdc774e/users/3d836297c6774e10ab68615182745be9/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:34:11.559608 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafbd50-e3eb-477e-88ee-2639aa8b5134 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:11.570194 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafbd50-e3eb-477e-88ee-2639aa8b5134 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:11.643478 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ff076-43a7-4856-87e6-ff5a37063c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:11.644128 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ff076-43a7-4856-87e6-ff5a37063c30 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:11.644405 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ff076-43a7-4856-87e6-ff5a37063c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:11.644674 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ff076-43a7-4856-87e6-ff5a37063c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:11.645414 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ff076-43a7-4856-87e6-ff5a37063c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:11.647008 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ff076-43a7-4856-87e6-ff5a37063c30 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:11.657053 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 988/1974] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:11 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:11.661340 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fe8c6-f4e7-4b0d-aafe-6a0e59abe39a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:11.671938 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fe8c6-f4e7-4b0d-aafe-6a0e59abe39a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:11.676481 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a773e0-1b0e-4de2-9955-8618c30ca3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:11.677375 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a773e0-1b0e-4de2-9955-8618c30ca3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:11.677655 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a773e0-1b0e-4de2-9955-8618c30ca3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:11.677920 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a773e0-1b0e-4de2-9955-8618c30ca3f0 admin admin] PATH_INFO: `/v3/projects/9a812fb685ec4116832d31e2fcdc774e/users/3d836297c6774e10ab68615182745be9/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:11.679840 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a773e0-1b0e-4de2-9955-8618c30ca3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a812fb685ec4116832d31e2fcdc774e, user_id=3d836297c6774e10ab68615182745be9, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:11.682519 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a773e0-1b0e-4de2-9955-8618c30ca3f0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:11.694847 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 987/1975] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:11 2022] PUT /identity/v3/projects/9a812fb685ec4116832d31e2fcdc774e/users/3d836297c6774e10ab68615182745be9/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:11.706540 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0292d6d-138c-4a35-8dcb-3f06c0cfa9f3 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:11.706954 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0292d6d-138c-4a35-8dcb-3f06c0cfa9f3 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:11.707319 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0292d6d-138c-4a35-8dcb-3f06c0cfa9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:11.737149 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-a0292d6d-138c-4a35-8dcb-3f06c0cfa9f3 None None] MFA Rules not processed for user `3d836297c6774e10ab68615182745be9`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:11.738397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a0292d6d-138c-4a35-8dcb-3f06c0cfa9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:11.811623 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 989/1976] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:11.820775 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a773e0-1b0e-4de2-9955-8618c30ca3f0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:11.822491 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b5a773e0-1b0e-4de2-9955-8618c30ca3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:11.877283 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a773e0-1b0e-4de2-9955-8618c30ca3f0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:11.880841 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3899b0-0b16-4e84-a53b-c06e6a296d7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:11.881510 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3899b0-0b16-4e84-a53b-c06e6a296d7b service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:11.881788 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3899b0-0b16-4e84-a53b-c06e6a296d7b service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:11.882056 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3899b0-0b16-4e84-a53b-c06e6a296d7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:11.945638 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3899b0-0b16-4e84-a53b-c06e6a296d7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:11.947096 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3899b0-0b16-4e84-a53b-c06e6a296d7b service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:11.956948 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 988/1977] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:17.735661 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0292d6d-138c-4a35-8dcb-3f06c0cfa9f3 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:17.737179 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a0292d6d-138c-4a35-8dcb-3f06c0cfa9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:17.800959 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0292d6d-138c-4a35-8dcb-3f06c0cfa9f3 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:17.805444 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f564c0-f6bd-437a-b317-90df64b38afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:17.807240 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f564c0-f6bd-437a-b317-90df64b38afc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:17.807240 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f564c0-f6bd-437a-b317-90df64b38afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:17.807240 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f564c0-f6bd-437a-b317-90df64b38afc admin admin] PATH_INFO: `/v3/users/57bcfb4a6bcb40d4a5b41bbc37cd8ed1` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:17.808133 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f564c0-f6bd-437a-b317-90df64b38afc admin admin] RBAC: Authorizing `identity:delete_user(user_id=57bcfb4a6bcb40d4a5b41bbc37cd8ed1)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:17.810083 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f564c0-f6bd-437a-b317-90df64b38afc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:17.852154 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-41f564c0-f6bd-437a-b317-90df64b38afc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57bcfb4a6bcb40d4a5b41bbc37cd8ed1'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:17.859126 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-41f564c0-f6bd-437a-b317-90df64b38afc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57bcfb4a6bcb40d4a5b41bbc37cd8ed1'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:17.870216 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-41f564c0-f6bd-437a-b317-90df64b38afc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57bcfb4a6bcb40d4a5b41bbc37cd8ed1'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:17.870869 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-41f564c0-f6bd-437a-b317-90df64b38afc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57bcfb4a6bcb40d4a5b41bbc37cd8ed1'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:17.871475 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-41f564c0-f6bd-437a-b317-90df64b38afc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57bcfb4a6bcb40d4a5b41bbc37cd8ed1'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:17.884063 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 990/1978] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:17 2022] DELETE /identity/v3/users/57bcfb4a6bcb40d4a5b41bbc37cd8ed1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:17.888558 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037e95f-1ac9-461d-879e-51d45ee1a24f None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:17.889059 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037e95f-1ac9-461d-879e-51d45ee1a24f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:17.889151 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037e95f-1ac9-461d-879e-51d45ee1a24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:17.906139 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-7037e95f-1ac9-461d-879e-51d45ee1a24f None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:17.907319 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7037e95f-1ac9-461d-879e-51d45ee1a24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:17.962946 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 989/1979] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:17.973199 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f564c0-f6bd-437a-b317-90df64b38afc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:17.974646 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-41f564c0-f6bd-437a-b317-90df64b38afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:18.033507 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f564c0-f6bd-437a-b317-90df64b38afc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:18.037284 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195bfb1-93e4-448a-a46b-a00c746ce6a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:18.038013 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195bfb1-93e4-448a-a46b-a00c746ce6a7 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:18.038359 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195bfb1-93e4-448a-a46b-a00c746ce6a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:18.038715 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195bfb1-93e4-448a-a46b-a00c746ce6a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:18.049102 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195bfb1-93e4-448a-a46b-a00c746ce6a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:18.050559 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195bfb1-93e4-448a-a46b-a00c746ce6a7 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:18.060518 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 991/1980] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:18.224386 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037e95f-1ac9-461d-879e-51d45ee1a24f None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:18.226181 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7037e95f-1ac9-461d-879e-51d45ee1a24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:18.291138 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037e95f-1ac9-461d-879e-51d45ee1a24f None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:18.296240 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e5e0c-cb76-4ddb-a87a-87f4cd283858 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:18.296865 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e5e0c-cb76-4ddb-a87a-87f4cd283858 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:18.297149 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e5e0c-cb76-4ddb-a87a-87f4cd283858 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:18.297452 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e5e0c-cb76-4ddb-a87a-87f4cd283858 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:18.299458 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-681e5e0c-cb76-4ddb-a87a-87f4cd283858 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:18.388238 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e5e0c-cb76-4ddb-a87a-87f4cd283858 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:18.389813 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e5e0c-cb76-4ddb-a87a-87f4cd283858 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:18.400668 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 990/1981] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:18.523129 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195bfb1-93e4-448a-a46b-a00c746ce6a7 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:18.525819 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3195bfb1-93e4-448a-a46b-a00c746ce6a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:18.542240 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195bfb1-93e4-448a-a46b-a00c746ce6a7 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:18.548907 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4b535-62c3-4957-aaff-b3a8603bf682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:18.549924 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4b535-62c3-4957-aaff-b3a8603bf682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:18.550486 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4b535-62c3-4957-aaff-b3a8603bf682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:18.550903 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4b535-62c3-4957-aaff-b3a8603bf682 admin admin] PATH_INFO: `/v3/projects/45f30c74f6574140afeda317063bbd4e` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:18.552265 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4b535-62c3-4957-aaff-b3a8603bf682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45f30c74f6574140afeda317063bbd4e)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:18.554790 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4b535-62c3-4957-aaff-b3a8603bf682 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:18.650402 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5e4b535-62c3-4957-aaff-b3a8603bf682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45f30c74f6574140afeda317063bbd4e', 'request_id': 'req-c5e4b535-62c3-4957-aaff-b3a8603bf682'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:18.660796 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5e4b535-62c3-4957-aaff-b3a8603bf682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45f30c74f6574140afeda317063bbd4e', 'request_id': 'req-c5e4b535-62c3-4957-aaff-b3a8603bf682'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:18.671340 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5e4b535-62c3-4957-aaff-b3a8603bf682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45f30c74f6574140afeda317063bbd4e', 'request_id': 'req-c5e4b535-62c3-4957-aaff-b3a8603bf682'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:18.688792 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5e4b535-62c3-4957-aaff-b3a8603bf682 admin admin] The token cache is being invalidate because project 45f30c74f6574140afeda317063bbd4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:18.689112 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5e4b535-62c3-4957-aaff-b3a8603bf682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:18.690771 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5e4b535-62c3-4957-aaff-b3a8603bf682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:18.702445 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 992/1982] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:18 2022] DELETE /identity/v3/projects/45f30c74f6574140afeda317063bbd4e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:18.707241 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e5e0c-cb76-4ddb-a87a-87f4cd283858 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:18.719547 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e5e0c-cb76-4ddb-a87a-87f4cd283858 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:18.798395 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db15f6-8878-4e28-bffb-371fd9f50475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:18.799399 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db15f6-8878-4e28-bffb-371fd9f50475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:18.799748 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db15f6-8878-4e28-bffb-371fd9f50475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:18.800313 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db15f6-8878-4e28-bffb-371fd9f50475 admin admin] PATH_INFO: `/v3/users/d45002c105e7462cac6212badea78e9b` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:18.801738 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db15f6-8878-4e28-bffb-371fd9f50475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d45002c105e7462cac6212badea78e9b)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:18.803752 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db15f6-8878-4e28-bffb-371fd9f50475 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:18.858137 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d5db15f6-8878-4e28-bffb-371fd9f50475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd45002c105e7462cac6212badea78e9b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:18.870590 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d5db15f6-8878-4e28-bffb-371fd9f50475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd45002c105e7462cac6212badea78e9b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:18.872254 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d5db15f6-8878-4e28-bffb-371fd9f50475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd45002c105e7462cac6212badea78e9b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:18.874711 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d5db15f6-8878-4e28-bffb-371fd9f50475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd45002c105e7462cac6212badea78e9b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:18.883534 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d5db15f6-8878-4e28-bffb-371fd9f50475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd45002c105e7462cac6212badea78e9b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:18.897018 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 991/1983] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:18 2022] DELETE /identity/v3/users/d45002c105e7462cac6212badea78e9b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:19.168344 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4b535-62c3-4957-aaff-b3a8603bf682 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:19.169817 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c5e4b535-62c3-4957-aaff-b3a8603bf682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:19.189253 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4b535-62c3-4957-aaff-b3a8603bf682 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:19.256647 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca83ba3-ba9d-402b-b1b8-29b4f3d34b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:19.257546 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca83ba3-ba9d-402b-b1b8-29b4f3d34b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:19.257824 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca83ba3-ba9d-402b-b1b8-29b4f3d34b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:19.258262 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca83ba3-ba9d-402b-b1b8-29b4f3d34b7a admin admin] PATH_INFO: `/v3/projects/cc3a18fc19e64ab6b1cc1483c2b14963` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:19.259553 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca83ba3-ba9d-402b-b1b8-29b4f3d34b7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc3a18fc19e64ab6b1cc1483c2b14963)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:19.261511 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca83ba3-ba9d-402b-b1b8-29b4f3d34b7a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:19.317972 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-eca83ba3-ba9d-402b-b1b8-29b4f3d34b7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc3a18fc19e64ab6b1cc1483c2b14963', 'request_id': 'req-eca83ba3-ba9d-402b-b1b8-29b4f3d34b7a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:19.325478 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-eca83ba3-ba9d-402b-b1b8-29b4f3d34b7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc3a18fc19e64ab6b1cc1483c2b14963', 'request_id': 'req-eca83ba3-ba9d-402b-b1b8-29b4f3d34b7a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:19.331427 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-eca83ba3-ba9d-402b-b1b8-29b4f3d34b7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc3a18fc19e64ab6b1cc1483c2b14963', 'request_id': 'req-eca83ba3-ba9d-402b-b1b8-29b4f3d34b7a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:19.342743 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-eca83ba3-ba9d-402b-b1b8-29b4f3d34b7a admin admin] The token cache is being invalidate because project cc3a18fc19e64ab6b1cc1483c2b14963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:19.343026 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-eca83ba3-ba9d-402b-b1b8-29b4f3d34b7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:19.343692 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-eca83ba3-ba9d-402b-b1b8-29b4f3d34b7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:19.345331 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 993/1984] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:19 2022] DELETE /identity/v3/projects/cc3a18fc19e64ab6b1cc1483c2b14963 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:19.350109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2527b9-ba8d-4136-84fa-6bd6a0bfed9c None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:19.350391 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2527b9-ba8d-4136-84fa-6bd6a0bfed9c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:19.350692 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2527b9-ba8d-4136-84fa-6bd6a0bfed9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:19.367656 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-6d2527b9-ba8d-4136-84fa-6bd6a0bfed9c None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:19.368859 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6d2527b9-ba8d-4136-84fa-6bd6a0bfed9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:19.423944 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 992/1985] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:19.431547 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbc365-ef5b-4717-bcdd-6e588cc506d2 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:19.431833 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbc365-ef5b-4717-bcdd-6e588cc506d2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:19.432111 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbc365-ef5b-4717-bcdd-6e588cc506d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:19.450261 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-fdfbc365-ef5b-4717-bcdd-6e588cc506d2 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:19.452039 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-fdfbc365-ef5b-4717-bcdd-6e588cc506d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:19.460192 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 994/1986] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:19.464149 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2527b9-ba8d-4136-84fa-6bd6a0bfed9c None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:19.473411 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2527b9-ba8d-4136-84fa-6bd6a0bfed9c None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:19.477843 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65eedd-c91d-4362-8385-195ab318497e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:19.478473 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65eedd-c91d-4362-8385-195ab318497e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:19.478746 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65eedd-c91d-4362-8385-195ab318497e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:19.479014 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65eedd-c91d-4362-8385-195ab318497e admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:19.479724 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65eedd-c91d-4362-8385-195ab318497e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:34:19.480026 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65eedd-c91d-4362-8385-195ab318497e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:19.481674 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65eedd-c91d-4362-8385-195ab318497e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:19.492538 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 993/1987] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:34:19.496593 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbc365-ef5b-4717-bcdd-6e588cc506d2 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:19.506505 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbc365-ef5b-4717-bcdd-6e588cc506d2 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:19.511119 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c2a4a-6c91-4a58-9174-9e58ce8d7ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:19.511748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c2a4a-6c91-4a58-9174-9e58ce8d7ace admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:19.512098 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c2a4a-6c91-4a58-9174-9e58ce8d7ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:19.512372 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c2a4a-6c91-4a58-9174-9e58ce8d7ace admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:19.513051 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c2a4a-6c91-4a58-9174-9e58ce8d7ace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:19.515539 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7c2a4a-6c91-4a58-9174-9e58ce8d7ace admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:19.550471 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 995/1988] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:34:19 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:19.551708 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65eedd-c91d-4362-8385-195ab318497e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:19.563615 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65eedd-c91d-4362-8385-195ab318497e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:19.619409 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e759128-99d7-4cb6-9549-649d15229caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:19.620179 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e759128-99d7-4cb6-9549-649d15229caf admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:19.620464 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e759128-99d7-4cb6-9549-649d15229caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:19.620738 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e759128-99d7-4cb6-9549-649d15229caf admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:19.621459 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e759128-99d7-4cb6-9549-649d15229caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:19.623947 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e759128-99d7-4cb6-9549-649d15229caf admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:19.644495 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 994/1989] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:34:19 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:19.648297 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c2a4a-6c91-4a58-9174-9e58ce8d7ace admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:19.659076 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c2a4a-6c91-4a58-9174-9e58ce8d7ace admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:19.664067 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe38f7-f6f6-4452-a224-0ae9c89f8bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:19.664812 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe38f7-f6f6-4452-a224-0ae9c89f8bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:19.665123 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe38f7-f6f6-4452-a224-0ae9c89f8bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:19.665449 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe38f7-f6f6-4452-a224-0ae9c89f8bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:19.666186 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe38f7-f6f6-4452-a224-0ae9c89f8bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:19.668691 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe38f7-f6f6-4452-a224-0ae9c89f8bd5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:19.681040 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 996/1990] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:19.685037 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e759128-99d7-4cb6-9549-649d15229caf admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:19.696031 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e759128-99d7-4cb6-9549-649d15229caf admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:19.700902 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a3082-3c83-4caa-9bba-ce13ac66a1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:19.702124 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a3082-3c83-4caa-9bba-ce13ac66a1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:19.702405 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a3082-3c83-4caa-9bba-ce13ac66a1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:19.702677 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a3082-3c83-4caa-9bba-ce13ac66a1b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:19.703408 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a3082-3c83-4caa-9bba-ce13ac66a1b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:19.705163 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a3082-3c83-4caa-9bba-ce13ac66a1b3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:19.718415 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 995/1991] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:34:19.719832 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe38f7-f6f6-4452-a224-0ae9c89f8bd5 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:19.729569 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe38f7-f6f6-4452-a224-0ae9c89f8bd5 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:19.734671 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddcbac-b79c-4d76-8b84-c56693efd411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:19.735546 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddcbac-b79c-4d76-8b84-c56693efd411 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:19.735823 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddcbac-b79c-4d76-8b84-c56693efd411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:19.736091 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddcbac-b79c-4d76-8b84-c56693efd411 admin admin] PATH_INFO: `/v3/projects/1cc2d6c54d3d4c8b9a35f10ee3e333cf/users/c4ee48eeb8e6491fb0a3cc085517ac3b/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:19.751129 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddcbac-b79c-4d76-8b84-c56693efd411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc2d6c54d3d4c8b9a35f10ee3e333cf, user_id=c4ee48eeb8e6491fb0a3cc085517ac3b, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:19.753870 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddcbac-b79c-4d76-8b84-c56693efd411 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:19.776652 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 997/1992] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:19 2022] PUT /identity/v3/projects/1cc2d6c54d3d4c8b9a35f10ee3e333cf/users/c4ee48eeb8e6491fb0a3cc085517ac3b/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:19.778424 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ae12f-f881-4d41-a270-bb6849ae5ba9 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:19.778768 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ae12f-f881-4d41-a270-bb6849ae5ba9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:19.779080 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ae12f-f881-4d41-a270-bb6849ae5ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:19.824804 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-231ae12f-f881-4d41-a270-bb6849ae5ba9 None None] MFA Rules not processed for user `c4ee48eeb8e6491fb0a3cc085517ac3b`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:19.826357 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-231ae12f-f881-4d41-a270-bb6849ae5ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:19.911064 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 996/1993] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:34:19.923877 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddcbac-b79c-4d76-8b84-c56693efd411 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:19.927143 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e0ddcbac-b79c-4d76-8b84-c56693efd411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:20.004573 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddcbac-b79c-4d76-8b84-c56693efd411 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:20.009382 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce511677-51e0-4904-af1f-ba44afef2efe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:20.010128 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce511677-51e0-4904-af1f-ba44afef2efe service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:20.010478 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce511677-51e0-4904-af1f-ba44afef2efe service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:20.010931 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce511677-51e0-4904-af1f-ba44afef2efe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:20.026111 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce511677-51e0-4904-af1f-ba44afef2efe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:20.027559 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce511677-51e0-4904-af1f-ba44afef2efe service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:20.037895 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 998/1994] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:24.171994 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ae12f-f881-4d41-a270-bb6849ae5ba9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:24.230872 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ae12f-f881-4d41-a270-bb6849ae5ba9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:24.236008 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393a21d-14d4-4422-8dab-dcb96fcca8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:24.236866 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393a21d-14d4-4422-8dab-dcb96fcca8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:24.237148 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393a21d-14d4-4422-8dab-dcb96fcca8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:24.237455 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393a21d-14d4-4422-8dab-dcb96fcca8d0 admin admin] PATH_INFO: `/v3/users/c4ee48eeb8e6491fb0a3cc085517ac3b` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:24.238644 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393a21d-14d4-4422-8dab-dcb96fcca8d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ee48eeb8e6491fb0a3cc085517ac3b)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:24.240757 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393a21d-14d4-4422-8dab-dcb96fcca8d0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:24.284951 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b393a21d-14d4-4422-8dab-dcb96fcca8d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ee48eeb8e6491fb0a3cc085517ac3b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:24.297498 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b393a21d-14d4-4422-8dab-dcb96fcca8d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ee48eeb8e6491fb0a3cc085517ac3b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:24.298168 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b393a21d-14d4-4422-8dab-dcb96fcca8d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ee48eeb8e6491fb0a3cc085517ac3b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:24.298763 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b393a21d-14d4-4422-8dab-dcb96fcca8d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ee48eeb8e6491fb0a3cc085517ac3b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:24.305803 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b393a21d-14d4-4422-8dab-dcb96fcca8d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ee48eeb8e6491fb0a3cc085517ac3b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:24.318406 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 997/1995] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:24 2022] DELETE /identity/v3/users/c4ee48eeb8e6491fb0a3cc085517ac3b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:24.322833 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199877f6-0330-4516-bf98-714f020cd2ce None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:24.323307 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199877f6-0330-4516-bf98-714f020cd2ce None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:24.323395 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199877f6-0330-4516-bf98-714f020cd2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:24.339988 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-199877f6-0330-4516-bf98-714f020cd2ce None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:24.341345 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-199877f6-0330-4516-bf98-714f020cd2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:24.399082 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 999/1996] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:24.408598 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393a21d-14d4-4422-8dab-dcb96fcca8d0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:24.410014 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b393a21d-14d4-4422-8dab-dcb96fcca8d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:24.466979 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393a21d-14d4-4422-8dab-dcb96fcca8d0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:24.470642 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28bce3-4413-4bba-a957-43e749507658 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:24.471285 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28bce3-4413-4bba-a957-43e749507658 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:24.471566 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28bce3-4413-4bba-a957-43e749507658 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:24.471840 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28bce3-4413-4bba-a957-43e749507658 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:24.480842 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28bce3-4413-4bba-a957-43e749507658 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:24.482998 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28bce3-4413-4bba-a957-43e749507658 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:24.494179 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 998/1997] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:24.505708 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199877f6-0330-4516-bf98-714f020cd2ce None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:24.507096 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-199877f6-0330-4516-bf98-714f020cd2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:24.518952 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199877f6-0330-4516-bf98-714f020cd2ce None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:24.538034 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987dcbb7-605b-4c9e-b4fd-9e508d1c2064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:24.539298 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987dcbb7-605b-4c9e-b4fd-9e508d1c2064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:24.539749 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987dcbb7-605b-4c9e-b4fd-9e508d1c2064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:24.540440 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987dcbb7-605b-4c9e-b4fd-9e508d1c2064 admin admin] PATH_INFO: `/v3/users/231f548c5f23496289c60836eb57c99c` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:24.542062 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987dcbb7-605b-4c9e-b4fd-9e508d1c2064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=231f548c5f23496289c60836eb57c99c)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:24.547594 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987dcbb7-605b-4c9e-b4fd-9e508d1c2064 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:24.640093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-987dcbb7-605b-4c9e-b4fd-9e508d1c2064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '231f548c5f23496289c60836eb57c99c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:24.650714 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-987dcbb7-605b-4c9e-b4fd-9e508d1c2064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '231f548c5f23496289c60836eb57c99c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:24.667000 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-987dcbb7-605b-4c9e-b4fd-9e508d1c2064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '231f548c5f23496289c60836eb57c99c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:24.667964 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-987dcbb7-605b-4c9e-b4fd-9e508d1c2064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '231f548c5f23496289c60836eb57c99c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:24.668624 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-987dcbb7-605b-4c9e-b4fd-9e508d1c2064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '231f548c5f23496289c60836eb57c99c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:24.699108 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1000/1998] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:24 2022] DELETE /identity/v3/users/231f548c5f23496289c60836eb57c99c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:24.709447 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26606e63-3ee4-4b34-b0af-30782593dc87 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:24.709808 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26606e63-3ee4-4b34-b0af-30782593dc87 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:24.710094 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26606e63-3ee4-4b34-b0af-30782593dc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:24.742483 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-26606e63-3ee4-4b34-b0af-30782593dc87 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:24.751033 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-26606e63-3ee4-4b34-b0af-30782593dc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:24.865482 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987dcbb7-605b-4c9e-b4fd-9e508d1c2064 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:24.867554 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-987dcbb7-605b-4c9e-b4fd-9e508d1c2064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:24.908166 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 999/1999] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:24.922587 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c0bf4-3ea1-4f0b-806a-6a9dceb99a71 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:24.922879 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c0bf4-3ea1-4f0b-806a-6a9dceb99a71 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:24.923549 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c0bf4-3ea1-4f0b-806a-6a9dceb99a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:24.945317 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f64c0bf4-3ea1-4f0b-806a-6a9dceb99a71 None None] MFA Rules not processed for user `65045a2a88084c12aeb9133bf0162193`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:24.946811 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f64c0bf4-3ea1-4f0b-806a-6a9dceb99a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:24.978643 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987dcbb7-605b-4c9e-b4fd-9e508d1c2064 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:24.983997 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c46d55-805e-446e-b798-50f80b453ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:24.984949 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c46d55-805e-446e-b798-50f80b453ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:24.985328 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c46d55-805e-446e-b798-50f80b453ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:24.985678 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c46d55-805e-446e-b798-50f80b453ec7 admin admin] PATH_INFO: `/v3/projects/1cc2d6c54d3d4c8b9a35f10ee3e333cf` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:24.987168 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c46d55-805e-446e-b798-50f80b453ec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc2d6c54d3d4c8b9a35f10ee3e333cf)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:24.989198 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c46d55-805e-446e-b798-50f80b453ec7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:25.013906 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1000/2000] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:25.013906 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c0bf4-3ea1-4f0b-806a-6a9dceb99a71 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:25.013906 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f64c0bf4-3ea1-4f0b-806a-6a9dceb99a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:25.049292 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-51c46d55-805e-446e-b798-50f80b453ec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc2d6c54d3d4c8b9a35f10ee3e333cf', 'request_id': 'req-51c46d55-805e-446e-b798-50f80b453ec7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:25.062458 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-51c46d55-805e-446e-b798-50f80b453ec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc2d6c54d3d4c8b9a35f10ee3e333cf', 'request_id': 'req-51c46d55-805e-446e-b798-50f80b453ec7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:25.071325 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-51c46d55-805e-446e-b798-50f80b453ec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc2d6c54d3d4c8b9a35f10ee3e333cf', 'request_id': 'req-51c46d55-805e-446e-b798-50f80b453ec7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:25.076871 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c0bf4-3ea1-4f0b-806a-6a9dceb99a71 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:25.085024 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-51c46d55-805e-446e-b798-50f80b453ec7 admin admin] The token cache is being invalidate because project 1cc2d6c54d3d4c8b9a35f10ee3e333cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:25.085484 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-51c46d55-805e-446e-b798-50f80b453ec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:25.086315 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-51c46d55-805e-446e-b798-50f80b453ec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:25.088082 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1001/2001] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:24 2022] DELETE /identity/v3/projects/1cc2d6c54d3d4c8b9a35f10ee3e333cf => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:34:25.093237 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49216834-239a-4440-81d9-52ae47b33f3b None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:25.093633 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49216834-239a-4440-81d9-52ae47b33f3b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:25.093983 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49216834-239a-4440-81d9-52ae47b33f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:25.114433 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-49216834-239a-4440-81d9-52ae47b33f3b None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:25.116862 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-49216834-239a-4440-81d9-52ae47b33f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:25.136893 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f06370-507e-4c75-b85d-becbe3d86ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:25.137581 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f06370-507e-4c75-b85d-becbe3d86ccf service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:25.137857 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f06370-507e-4c75-b85d-becbe3d86ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:25.138676 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f06370-507e-4c75-b85d-becbe3d86ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:25.141586 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-88f06370-507e-4c75-b85d-becbe3d86ccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:25.217395 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1002/2002] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:25.221691 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f06370-507e-4c75-b85d-becbe3d86ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:25.223454 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f06370-507e-4c75-b85d-becbe3d86ccf service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:25.225762 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea855d9f-df56-4e6c-8773-e56cb2dbab0b None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:25.226116 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea855d9f-df56-4e6c-8773-e56cb2dbab0b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:25.226467 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea855d9f-df56-4e6c-8773-e56cb2dbab0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:25.237531 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1001/2003] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:25.246855 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-ea855d9f-df56-4e6c-8773-e56cb2dbab0b None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:25.248768 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ea855d9f-df56-4e6c-8773-e56cb2dbab0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:25.267048 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1003/2004] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:25.270919 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f06370-507e-4c75-b85d-becbe3d86ccf service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:25.281331 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f06370-507e-4c75-b85d-becbe3d86ccf service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:25.286469 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62235fa0-6fa5-4317-ab00-ab371a020f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:25.287206 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62235fa0-6fa5-4317-ab00-ab371a020f51 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:25.287612 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62235fa0-6fa5-4317-ab00-ab371a020f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:25.287985 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62235fa0-6fa5-4317-ab00-ab371a020f51 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:25.288929 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62235fa0-6fa5-4317-ab00-ab371a020f51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:34:25.289340 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62235fa0-6fa5-4317-ab00-ab371a020f51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:25.291063 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62235fa0-6fa5-4317-ab00-ab371a020f51 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:25.303812 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1002/2005] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:34:25.308203 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea855d9f-df56-4e6c-8773-e56cb2dbab0b None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:25.324670 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea855d9f-df56-4e6c-8773-e56cb2dbab0b None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:25.332574 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89193df-22bb-4ed1-be69-5da56ff7170f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:25.332574 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89193df-22bb-4ed1-be69-5da56ff7170f admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:25.332574 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89193df-22bb-4ed1-be69-5da56ff7170f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:25.332574 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89193df-22bb-4ed1-be69-5da56ff7170f admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:25.332991 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89193df-22bb-4ed1-be69-5da56ff7170f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:25.334232 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89193df-22bb-4ed1-be69-5da56ff7170f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:25.367643 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1004/2006] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:34:25 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:25.371589 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62235fa0-6fa5-4317-ab00-ab371a020f51 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:25.382134 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62235fa0-6fa5-4317-ab00-ab371a020f51 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:25.463757 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89193df-22bb-4ed1-be69-5da56ff7170f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:25.465848 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058960c-b808-43a3-992e-38164c91e770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:25.466668 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f89193df-22bb-4ed1-be69-5da56ff7170f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:25.467060 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058960c-b808-43a3-992e-38164c91e770 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:25.467486 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058960c-b808-43a3-992e-38164c91e770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:25.468437 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058960c-b808-43a3-992e-38164c91e770 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:25.469483 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058960c-b808-43a3-992e-38164c91e770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:25.472224 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058960c-b808-43a3-992e-38164c91e770 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:25.483447 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89193df-22bb-4ed1-be69-5da56ff7170f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:25.492239 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68d6c5-4bbf-4381-a17e-1ad8d7d3712e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:25.492902 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68d6c5-4bbf-4381-a17e-1ad8d7d3712e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:25.494603 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68d6c5-4bbf-4381-a17e-1ad8d7d3712e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:25.494906 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68d6c5-4bbf-4381-a17e-1ad8d7d3712e admin admin] PATH_INFO: `/v3/users/937df27c7eb1402b80a735a24170f074` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:25.501653 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68d6c5-4bbf-4381-a17e-1ad8d7d3712e admin admin] RBAC: Authorizing `identity:delete_user(user_id=937df27c7eb1402b80a735a24170f074)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:25.504577 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68d6c5-4bbf-4381-a17e-1ad8d7d3712e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:25.509287 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1003/2007] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:34:25 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:25.510966 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058960c-b808-43a3-992e-38164c91e770 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:25.531212 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058960c-b808-43a3-992e-38164c91e770 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:25.539635 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665895c7-ca2d-4c86-b1fb-5322e27c12f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:25.540306 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665895c7-ca2d-4c86-b1fb-5322e27c12f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:25.540746 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665895c7-ca2d-4c86-b1fb-5322e27c12f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:25.541032 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665895c7-ca2d-4c86-b1fb-5322e27c12f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:25.542257 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665895c7-ca2d-4c86-b1fb-5322e27c12f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:25.544147 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665895c7-ca2d-4c86-b1fb-5322e27c12f9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:25.557401 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1004/2008] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:25.562641 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665895c7-ca2d-4c86-b1fb-5322e27c12f9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:25.578071 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665895c7-ca2d-4c86-b1fb-5322e27c12f9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:25.588064 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19406a-c44c-4ed9-b6d4-db113d151cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:25.588885 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19406a-c44c-4ed9-b6d4-db113d151cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:25.589177 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19406a-c44c-4ed9-b6d4-db113d151cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:25.589488 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19406a-c44c-4ed9-b6d4-db113d151cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:25.590229 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19406a-c44c-4ed9-b6d4-db113d151cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:25.594416 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19406a-c44c-4ed9-b6d4-db113d151cc8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:25.603675 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ab68d6c5-4bbf-4381-a17e-1ad8d7d3712e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '937df27c7eb1402b80a735a24170f074'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:25.615745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1005/2009] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:25.616808 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19406a-c44c-4ed9-b6d4-db113d151cc8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:25.617163 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ab68d6c5-4bbf-4381-a17e-1ad8d7d3712e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '937df27c7eb1402b80a735a24170f074'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:25.632996 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ab68d6c5-4bbf-4381-a17e-1ad8d7d3712e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '937df27c7eb1402b80a735a24170f074'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:25.633828 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ab68d6c5-4bbf-4381-a17e-1ad8d7d3712e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '937df27c7eb1402b80a735a24170f074'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:25.634534 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ab68d6c5-4bbf-4381-a17e-1ad8d7d3712e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '937df27c7eb1402b80a735a24170f074'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:25.635942 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19406a-c44c-4ed9-b6d4-db113d151cc8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:25.646819 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3681f-d1bf-48e5-9fdd-c57844751522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:25.647810 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3681f-d1bf-48e5-9fdd-c57844751522 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:25.648550 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3681f-d1bf-48e5-9fdd-c57844751522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:25.648838 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3681f-d1bf-48e5-9fdd-c57844751522 admin admin] PATH_INFO: `/v3/projects/d37ca84d2a1f43748ffc6c7a36d9a691/users/be64be4d6efe45449807f7e5773f1ede/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:25.655148 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1005/2010] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:25 2022] DELETE /identity/v3/users/937df27c7eb1402b80a735a24170f074 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:25.680873 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3681f-d1bf-48e5-9fdd-c57844751522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37ca84d2a1f43748ffc6c7a36d9a691, user_id=be64be4d6efe45449807f7e5773f1ede, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:25.684114 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3681f-d1bf-48e5-9fdd-c57844751522 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:25.706808 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1006/2011] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:25 2022] PUT /identity/v3/projects/d37ca84d2a1f43748ffc6c7a36d9a691/users/be64be4d6efe45449807f7e5773f1ede/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:25.722428 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af21fd4-462b-4946-80c8-937e34ee3b28 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:25.722585 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af21fd4-462b-4946-80c8-937e34ee3b28 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:25.722922 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af21fd4-462b-4946-80c8-937e34ee3b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:25.795333 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3681f-d1bf-48e5-9fdd-c57844751522 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:25.798528 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7ed3681f-d1bf-48e5-9fdd-c57844751522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:25.800558 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0af21fd4-462b-4946-80c8-937e34ee3b28 None None] MFA Rules not processed for user `be64be4d6efe45449807f7e5773f1ede`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:25.801885 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0af21fd4-462b-4946-80c8-937e34ee3b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:25.925541 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3681f-d1bf-48e5-9fdd-c57844751522 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:25.942157 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56517d-ada9-4c73-9765-2fc7e0a2e79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:25.943029 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56517d-ada9-4c73-9765-2fc7e0a2e79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:25.943309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56517d-ada9-4c73-9765-2fc7e0a2e79e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:25.943580 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56517d-ada9-4c73-9765-2fc7e0a2e79e admin admin] PATH_INFO: `/v3/projects/c5bff3be281640dbbc05e8eaaaac2f58` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:25.946047 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56517d-ada9-4c73-9765-2fc7e0a2e79e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5bff3be281640dbbc05e8eaaaac2f58)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:25.950371 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56517d-ada9-4c73-9765-2fc7e0a2e79e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:25.957510 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1006/2012] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:25.961525 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af21fd4-462b-4946-80c8-937e34ee3b28 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:25.962871 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0af21fd4-462b-4946-80c8-937e34ee3b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:25.980015 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af21fd4-462b-4946-80c8-937e34ee3b28 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:25.986499 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d84819-1bcd-484c-8850-8fdf70b29b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:25.987253 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84819-1bcd-484c-8850-8fdf70b29b2e admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:25.987551 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84819-1bcd-484c-8850-8fdf70b29b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:25.987827 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84819-1bcd-484c-8850-8fdf70b29b2e admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:25.988631 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d84819-1bcd-484c-8850-8fdf70b29b2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:25.990784 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d84819-1bcd-484c-8850-8fdf70b29b2e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:26.032167 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-fb56517d-ada9-4c73-9765-2fc7e0a2e79e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5bff3be281640dbbc05e8eaaaac2f58', 'request_id': 'req-fb56517d-ada9-4c73-9765-2fc7e0a2e79e'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:26.037378 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1007/2013] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:34:25 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:34:26.037673 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d84819-1bcd-484c-8850-8fdf70b29b2e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:26.039893 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-fb56517d-ada9-4c73-9765-2fc7e0a2e79e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5bff3be281640dbbc05e8eaaaac2f58', 'request_id': 'req-fb56517d-ada9-4c73-9765-2fc7e0a2e79e'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:26.041624 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-64d84819-1bcd-484c-8850-8fdf70b29b2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:26.047694 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-fb56517d-ada9-4c73-9765-2fc7e0a2e79e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5bff3be281640dbbc05e8eaaaac2f58', 'request_id': 'req-fb56517d-ada9-4c73-9765-2fc7e0a2e79e'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:26.061193 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-fb56517d-ada9-4c73-9765-2fc7e0a2e79e admin admin] The token cache is being invalidate because project c5bff3be281640dbbc05e8eaaaac2f58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:26.061544 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-fb56517d-ada9-4c73-9765-2fc7e0a2e79e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:26.062748 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-fb56517d-ada9-4c73-9765-2fc7e0a2e79e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:26.065309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1007/2014] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:25 2022] DELETE /identity/v3/projects/c5bff3be281640dbbc05e8eaaaac2f58 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:26.065309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56517d-ada9-4c73-9765-2fc7e0a2e79e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:26.067216 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fb56517d-ada9-4c73-9765-2fc7e0a2e79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:26.125021 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d84819-1bcd-484c-8850-8fdf70b29b2e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:26.133111 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4862cd4-a4c9-4cd9-b718-2dc8f7a5713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:26.134770 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4862cd4-a4c9-4cd9-b718-2dc8f7a5713a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:26.134770 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4862cd4-a4c9-4cd9-b718-2dc8f7a5713a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:26.134979 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4862cd4-a4c9-4cd9-b718-2dc8f7a5713a admin admin] PATH_INFO: `/v3/projects/f8c0817ca34947d797da354bfc2aa372` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:26.136229 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4862cd4-a4c9-4cd9-b718-2dc8f7a5713a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8c0817ca34947d797da354bfc2aa372)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:26.139036 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4862cd4-a4c9-4cd9-b718-2dc8f7a5713a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:26.158759 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56517d-ada9-4c73-9765-2fc7e0a2e79e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:26.165053 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f09b1c-7f33-4475-b50d-0f249dd4a485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:26.165986 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f09b1c-7f33-4475-b50d-0f249dd4a485 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:26.166505 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f09b1c-7f33-4475-b50d-0f249dd4a485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:26.166682 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f09b1c-7f33-4475-b50d-0f249dd4a485 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:26.168765 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f09b1c-7f33-4475-b50d-0f249dd4a485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:26.170360 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f09b1c-7f33-4475-b50d-0f249dd4a485 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:26.197850 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1008/2015] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:34:26 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:26.198779 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f09b1c-7f33-4475-b50d-0f249dd4a485 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:26.200460 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d8f09b1c-7f33-4475-b50d-0f249dd4a485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:26.209693 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e4862cd4-a4c9-4cd9-b718-2dc8f7a5713a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8c0817ca34947d797da354bfc2aa372', 'request_id': 'req-e4862cd4-a4c9-4cd9-b718-2dc8f7a5713a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:26.218851 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e4862cd4-a4c9-4cd9-b718-2dc8f7a5713a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8c0817ca34947d797da354bfc2aa372', 'request_id': 'req-e4862cd4-a4c9-4cd9-b718-2dc8f7a5713a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:26.225182 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e4862cd4-a4c9-4cd9-b718-2dc8f7a5713a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8c0817ca34947d797da354bfc2aa372', 'request_id': 'req-e4862cd4-a4c9-4cd9-b718-2dc8f7a5713a'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:26.225343 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f09b1c-7f33-4475-b50d-0f249dd4a485 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:26.239974 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e4862cd4-a4c9-4cd9-b718-2dc8f7a5713a admin admin] The token cache is being invalidate because project f8c0817ca34947d797da354bfc2aa372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:26.240252 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e4862cd4-a4c9-4cd9-b718-2dc8f7a5713a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:26.240908 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e4862cd4-a4c9-4cd9-b718-2dc8f7a5713a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:26.243063 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1008/2016] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:26 2022] DELETE /identity/v3/projects/f8c0817ca34947d797da354bfc2aa372 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:26.243893 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4862cd4-a4c9-4cd9-b718-2dc8f7a5713a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:26.245350 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e4862cd4-a4c9-4cd9-b718-2dc8f7a5713a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:26.318781 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251adea-3e23-45cd-80d3-7f1fe8fc1921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:26.319804 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251adea-3e23-45cd-80d3-7f1fe8fc1921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:26.320382 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251adea-3e23-45cd-80d3-7f1fe8fc1921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:26.320666 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251adea-3e23-45cd-80d3-7f1fe8fc1921 admin admin] PATH_INFO: `/v3/users/3d836297c6774e10ab68615182745be9` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:26.322045 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251adea-3e23-45cd-80d3-7f1fe8fc1921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d836297c6774e10ab68615182745be9)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:26.339508 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251adea-3e23-45cd-80d3-7f1fe8fc1921 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:26.343380 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4862cd4-a4c9-4cd9-b718-2dc8f7a5713a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:26.349740 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac67ab-5321-47ab-a096-b0644059bd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:26.350578 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac67ab-5321-47ab-a096-b0644059bd52 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:26.350959 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac67ab-5321-47ab-a096-b0644059bd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:26.351340 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac67ab-5321-47ab-a096-b0644059bd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:26.352438 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac67ab-5321-47ab-a096-b0644059bd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:26.356175 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac67ab-5321-47ab-a096-b0644059bd52 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:26.370667 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1009/2017] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:26.373318 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45115c-2a49-4031-b77f-289af11122dc None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:26.373711 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45115c-2a49-4031-b77f-289af11122dc None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:26.373996 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45115c-2a49-4031-b77f-289af11122dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:26.399600 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4c45115c-2a49-4031-b77f-289af11122dc None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:26.400832 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4c45115c-2a49-4031-b77f-289af11122dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:26.411356 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1010/2018] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:26.412206 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45115c-2a49-4031-b77f-289af11122dc None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:26.425681 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b251adea-3e23-45cd-80d3-7f1fe8fc1921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d836297c6774e10ab68615182745be9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:26.428719 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45115c-2a49-4031-b77f-289af11122dc None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:26.434238 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a28c3b-fff0-4172-b94b-9412b1652a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:26.434837 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a28c3b-fff0-4172-b94b-9412b1652a82 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:26.435166 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a28c3b-fff0-4172-b94b-9412b1652a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:26.435475 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a28c3b-fff0-4172-b94b-9412b1652a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:26.436248 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a28c3b-fff0-4172-b94b-9412b1652a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:26.437935 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a28c3b-fff0-4172-b94b-9412b1652a82 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:26.446121 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b251adea-3e23-45cd-80d3-7f1fe8fc1921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d836297c6774e10ab68615182745be9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:26.447154 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b251adea-3e23-45cd-80d3-7f1fe8fc1921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d836297c6774e10ab68615182745be9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:26.447973 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b251adea-3e23-45cd-80d3-7f1fe8fc1921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d836297c6774e10ab68615182745be9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:26.452863 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1011/2019] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:26.453213 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118fbc7-96c4-4d45-9ef8-f387225a82fc None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:26.453599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118fbc7-96c4-4d45-9ef8-f387225a82fc None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:26.454205 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118fbc7-96c4-4d45-9ef8-f387225a82fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:26.462006 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-b251adea-3e23-45cd-80d3-7f1fe8fc1921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d836297c6774e10ab68615182745be9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:26.476650 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1009/2020] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:26 2022] DELETE /identity/v3/users/3d836297c6774e10ab68615182745be9 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:26.477849 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251adea-3e23-45cd-80d3-7f1fe8fc1921 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:26.479378 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b251adea-3e23-45cd-80d3-7f1fe8fc1921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:26.489708 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d118fbc7-96c4-4d45-9ef8-f387225a82fc None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:26.491133 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d118fbc7-96c4-4d45-9ef8-f387225a82fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:26.566607 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251adea-3e23-45cd-80d3-7f1fe8fc1921 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:26.571565 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f937382-a44e-4f9d-9e87-8606b97629c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:26.572394 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f937382-a44e-4f9d-9e87-8606b97629c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:26.572676 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f937382-a44e-4f9d-9e87-8606b97629c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:26.573187 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1012/2021] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:26.577513 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f937382-a44e-4f9d-9e87-8606b97629c2 admin admin] PATH_INFO: `/v3/projects/a6faa9dc34ea48ef8de1acbf62a83f90/users/41d2e0381fd54e3e99605b2e512feea3/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:26.579589 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118fbc7-96c4-4d45-9ef8-f387225a82fc None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:26.593829 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118fbc7-96c4-4d45-9ef8-f387225a82fc None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:26.594785 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f937382-a44e-4f9d-9e87-8606b97629c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6faa9dc34ea48ef8de1acbf62a83f90, user_id=41d2e0381fd54e3e99605b2e512feea3, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:26.597948 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f937382-a44e-4f9d-9e87-8606b97629c2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:26.600802 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6db9f-bb65-439e-b442-4acbf222aa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:26.601997 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6db9f-bb65-439e-b442-4acbf222aa8f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:26.602402 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6db9f-bb65-439e-b442-4acbf222aa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:26.602689 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6db9f-bb65-439e-b442-4acbf222aa8f admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:26.604070 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6db9f-bb65-439e-b442-4acbf222aa8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:34:26.604515 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6db9f-bb65-439e-b442-4acbf222aa8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:26.606528 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6db9f-bb65-439e-b442-4acbf222aa8f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:26.620386 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1010/2022] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:26 2022] PUT /identity/v3/projects/a6faa9dc34ea48ef8de1acbf62a83f90/users/41d2e0381fd54e3e99605b2e512feea3/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:26.629216 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1013/2023] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:34:26.633545 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f937382-a44e-4f9d-9e87-8606b97629c2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:26.636659 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01544909-1e1f-44f0-b1e1-cf1872110728 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:26.636947 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01544909-1e1f-44f0-b1e1-cf1872110728 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:26.637382 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01544909-1e1f-44f0-b1e1-cf1872110728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:26.671560 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-01544909-1e1f-44f0-b1e1-cf1872110728 None None] MFA Rules not processed for user `41d2e0381fd54e3e99605b2e512feea3`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:26.672842 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-01544909-1e1f-44f0-b1e1-cf1872110728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:26.727845 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f937382-a44e-4f9d-9e87-8606b97629c2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:26.737666 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1f382-4bf6-414d-92fd-956897060a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:26.738328 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1f382-4bf6-414d-92fd-956897060a48 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:26.738614 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1f382-4bf6-414d-92fd-956897060a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:26.738982 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1f382-4bf6-414d-92fd-956897060a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:26.739695 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1f382-4bf6-414d-92fd-956897060a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:26.742346 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1f382-4bf6-414d-92fd-956897060a48 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:26.756639 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1014/2024] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:26.761679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01544909-1e1f-44f0-b1e1-cf1872110728 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:26.772659 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1011/2025] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:34:26 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:26.774668 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01544909-1e1f-44f0-b1e1-cf1872110728 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:26.776595 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1f382-4bf6-414d-92fd-956897060a48 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:26.838293 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4a68e-6823-405e-830e-f9f0bc19116f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:26.838880 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4a68e-6823-405e-830e-f9f0bc19116f admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:26.839161 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4a68e-6823-405e-830e-f9f0bc19116f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:26.839434 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4a68e-6823-405e-830e-f9f0bc19116f admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:26.839873 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1f382-4bf6-414d-92fd-956897060a48 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:26.840138 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4a68e-6823-405e-830e-f9f0bc19116f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:26.842250 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4a68e-6823-405e-830e-f9f0bc19116f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:26.849191 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9666263-87c4-436a-b204-ac6a6d054a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:26.850320 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9666263-87c4-436a-b204-ac6a6d054a70 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:26.850852 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9666263-87c4-436a-b204-ac6a6d054a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:26.851354 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9666263-87c4-436a-b204-ac6a6d054a70 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:26.852559 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9666263-87c4-436a-b204-ac6a6d054a70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:26.855826 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9666263-87c4-436a-b204-ac6a6d054a70 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:26.875714 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1015/2026] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:34:26 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:34:26.880008 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4a68e-6823-405e-830e-f9f0bc19116f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:26.885134 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1012/2027] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:34:26 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:34:26.885134 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9666263-87c4-436a-b204-ac6a6d054a70 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:26.888319 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d9666263-87c4-436a-b204-ac6a6d054a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:26.906121 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9666263-87c4-436a-b204-ac6a6d054a70 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:26.948249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4a68e-6823-405e-830e-f9f0bc19116f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:26.955596 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a309c7-43f0-4895-941e-d66c6ecf65b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:26.956520 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a309c7-43f0-4895-941e-d66c6ecf65b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:26.956857 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a309c7-43f0-4895-941e-d66c6ecf65b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:26.957144 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a309c7-43f0-4895-941e-d66c6ecf65b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:26.957936 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a309c7-43f0-4895-941e-d66c6ecf65b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:26.960001 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a309c7-43f0-4895-941e-d66c6ecf65b9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:26.972824 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1968902-095b-49ff-81a6-090620dafb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:26.973735 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1968902-095b-49ff-81a6-090620dafb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:26.974059 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1968902-095b-49ff-81a6-090620dafb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:26.974337 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1968902-095b-49ff-81a6-090620dafb77 admin admin] PATH_INFO: `/v3/projects/9a812fb685ec4116832d31e2fcdc774e` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:26.975603 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1968902-095b-49ff-81a6-090620dafb77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a812fb685ec4116832d31e2fcdc774e)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:26.977649 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1968902-095b-49ff-81a6-090620dafb77 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:26.984952 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1016/2028] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:34:26 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:34:26.985877 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a309c7-43f0-4895-941e-d66c6ecf65b9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:26.996005 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a309c7-43f0-4895-941e-d66c6ecf65b9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:27.001291 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786a4a5-8628-467d-bb9d-083cecbb7984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:27.001966 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786a4a5-8628-467d-bb9d-083cecbb7984 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:27.002245 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786a4a5-8628-467d-bb9d-083cecbb7984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:27.002517 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786a4a5-8628-467d-bb9d-083cecbb7984 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:27.003268 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786a4a5-8628-467d-bb9d-083cecbb7984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:27.004871 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786a4a5-8628-467d-bb9d-083cecbb7984 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:27.015640 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1017/2029] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:27.018364 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786a4a5-8628-467d-bb9d-083cecbb7984 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:27.030413 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786a4a5-8628-467d-bb9d-083cecbb7984 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:27.034682 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f1968902-095b-49ff-81a6-090620dafb77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a812fb685ec4116832d31e2fcdc774e', 'request_id': 'req-f1968902-095b-49ff-81a6-090620dafb77'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:27.043444 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f1968902-095b-49ff-81a6-090620dafb77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a812fb685ec4116832d31e2fcdc774e', 'request_id': 'req-f1968902-095b-49ff-81a6-090620dafb77'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:27.049753 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f1968902-095b-49ff-81a6-090620dafb77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a812fb685ec4116832d31e2fcdc774e', 'request_id': 'req-f1968902-095b-49ff-81a6-090620dafb77'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:27.060872 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f1968902-095b-49ff-81a6-090620dafb77 admin admin] The token cache is being invalidate because project 9a812fb685ec4116832d31e2fcdc774e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:27.061155 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f1968902-095b-49ff-81a6-090620dafb77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:27.061848 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f1968902-095b-49ff-81a6-090620dafb77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:27.063414 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1013/2030] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:26 2022] DELETE /identity/v3/projects/9a812fb685ec4116832d31e2fcdc774e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:27.064162 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1968902-095b-49ff-81a6-090620dafb77 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:27.065485 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f1968902-095b-49ff-81a6-090620dafb77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:27.088499 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d6dd1-8dbb-4a6c-8472-daad7109fde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:27.089112 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d6dd1-8dbb-4a6c-8472-daad7109fde8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:27.089491 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d6dd1-8dbb-4a6c-8472-daad7109fde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:27.089766 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d6dd1-8dbb-4a6c-8472-daad7109fde8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:27.090514 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d6dd1-8dbb-4a6c-8472-daad7109fde8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:27.092669 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d6dd1-8dbb-4a6c-8472-daad7109fde8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:27.102457 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1018/2031] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:27.103789 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3c60b-d1cf-4e26-a151-a9051764146c None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:27.104075 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3c60b-d1cf-4e26-a151-a9051764146c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:27.104348 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3c60b-d1cf-4e26-a151-a9051764146c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:27.122091 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-eee3c60b-d1cf-4e26-a151-a9051764146c None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:27.123272 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-eee3c60b-d1cf-4e26-a151-a9051764146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:27.130099 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1968902-095b-49ff-81a6-090620dafb77 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:27.131033 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1019/2032] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:27.131977 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3c60b-d1cf-4e26-a151-a9051764146c None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:27.133199 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-eee3c60b-d1cf-4e26-a151-a9051764146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:27.141452 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382591f2-0106-480d-af39-562a6f394f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:27.142123 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382591f2-0106-480d-af39-562a6f394f6e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:27.142408 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382591f2-0106-480d-af39-562a6f394f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:27.142680 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382591f2-0106-480d-af39-562a6f394f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:27.143406 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382591f2-0106-480d-af39-562a6f394f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:27.144398 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3c60b-d1cf-4e26-a151-a9051764146c None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:27.145297 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382591f2-0106-480d-af39-562a6f394f6e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:27.149015 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bc40c-3918-4fbe-87c5-e8929cc9e9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:27.149910 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bc40c-3918-4fbe-87c5-e8929cc9e9d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:27.150182 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bc40c-3918-4fbe-87c5-e8929cc9e9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:27.150453 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bc40c-3918-4fbe-87c5-e8929cc9e9d2 admin admin] PATH_INFO: `/v3/projects/4bd5bb333d3d4606a7c77045262cbce6/users/f7011ea6568847d283ba729f7de761d6/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:27.155809 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1014/2033] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:27.157043 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da655083-ffd1-4341-95f7-0bd216b24f2d None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:27.157349 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da655083-ffd1-4341-95f7-0bd216b24f2d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:27.157623 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da655083-ffd1-4341-95f7-0bd216b24f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:27.166462 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bc40c-3918-4fbe-87c5-e8929cc9e9d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd5bb333d3d4606a7c77045262cbce6, user_id=f7011ea6568847d283ba729f7de761d6, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:27.169127 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bc40c-3918-4fbe-87c5-e8929cc9e9d2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:27.177902 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-da655083-ffd1-4341-95f7-0bd216b24f2d None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:27.179207 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-da655083-ffd1-4341-95f7-0bd216b24f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:27.183657 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1020/2034] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:27 2022] PUT /identity/v3/projects/4bd5bb333d3d4606a7c77045262cbce6/users/f7011ea6568847d283ba729f7de761d6/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:27.184859 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bc40c-3918-4fbe-87c5-e8929cc9e9d2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:27.243336 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1015/2035] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:27.244180 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da655083-ffd1-4341-95f7-0bd216b24f2d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:27.253374 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da655083-ffd1-4341-95f7-0bd216b24f2d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:27.256052 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bc40c-3918-4fbe-87c5-e8929cc9e9d2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:27.258377 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396554f0-3d4a-4f7c-b36d-87c8ed3382b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:27.259056 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396554f0-3d4a-4f7c-b36d-87c8ed3382b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:27.259336 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396554f0-3d4a-4f7c-b36d-87c8ed3382b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:27.259608 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396554f0-3d4a-4f7c-b36d-87c8ed3382b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:27.260331 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396554f0-3d4a-4f7c-b36d-87c8ed3382b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:27.261425 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b510f-41b5-44ca-8df5-4a5920901bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:27.261988 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396554f0-3d4a-4f7c-b36d-87c8ed3382b9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:27.262329 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b510f-41b5-44ca-8df5-4a5920901bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:27.262604 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b510f-41b5-44ca-8df5-4a5920901bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:27.262872 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b510f-41b5-44ca-8df5-4a5920901bc3 admin admin] PATH_INFO: `/v3/projects/c62e07faeaef4a67a91d6ba3d3c2bcd6/users/4c89a8ad5898427cb398612c89807cd4/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:27.272643 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1016/2036] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:27.276315 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396554f0-3d4a-4f7c-b36d-87c8ed3382b9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:27.280635 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b510f-41b5-44ca-8df5-4a5920901bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c62e07faeaef4a67a91d6ba3d3c2bcd6, user_id=4c89a8ad5898427cb398612c89807cd4, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:27.283667 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38b510f-41b5-44ca-8df5-4a5920901bc3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:27.286497 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396554f0-3d4a-4f7c-b36d-87c8ed3382b9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:27.292523 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f642ea-e380-4bbe-bb52-1c92fb39da36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:27.293180 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f642ea-e380-4bbe-bb52-1c92fb39da36 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:27.293494 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f642ea-e380-4bbe-bb52-1c92fb39da36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:27.293770 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f642ea-e380-4bbe-bb52-1c92fb39da36 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:27.294776 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f642ea-e380-4bbe-bb52-1c92fb39da36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:34:27.295207 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f642ea-e380-4bbe-bb52-1c92fb39da36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:27.297476 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f642ea-e380-4bbe-bb52-1c92fb39da36 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:27.299771 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1021/2037] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:27 2022] PUT /identity/v3/projects/c62e07faeaef4a67a91d6ba3d3c2bcd6/users/4c89a8ad5898427cb398612c89807cd4/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:27.302087 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b510f-41b5-44ca-8df5-4a5920901bc3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:27.313524 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1017/2038] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:34:27.313524 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573759cc-eb79-4b13-88de-cafd55074222 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:27.313524 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573759cc-eb79-4b13-88de-cafd55074222 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:27.313524 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573759cc-eb79-4b13-88de-cafd55074222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:27.339509 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-573759cc-eb79-4b13-88de-cafd55074222 None None] MFA Rules not processed for user `4c89a8ad5898427cb398612c89807cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:27.340721 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-573759cc-eb79-4b13-88de-cafd55074222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:27.370189 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38b510f-41b5-44ca-8df5-4a5920901bc3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:27.374888 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820291b0-cd70-4b03-bf14-ef53ac0601b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:27.375764 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820291b0-cd70-4b03-bf14-ef53ac0601b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:27.376040 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820291b0-cd70-4b03-bf14-ef53ac0601b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:27.376305 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820291b0-cd70-4b03-bf14-ef53ac0601b0 admin admin] PATH_INFO: `/v3/projects/4bd5bb333d3d4606a7c77045262cbce6/users/f7011ea6568847d283ba729f7de761d6/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:27.378325 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820291b0-cd70-4b03-bf14-ef53ac0601b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd5bb333d3d4606a7c77045262cbce6, user_id=f7011ea6568847d283ba729f7de761d6, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:27.380961 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820291b0-cd70-4b03-bf14-ef53ac0601b0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:27.392600 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1022/2039] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:27 2022] PUT /identity/v3/projects/4bd5bb333d3d4606a7c77045262cbce6/users/f7011ea6568847d283ba729f7de761d6/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:27.393779 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820291b0-cd70-4b03-bf14-ef53ac0601b0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:27.419684 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1018/2040] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:27.421385 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaec27e-e5f5-4c0f-adf5-c3ab99609e67 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:27.421743 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaec27e-e5f5-4c0f-adf5-c3ab99609e67 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:27.422084 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaec27e-e5f5-4c0f-adf5-c3ab99609e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:27.454958 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ffaec27e-e5f5-4c0f-adf5-c3ab99609e67 None None] MFA Rules not processed for user `f7011ea6568847d283ba729f7de761d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:27.456402 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ffaec27e-e5f5-4c0f-adf5-c3ab99609e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:27.484090 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820291b0-cd70-4b03-bf14-ef53ac0601b0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:27.492010 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acafdc-7461-41a1-afa1-ed6826df5a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:27.492923 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acafdc-7461-41a1-afa1-ed6826df5a93 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:27.493211 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acafdc-7461-41a1-afa1-ed6826df5a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:27.494212 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acafdc-7461-41a1-afa1-ed6826df5a93 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:27.494930 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1acafdc-7461-41a1-afa1-ed6826df5a93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:27.496582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1acafdc-7461-41a1-afa1-ed6826df5a93 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:27.536961 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1023/2041] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:34:27 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:27.536961 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acafdc-7461-41a1-afa1-ed6826df5a93 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:27.538380 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c1acafdc-7461-41a1-afa1-ed6826df5a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:27.552030 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1019/2042] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:27.552712 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaec27e-e5f5-4c0f-adf5-c3ab99609e67 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:27.565004 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaec27e-e5f5-4c0f-adf5-c3ab99609e67 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:27.628243 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319e8c2-e1c9-4b33-83f1-db755d7ec166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:27.629032 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319e8c2-e1c9-4b33-83f1-db755d7ec166 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:27.631785 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319e8c2-e1c9-4b33-83f1-db755d7ec166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:27.631785 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319e8c2-e1c9-4b33-83f1-db755d7ec166 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:27.631785 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319e8c2-e1c9-4b33-83f1-db755d7ec166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:27.632487 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319e8c2-e1c9-4b33-83f1-db755d7ec166 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:27.640112 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acafdc-7461-41a1-afa1-ed6826df5a93 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:27.648509 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0befb-3869-4589-8a88-416bacfaad61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:27.649300 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0befb-3869-4589-8a88-416bacfaad61 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:27.649597 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0befb-3869-4589-8a88-416bacfaad61 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:27.649863 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0befb-3869-4589-8a88-416bacfaad61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:27.660753 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1020/2043] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:34:27 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:27.661785 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319e8c2-e1c9-4b33-83f1-db755d7ec166 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:27.663363 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-1319e8c2-e1c9-4b33-83f1-db755d7ec166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:27.725480 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0befb-3869-4589-8a88-416bacfaad61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:27.727113 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0befb-3869-4589-8a88-416bacfaad61 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:27.732512 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319e8c2-e1c9-4b33-83f1-db755d7ec166 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:27.736863 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1024/2044] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:27.737291 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab500eba-50a6-470a-9568-c57cf0cc3c63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:27.737743 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0befb-3869-4589-8a88-416bacfaad61 service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:27.738425 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab500eba-50a6-470a-9568-c57cf0cc3c63 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:27.739056 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab500eba-50a6-470a-9568-c57cf0cc3c63 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:27.739534 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab500eba-50a6-470a-9568-c57cf0cc3c63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:27.741686 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ab500eba-50a6-470a-9568-c57cf0cc3c63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:27.748038 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0befb-3869-4589-8a88-416bacfaad61 service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:27.753313 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e7035-f4c0-47b4-9171-b2914add8db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:27.754548 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e7035-f4c0-47b4-9171-b2914add8db8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:27.755183 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e7035-f4c0-47b4-9171-b2914add8db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:27.755456 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e7035-f4c0-47b4-9171-b2914add8db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:27.756183 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e7035-f4c0-47b4-9171-b2914add8db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:27.757800 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e7035-f4c0-47b4-9171-b2914add8db8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:27.770762 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1025/2045] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:27.774898 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e7035-f4c0-47b4-9171-b2914add8db8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:27.786710 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e7035-f4c0-47b4-9171-b2914add8db8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:27.797989 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d77a2-6d16-4b6d-be0c-57ce78346dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:27.799142 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d77a2-6d16-4b6d-be0c-57ce78346dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:27.800222 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d77a2-6d16-4b6d-be0c-57ce78346dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:27.800700 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d77a2-6d16-4b6d-be0c-57ce78346dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:27.801810 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d77a2-6d16-4b6d-be0c-57ce78346dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:27.804449 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d77a2-6d16-4b6d-be0c-57ce78346dd7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:27.818566 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1026/2046] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:27 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:27.823397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d77a2-6d16-4b6d-be0c-57ce78346dd7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:27.825641 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab500eba-50a6-470a-9568-c57cf0cc3c63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:27.827618 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab500eba-50a6-470a-9568-c57cf0cc3c63 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:27.838198 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1021/2047] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:27.841803 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d77a2-6d16-4b6d-be0c-57ce78346dd7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:27.850102 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6eaa65-605d-48af-ba78-652b20f2c14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:27.851791 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6eaa65-605d-48af-ba78-652b20f2c14b admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:27.851791 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6eaa65-605d-48af-ba78-652b20f2c14b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:27.851791 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6eaa65-605d-48af-ba78-652b20f2c14b admin admin] PATH_INFO: `/v3/projects/ef5ac29a6d674d778718648b4bf05e17/users/e523f071b1ce4fffb80924e66f5d5bb7/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:27.870717 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6eaa65-605d-48af-ba78-652b20f2c14b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5ac29a6d674d778718648b4bf05e17, user_id=e523f071b1ce4fffb80924e66f5d5bb7, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:27.874366 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6eaa65-605d-48af-ba78-652b20f2c14b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:27.909684 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1027/2048] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:27 2022] PUT /identity/v3/projects/ef5ac29a6d674d778718648b4bf05e17/users/e523f071b1ce4fffb80924e66f5d5bb7/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:34:27.926662 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c779c42-8eb5-4218-ba41-b33134649e38 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:27.927043 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c779c42-8eb5-4218-ba41-b33134649e38 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:27.927395 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c779c42-8eb5-4218-ba41-b33134649e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:27.966978 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-2c779c42-8eb5-4218-ba41-b33134649e38 None None] MFA Rules not processed for user `e523f071b1ce4fffb80924e66f5d5bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:27.968889 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2c779c42-8eb5-4218-ba41-b33134649e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:28.059960 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1022/2049] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:28.073675 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6eaa65-605d-48af-ba78-652b20f2c14b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:28.076311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ce6eaa65-605d-48af-ba78-652b20f2c14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:28.206241 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6eaa65-605d-48af-ba78-652b20f2c14b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:28.216033 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc78cf-5812-4d61-b722-4749dd633ecd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8e4a7763524f4190c5cd66e27b5910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:28.217224 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc78cf-5812-4d61-b722-4749dd633ecd service glance] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:28.217520 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc78cf-5812-4d61-b722-4749dd633ecd service glance] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:28.217791 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc78cf-5812-4d61-b722-4749dd633ecd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:28.228915 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc78cf-5812-4d61-b722-4749dd633ecd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:28.230587 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc78cf-5812-4d61-b722-4749dd633ecd service glance] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:28.256294 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1028/2050] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:30.571258 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c779c42-8eb5-4218-ba41-b33134649e38 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:30.572685 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2c779c42-8eb5-4218-ba41-b33134649e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:30.629608 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c779c42-8eb5-4218-ba41-b33134649e38 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:30.633153 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b9e95-15cd-4db7-9392-ec90bf34a9f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:30.633820 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b9e95-15cd-4db7-9392-ec90bf34a9f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:30.634105 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b9e95-15cd-4db7-9392-ec90bf34a9f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:30.634382 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b9e95-15cd-4db7-9392-ec90bf34a9f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:30.636123 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-af1b9e95-15cd-4db7-9392-ec90bf34a9f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:30.695887 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b9e95-15cd-4db7-9392-ec90bf34a9f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:30.697707 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b9e95-15cd-4db7-9392-ec90bf34a9f7 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:30.709519 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1023/2051] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:30.728822 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc78cf-5812-4d61-b722-4749dd633ecd service glance] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:30.796425 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc78cf-5812-4d61-b722-4749dd633ecd service glance] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:30.801415 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724591b-38fd-4007-9181-01ee2a383668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:30.802360 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724591b-38fd-4007-9181-01ee2a383668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:30.802639 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724591b-38fd-4007-9181-01ee2a383668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:30.802911 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724591b-38fd-4007-9181-01ee2a383668 admin admin] PATH_INFO: `/v3/users/4c89a8ad5898427cb398612c89807cd4` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:30.804448 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724591b-38fd-4007-9181-01ee2a383668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c89a8ad5898427cb398612c89807cd4)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:30.807122 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724591b-38fd-4007-9181-01ee2a383668 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:30.873161 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6724591b-38fd-4007-9181-01ee2a383668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c89a8ad5898427cb398612c89807cd4'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:30.897180 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6724591b-38fd-4007-9181-01ee2a383668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c89a8ad5898427cb398612c89807cd4'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:30.934162 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6724591b-38fd-4007-9181-01ee2a383668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c89a8ad5898427cb398612c89807cd4'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:30.935992 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6724591b-38fd-4007-9181-01ee2a383668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c89a8ad5898427cb398612c89807cd4'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:30.937349 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6724591b-38fd-4007-9181-01ee2a383668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c89a8ad5898427cb398612c89807cd4'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:30.954055 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1029/2052] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:30 2022] DELETE /identity/v3/users/4c89a8ad5898427cb398612c89807cd4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:30.958688 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616e5be-7436-4f80-941d-22e8928a71b3 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:30.959103 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616e5be-7436-4f80-941d-22e8928a71b3 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:30.959618 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616e5be-7436-4f80-941d-22e8928a71b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:30.985683 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-0616e5be-7436-4f80-941d-22e8928a71b3 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:30.986909 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0616e5be-7436-4f80-941d-22e8928a71b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:31.060790 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1024/2053] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:31.070594 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724591b-38fd-4007-9181-01ee2a383668 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:31.072553 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6724591b-38fd-4007-9181-01ee2a383668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:31.134125 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724591b-38fd-4007-9181-01ee2a383668 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:31.139994 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ced76-952a-41d4-8379-80de072a9831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:31.140829 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ced76-952a-41d4-8379-80de072a9831 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:31.141098 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ced76-952a-41d4-8379-80de072a9831 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:31.141405 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ced76-952a-41d4-8379-80de072a9831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:31.151098 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ced76-952a-41d4-8379-80de072a9831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:31.153279 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ced76-952a-41d4-8379-80de072a9831 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:31.165103 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1030/2054] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:31.390409 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616e5be-7436-4f80-941d-22e8928a71b3 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:31.391911 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0616e5be-7436-4f80-941d-22e8928a71b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:31.452161 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616e5be-7436-4f80-941d-22e8928a71b3 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:31.457216 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac3a3f-842a-47cd-bd8f-9cce2bed5f44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:31.457872 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac3a3f-842a-47cd-bd8f-9cce2bed5f44 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:31.458154 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac3a3f-842a-47cd-bd8f-9cce2bed5f44 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:31.458427 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac3a3f-842a-47cd-bd8f-9cce2bed5f44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:31.460421 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3aac3a3f-842a-47cd-bd8f-9cce2bed5f44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:31.470860 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ced76-952a-41d4-8379-80de072a9831 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:31.472311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-069ced76-952a-41d4-8379-80de072a9831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:31.486389 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ced76-952a-41d4-8379-80de072a9831 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:31.491739 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94405d49-c2cc-4427-8b2c-ce732e62c990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:31.492858 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94405d49-c2cc-4427-8b2c-ce732e62c990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:31.493166 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94405d49-c2cc-4427-8b2c-ce732e62c990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:31.493459 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94405d49-c2cc-4427-8b2c-ce732e62c990 admin admin] PATH_INFO: `/v3/projects/c62e07faeaef4a67a91d6ba3d3c2bcd6` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:31.494689 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94405d49-c2cc-4427-8b2c-ce732e62c990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c62e07faeaef4a67a91d6ba3d3c2bcd6)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:31.496770 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94405d49-c2cc-4427-8b2c-ce732e62c990 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:31.540399 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac3a3f-842a-47cd-bd8f-9cce2bed5f44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:31.541922 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac3a3f-842a-47cd-bd8f-9cce2bed5f44 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:31.545954 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-94405d49-c2cc-4427-8b2c-ce732e62c990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c62e07faeaef4a67a91d6ba3d3c2bcd6', 'request_id': 'req-94405d49-c2cc-4427-8b2c-ce732e62c990'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:31.552596 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1025/2055] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:31 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:31.555034 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-94405d49-c2cc-4427-8b2c-ce732e62c990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c62e07faeaef4a67a91d6ba3d3c2bcd6', 'request_id': 'req-94405d49-c2cc-4427-8b2c-ce732e62c990'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:31.562067 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-94405d49-c2cc-4427-8b2c-ce732e62c990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c62e07faeaef4a67a91d6ba3d3c2bcd6', 'request_id': 'req-94405d49-c2cc-4427-8b2c-ce732e62c990'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:31.578025 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-94405d49-c2cc-4427-8b2c-ce732e62c990 admin admin] The token cache is being invalidate because project c62e07faeaef4a67a91d6ba3d3c2bcd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:31.578313 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-94405d49-c2cc-4427-8b2c-ce732e62c990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:31.578981 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-94405d49-c2cc-4427-8b2c-ce732e62c990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:31.580536 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1031/2056] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:31 2022] DELETE /identity/v3/projects/c62e07faeaef4a67a91d6ba3d3c2bcd6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:34:31.585517 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041ef33-46c3-488b-b6fa-4031e3c8fab2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:31.586013 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041ef33-46c3-488b-b6fa-4031e3c8fab2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:31.586105 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041ef33-46c3-488b-b6fa-4031e3c8fab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:31.606004 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-7041ef33-46c3-488b-b6fa-4031e3c8fab2 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:31.607293 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7041ef33-46c3-488b-b6fa-4031e3c8fab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:31.642190 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadd92c-e85f-4371-a80f-f4c83cac8b00 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:31.642474 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadd92c-e85f-4371-a80f-f4c83cac8b00 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:31.642747 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadd92c-e85f-4371-a80f-f4c83cac8b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:31.667356 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-cdadd92c-e85f-4371-a80f-f4c83cac8b00 None None] MFA Rules not processed for user `7e792fde8d97434b95de7a9b58a41d14`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:31.668826 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cdadd92c-e85f-4371-a80f-f4c83cac8b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:31.685689 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1026/2057] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:31.694582 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2002d-f150-451e-9bb5-60554f6302d1 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:31.694963 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2002d-f150-451e-9bb5-60554f6302d1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:31.695534 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2002d-f150-451e-9bb5-60554f6302d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:31.714753 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-b4a2002d-f150-451e-9bb5-60554f6302d1 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:31.716021 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b4a2002d-f150-451e-9bb5-60554f6302d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:31.724273 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1027/2058] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:31.726166 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1032/2059] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:34:31.728431 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2002d-f150-451e-9bb5-60554f6302d1 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:31.738095 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2002d-f150-451e-9bb5-60554f6302d1 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:31.742711 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98107b42-d101-40d2-9a31-432e30095b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:31.743351 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98107b42-d101-40d2-9a31-432e30095b12 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:31.743630 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98107b42-d101-40d2-9a31-432e30095b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:31.743899 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98107b42-d101-40d2-9a31-432e30095b12 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:31.744617 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98107b42-d101-40d2-9a31-432e30095b12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:34:31.744922 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98107b42-d101-40d2-9a31-432e30095b12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:31.746552 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98107b42-d101-40d2-9a31-432e30095b12 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:31.762241 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1028/2060] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:34:31.763427 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdadd92c-e85f-4371-a80f-f4c83cac8b00 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:31.774379 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdadd92c-e85f-4371-a80f-f4c83cac8b00 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:31.781507 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7578e-4072-49e3-9681-f5d007f83adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:31.782153 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7578e-4072-49e3-9681-f5d007f83adb admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:31.782433 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7578e-4072-49e3-9681-f5d007f83adb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:31.782715 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7578e-4072-49e3-9681-f5d007f83adb admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:31.783384 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7578e-4072-49e3-9681-f5d007f83adb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:31.785319 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a7578e-4072-49e3-9681-f5d007f83adb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:31.812981 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1033/2061] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:34:31 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:31.817175 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98107b42-d101-40d2-9a31-432e30095b12 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:31.827144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98107b42-d101-40d2-9a31-432e30095b12 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:31.888248 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1a259-7ccd-463d-99ea-acbb29e83f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:31.888918 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1a259-7ccd-463d-99ea-acbb29e83f70 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:31.889202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1a259-7ccd-463d-99ea-acbb29e83f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:31.889508 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1a259-7ccd-463d-99ea-acbb29e83f70 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:31.890216 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1a259-7ccd-463d-99ea-acbb29e83f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:31.892159 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1a259-7ccd-463d-99ea-acbb29e83f70 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:31.912512 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1029/2062] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:34:31 2022] POST /identity/v3/users => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:34:31.916871 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7578e-4072-49e3-9681-f5d007f83adb admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:31.931816 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7578e-4072-49e3-9681-f5d007f83adb admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:31.946196 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ce6b5-b4bc-4e28-b163-bddeb7a3b132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:31.946875 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ce6b5-b4bc-4e28-b163-bddeb7a3b132 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:31.947154 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ce6b5-b4bc-4e28-b163-bddeb7a3b132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:31.947419 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ce6b5-b4bc-4e28-b163-bddeb7a3b132 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:31.953112 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ce6b5-b4bc-4e28-b163-bddeb7a3b132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:31.953112 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ce6b5-b4bc-4e28-b163-bddeb7a3b132 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:31.971351 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1034/2063] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:31.976489 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1a259-7ccd-463d-99ea-acbb29e83f70 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:31.992079 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1a259-7ccd-463d-99ea-acbb29e83f70 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:32.007431 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07feaf5-e0fe-40e6-947d-4f4cbfb7f8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:32.008235 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07feaf5-e0fe-40e6-947d-4f4cbfb7f8ac admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:32.008515 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07feaf5-e0fe-40e6-947d-4f4cbfb7f8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:32.008835 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07feaf5-e0fe-40e6-947d-4f4cbfb7f8ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:32.009603 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07feaf5-e0fe-40e6-947d-4f4cbfb7f8ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:32.011295 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07feaf5-e0fe-40e6-947d-4f4cbfb7f8ac admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:32.027236 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1030/2064] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:32.030311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ce6b5-b4bc-4e28-b163-bddeb7a3b132 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:32.043333 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ce6b5-b4bc-4e28-b163-bddeb7a3b132 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:32.050778 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f841666-76c4-474b-807a-7ee3388ac971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:32.051799 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f841666-76c4-474b-807a-7ee3388ac971 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:32.051983 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f841666-76c4-474b-807a-7ee3388ac971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:32.052252 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f841666-76c4-474b-807a-7ee3388ac971 admin admin] PATH_INFO: `/v3/projects/d351d74a193242b1b48d7c20a43d5fd5/users/1630394ecafb409cbf3b0f6ced67f12f/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:32.073216 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f841666-76c4-474b-807a-7ee3388ac971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d351d74a193242b1b48d7c20a43d5fd5, user_id=1630394ecafb409cbf3b0f6ced67f12f, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:32.075926 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f841666-76c4-474b-807a-7ee3388ac971 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:32.099973 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1035/2065] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:32 2022] PUT /identity/v3/projects/d351d74a193242b1b48d7c20a43d5fd5/users/1630394ecafb409cbf3b0f6ced67f12f/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:34:32.111761 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9003658-cbd6-4999-bbfa-6c12c6b85254 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:32.112044 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9003658-cbd6-4999-bbfa-6c12c6b85254 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:32.112316 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9003658-cbd6-4999-bbfa-6c12c6b85254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:32.152654 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-e9003658-cbd6-4999-bbfa-6c12c6b85254 None None] MFA Rules not processed for user `1630394ecafb409cbf3b0f6ced67f12f`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:32.154769 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e9003658-cbd6-4999-bbfa-6c12c6b85254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:32.252268 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1031/2066] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:32.253416 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f841666-76c4-474b-807a-7ee3388ac971 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:32.354085 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f841666-76c4-474b-807a-7ee3388ac971 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:32.369438 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2b7c2-efa6-4835-87cf-872b3163daa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:32.370308 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2b7c2-efa6-4835-87cf-872b3163daa9 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:32.370738 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2b7c2-efa6-4835-87cf-872b3163daa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:32.371167 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2b7c2-efa6-4835-87cf-872b3163daa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:32.372321 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2b7c2-efa6-4835-87cf-872b3163daa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:32.374378 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b2b7c2-efa6-4835-87cf-872b3163daa9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:32.406634 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1036/2067] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:34:32 2022] POST /identity/v3/projects => generated 405 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:32.410954 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9003658-cbd6-4999-bbfa-6c12c6b85254 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:32.443268 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9003658-cbd6-4999-bbfa-6c12c6b85254 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:32.539142 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fe328-73c7-4a10-bb7c-975b5afbf8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:32.539626 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fe328-73c7-4a10-bb7c-975b5afbf8b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:32.540004 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fe328-73c7-4a10-bb7c-975b5afbf8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:32.540452 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fe328-73c7-4a10-bb7c-975b5afbf8b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:32.541399 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6fe328-73c7-4a10-bb7c-975b5afbf8b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:32.543449 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6fe328-73c7-4a10-bb7c-975b5afbf8b3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:32.574030 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1032/2068] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:34:32 2022] POST /identity/v3/users => generated 309 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:32.574789 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2b7c2-efa6-4835-87cf-872b3163daa9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:32.587675 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b2b7c2-efa6-4835-87cf-872b3163daa9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:32.594843 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3665de0-a93f-4840-ba71-70cd0ec7353e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:32.595564 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3665de0-a93f-4840-ba71-70cd0ec7353e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:32.596343 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3665de0-a93f-4840-ba71-70cd0ec7353e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:32.596628 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3665de0-a93f-4840-ba71-70cd0ec7353e admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:32.598024 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3665de0-a93f-4840-ba71-70cd0ec7353e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:32.599630 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3665de0-a93f-4840-ba71-70cd0ec7353e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:32.615895 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1037/2069] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:32.620508 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fe328-73c7-4a10-bb7c-975b5afbf8b3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:32.631535 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fe328-73c7-4a10-bb7c-975b5afbf8b3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:32.637851 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d2da1-dc85-4f62-886c-2775d6d5d179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:32.639301 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d2da1-dc85-4f62-886c-2775d6d5d179 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:32.639601 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d2da1-dc85-4f62-886c-2775d6d5d179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:32.639860 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d2da1-dc85-4f62-886c-2775d6d5d179 admin admin] PATH_INFO: `/v3/projects/eaaee6934b69430392dffe1c98c446eb/users/cbfea77901134c12be9b501b83df444c/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:32.664137 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d2da1-dc85-4f62-886c-2775d6d5d179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaaee6934b69430392dffe1c98c446eb, user_id=cbfea77901134c12be9b501b83df444c, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:32.667377 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d2da1-dc85-4f62-886c-2775d6d5d179 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:32.690008 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1033/2070] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:32 2022] PUT /identity/v3/projects/eaaee6934b69430392dffe1c98c446eb/users/cbfea77901134c12be9b501b83df444c/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:32.693873 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3665de0-a93f-4840-ba71-70cd0ec7353e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:32.706268 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3665de0-a93f-4840-ba71-70cd0ec7353e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:32.778808 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f3f8f-93e5-4292-b97f-442ecfd44c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:32.785226 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f3f8f-93e5-4292-b97f-442ecfd44c4c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:32.785548 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f3f8f-93e5-4292-b97f-442ecfd44c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:32.786123 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f3f8f-93e5-4292-b97f-442ecfd44c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:32.786573 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f3f8f-93e5-4292-b97f-442ecfd44c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:32.788188 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f3f8f-93e5-4292-b97f-442ecfd44c4c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:32.800197 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1038/2071] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:32.804633 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d2da1-dc85-4f62-886c-2775d6d5d179 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:32.815564 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d2da1-dc85-4f62-886c-2775d6d5d179 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:32.821289 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2486cf1-9a5a-49dc-a3b8-5408dfea00a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:32.822445 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2486cf1-9a5a-49dc-a3b8-5408dfea00a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:32.822831 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2486cf1-9a5a-49dc-a3b8-5408dfea00a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:32.823116 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2486cf1-9a5a-49dc-a3b8-5408dfea00a0 admin admin] PATH_INFO: `/v3/projects/eaaee6934b69430392dffe1c98c446eb/users/cbfea77901134c12be9b501b83df444c/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:32.826050 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2486cf1-9a5a-49dc-a3b8-5408dfea00a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaaee6934b69430392dffe1c98c446eb, user_id=cbfea77901134c12be9b501b83df444c, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:32.828834 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2486cf1-9a5a-49dc-a3b8-5408dfea00a0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:32.845692 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1034/2072] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:32 2022] PUT /identity/v3/projects/eaaee6934b69430392dffe1c98c446eb/users/cbfea77901134c12be9b501b83df444c/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:32.856133 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8db011-703e-4e9a-92cc-583b296b2459 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:32.856420 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8db011-703e-4e9a-92cc-583b296b2459 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:32.856727 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8db011-703e-4e9a-92cc-583b296b2459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:32.893410 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4c8db011-703e-4e9a-92cc-583b296b2459 None None] MFA Rules not processed for user `cbfea77901134c12be9b501b83df444c`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:32.894620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4c8db011-703e-4e9a-92cc-583b296b2459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:32.977721 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1039/2073] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:32 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:32.988521 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2486cf1-9a5a-49dc-a3b8-5408dfea00a0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:32.990525 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c2486cf1-9a5a-49dc-a3b8-5408dfea00a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:33.071053 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2486cf1-9a5a-49dc-a3b8-5408dfea00a0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:33.075209 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c059f43-6603-4498-93b4-e7739625599f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:33.076427 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c059f43-6603-4498-93b4-e7739625599f service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:33.076725 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c059f43-6603-4498-93b4-e7739625599f service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:33.077054 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c059f43-6603-4498-93b4-e7739625599f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:33.087738 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c059f43-6603-4498-93b4-e7739625599f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:33.088650 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c059f43-6603-4498-93b4-e7739625599f service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:33.099693 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1035/2074] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:32 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:33.431796 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8db011-703e-4e9a-92cc-583b296b2459 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:33.494097 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8db011-703e-4e9a-92cc-583b296b2459 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:33.499334 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b615ba-86ee-4e9e-9de7-d5d44d3b08de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:33.500198 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b615ba-86ee-4e9e-9de7-d5d44d3b08de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:33.500479 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b615ba-86ee-4e9e-9de7-d5d44d3b08de admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:33.500755 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b615ba-86ee-4e9e-9de7-d5d44d3b08de admin admin] PATH_INFO: `/v3/users/1630394ecafb409cbf3b0f6ced67f12f` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:33.502007 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b615ba-86ee-4e9e-9de7-d5d44d3b08de admin admin] RBAC: Authorizing `identity:delete_user(user_id=1630394ecafb409cbf3b0f6ced67f12f)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:33.503968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b615ba-86ee-4e9e-9de7-d5d44d3b08de admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:33.556750 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e3b615ba-86ee-4e9e-9de7-d5d44d3b08de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1630394ecafb409cbf3b0f6ced67f12f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:33.564214 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e3b615ba-86ee-4e9e-9de7-d5d44d3b08de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1630394ecafb409cbf3b0f6ced67f12f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:33.575852 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e3b615ba-86ee-4e9e-9de7-d5d44d3b08de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1630394ecafb409cbf3b0f6ced67f12f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:33.576565 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e3b615ba-86ee-4e9e-9de7-d5d44d3b08de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1630394ecafb409cbf3b0f6ced67f12f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:33.577232 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e3b615ba-86ee-4e9e-9de7-d5d44d3b08de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1630394ecafb409cbf3b0f6ced67f12f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:33.590545 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1040/2075] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:33 2022] DELETE /identity/v3/users/1630394ecafb409cbf3b0f6ced67f12f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:33.595107 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe13e4e-7471-4bb8-95f3-b5cf1ed39607 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:33.595398 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe13e4e-7471-4bb8-95f3-b5cf1ed39607 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:33.595678 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe13e4e-7471-4bb8-95f3-b5cf1ed39607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:33.616533 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-bfe13e4e-7471-4bb8-95f3-b5cf1ed39607 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:33.618061 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-bfe13e4e-7471-4bb8-95f3-b5cf1ed39607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:33.678694 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1036/2076] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:33.687289 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b615ba-86ee-4e9e-9de7-d5d44d3b08de admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:33.688758 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e3b615ba-86ee-4e9e-9de7-d5d44d3b08de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:33.748954 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b615ba-86ee-4e9e-9de7-d5d44d3b08de admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:33.752655 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7ac95-d5b4-4ebf-8539-a01870b774e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:33.753318 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7ac95-d5b4-4ebf-8539-a01870b774e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:33.753599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7ac95-d5b4-4ebf-8539-a01870b774e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:33.753868 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7ac95-d5b4-4ebf-8539-a01870b774e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:33.763312 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7ac95-d5b4-4ebf-8539-a01870b774e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:33.764739 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7ac95-d5b4-4ebf-8539-a01870b774e0 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:33.775468 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1041/2077] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:34:34.181728 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe13e4e-7471-4bb8-95f3-b5cf1ed39607 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:34.183285 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-bfe13e4e-7471-4bb8-95f3-b5cf1ed39607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:34.203687 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe13e4e-7471-4bb8-95f3-b5cf1ed39607 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:34.206211 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a37d3-448c-4a04-b7d8-b2a7f28158ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:34.207330 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a37d3-448c-4a04-b7d8-b2a7f28158ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:34.207781 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a37d3-448c-4a04-b7d8-b2a7f28158ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:34.208151 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a37d3-448c-4a04-b7d8-b2a7f28158ed admin admin] PATH_INFO: `/v3/projects/d351d74a193242b1b48d7c20a43d5fd5` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:34.209537 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a37d3-448c-4a04-b7d8-b2a7f28158ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=d351d74a193242b1b48d7c20a43d5fd5)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:34.211593 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a37d3-448c-4a04-b7d8-b2a7f28158ed admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:34.272299 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-260a37d3-448c-4a04-b7d8-b2a7f28158ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd351d74a193242b1b48d7c20a43d5fd5', 'request_id': 'req-260a37d3-448c-4a04-b7d8-b2a7f28158ed'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:34.284562 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-260a37d3-448c-4a04-b7d8-b2a7f28158ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd351d74a193242b1b48d7c20a43d5fd5', 'request_id': 'req-260a37d3-448c-4a04-b7d8-b2a7f28158ed'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:34.292210 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-260a37d3-448c-4a04-b7d8-b2a7f28158ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd351d74a193242b1b48d7c20a43d5fd5', 'request_id': 'req-260a37d3-448c-4a04-b7d8-b2a7f28158ed'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:34.307858 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-260a37d3-448c-4a04-b7d8-b2a7f28158ed admin admin] The token cache is being invalidate because project d351d74a193242b1b48d7c20a43d5fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:34.308271 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-260a37d3-448c-4a04-b7d8-b2a7f28158ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:34.309585 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-260a37d3-448c-4a04-b7d8-b2a7f28158ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:34.311392 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1037/2078] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:34 2022] DELETE /identity/v3/projects/d351d74a193242b1b48d7c20a43d5fd5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:34:34.318303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7ac95-d5b4-4ebf-8539-a01870b774e0 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:34.328279 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7ac95-d5b4-4ebf-8539-a01870b774e0 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:34.392302 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d195a-190e-4bb7-83f4-46db5ec04b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:34.393488 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d195a-190e-4bb7-83f4-46db5ec04b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:34.393929 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d195a-190e-4bb7-83f4-46db5ec04b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:34.394418 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d195a-190e-4bb7-83f4-46db5ec04b7c admin admin] PATH_INFO: `/v3/users/cbfea77901134c12be9b501b83df444c` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:34.396138 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d195a-190e-4bb7-83f4-46db5ec04b7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbfea77901134c12be9b501b83df444c)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:34.398433 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d195a-190e-4bb7-83f4-46db5ec04b7c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:34.449112 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-a51d195a-190e-4bb7-83f4-46db5ec04b7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbfea77901134c12be9b501b83df444c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:34.457591 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-a51d195a-190e-4bb7-83f4-46db5ec04b7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbfea77901134c12be9b501b83df444c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:34.470492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-a51d195a-190e-4bb7-83f4-46db5ec04b7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbfea77901134c12be9b501b83df444c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:34.471248 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-a51d195a-190e-4bb7-83f4-46db5ec04b7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbfea77901134c12be9b501b83df444c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:34.471850 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-a51d195a-190e-4bb7-83f4-46db5ec04b7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbfea77901134c12be9b501b83df444c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:34.485075 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1042/2079] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:34 2022] DELETE /identity/v3/users/cbfea77901134c12be9b501b83df444c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:34.875211 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a37d3-448c-4a04-b7d8-b2a7f28158ed admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:34.877341 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-260a37d3-448c-4a04-b7d8-b2a7f28158ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:34.896729 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a37d3-448c-4a04-b7d8-b2a7f28158ed admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:34.972414 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a45b4-a15e-4da2-aaea-6b306628f79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:34.973283 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a45b4-a15e-4da2-aaea-6b306628f79b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:34.973576 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a45b4-a15e-4da2-aaea-6b306628f79b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:34.973849 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a45b4-a15e-4da2-aaea-6b306628f79b admin admin] PATH_INFO: `/v3/projects/eaaee6934b69430392dffe1c98c446eb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:34.975081 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a45b4-a15e-4da2-aaea-6b306628f79b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaaee6934b69430392dffe1c98c446eb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:34.977120 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a45b4-a15e-4da2-aaea-6b306628f79b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:35.022189 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-483a45b4-a15e-4da2-aaea-6b306628f79b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaaee6934b69430392dffe1c98c446eb', 'request_id': 'req-483a45b4-a15e-4da2-aaea-6b306628f79b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:35.030599 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-483a45b4-a15e-4da2-aaea-6b306628f79b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaaee6934b69430392dffe1c98c446eb', 'request_id': 'req-483a45b4-a15e-4da2-aaea-6b306628f79b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:35.038993 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-483a45b4-a15e-4da2-aaea-6b306628f79b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaaee6934b69430392dffe1c98c446eb', 'request_id': 'req-483a45b4-a15e-4da2-aaea-6b306628f79b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:35.050732 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-483a45b4-a15e-4da2-aaea-6b306628f79b admin admin] The token cache is being invalidate because project eaaee6934b69430392dffe1c98c446eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:35.051018 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-483a45b4-a15e-4da2-aaea-6b306628f79b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:35.051669 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-483a45b4-a15e-4da2-aaea-6b306628f79b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:35.053676 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1038/2080] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:34 2022] DELETE /identity/v3/projects/eaaee6934b69430392dffe1c98c446eb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:35.059449 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36491de-d380-4129-bd09-8e5684d5c686 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:35.060360 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36491de-d380-4129-bd09-8e5684d5c686 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:35.060640 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36491de-d380-4129-bd09-8e5684d5c686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:35.078662 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-a36491de-d380-4129-bd09-8e5684d5c686 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:35.080096 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a36491de-d380-4129-bd09-8e5684d5c686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:35.142831 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1043/2081] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:35.150565 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040db8a-6582-4a1d-a898-27ed6ce844e7 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:35.151033 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040db8a-6582-4a1d-a898-27ed6ce844e7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:35.151454 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040db8a-6582-4a1d-a898-27ed6ce844e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:35.173098 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-2040db8a-6582-4a1d-a898-27ed6ce844e7 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:35.174339 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2040db8a-6582-4a1d-a898-27ed6ce844e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:35.183487 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1039/2082] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:35.187711 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36491de-d380-4129-bd09-8e5684d5c686 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:35.196998 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36491de-d380-4129-bd09-8e5684d5c686 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:35.201832 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53a45c-b23b-4f7d-9167-460cf796425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:35.202482 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53a45c-b23b-4f7d-9167-460cf796425f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:35.202776 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53a45c-b23b-4f7d-9167-460cf796425f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:35.203063 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53a45c-b23b-4f7d-9167-460cf796425f admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:35.203825 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53a45c-b23b-4f7d-9167-460cf796425f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:34:35.204127 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53a45c-b23b-4f7d-9167-460cf796425f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:35.205788 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53a45c-b23b-4f7d-9167-460cf796425f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:35.218948 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1044/2083] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:34:35.223825 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040db8a-6582-4a1d-a898-27ed6ce844e7 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:35.233594 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040db8a-6582-4a1d-a898-27ed6ce844e7 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:35.240191 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe2e28-c8af-4e83-ad99-d8d0f5a6b34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:35.240850 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe2e28-c8af-4e83-ad99-d8d0f5a6b34b admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:35.241133 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe2e28-c8af-4e83-ad99-d8d0f5a6b34b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:35.241440 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe2e28-c8af-4e83-ad99-d8d0f5a6b34b admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:35.242134 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe2e28-c8af-4e83-ad99-d8d0f5a6b34b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:35.244057 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe2e28-c8af-4e83-ad99-d8d0f5a6b34b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:35.276914 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1040/2084] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:34:35 2022] POST /identity/v3/projects => generated 401 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:35.277997 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53a45c-b23b-4f7d-9167-460cf796425f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:35.288010 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53a45c-b23b-4f7d-9167-460cf796425f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:35.344984 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606262c8-32f2-4e06-af18-0a50e42167f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:35.345828 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606262c8-32f2-4e06-af18-0a50e42167f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:35.346115 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606262c8-32f2-4e06-af18-0a50e42167f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:35.346399 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606262c8-32f2-4e06-af18-0a50e42167f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:35.347083 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606262c8-32f2-4e06-af18-0a50e42167f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:35.349037 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606262c8-32f2-4e06-af18-0a50e42167f1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:35.372769 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1045/2085] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:34:35 2022] POST /identity/v3/users => generated 301 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:34:35.374009 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe2e28-c8af-4e83-ad99-d8d0f5a6b34b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:35.387139 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe2e28-c8af-4e83-ad99-d8d0f5a6b34b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:35.393760 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2f095-494b-412a-b150-55e5f1fbcf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:35.394689 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2f095-494b-412a-b150-55e5f1fbcf8c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:35.394977 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2f095-494b-412a-b150-55e5f1fbcf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:35.395254 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2f095-494b-412a-b150-55e5f1fbcf8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:35.396121 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2f095-494b-412a-b150-55e5f1fbcf8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:35.398043 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2f095-494b-412a-b150-55e5f1fbcf8c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:35.409236 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1041/2086] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:35.413270 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606262c8-32f2-4e06-af18-0a50e42167f1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:35.424203 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606262c8-32f2-4e06-af18-0a50e42167f1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:35.430778 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5be505-91ac-49fd-94f2-df635db206c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:35.431539 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5be505-91ac-49fd-94f2-df635db206c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:35.431730 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5be505-91ac-49fd-94f2-df635db206c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:35.432192 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5be505-91ac-49fd-94f2-df635db206c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:35.432977 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5be505-91ac-49fd-94f2-df635db206c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:35.434632 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5be505-91ac-49fd-94f2-df635db206c2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:35.445370 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1046/2087] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:35.450263 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2f095-494b-412a-b150-55e5f1fbcf8c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:35.467561 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2f095-494b-412a-b150-55e5f1fbcf8c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:35.483199 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bd0e8-e439-458c-85cc-aba3fff7a1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:35.484222 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bd0e8-e439-458c-85cc-aba3fff7a1ed admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:35.484604 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bd0e8-e439-458c-85cc-aba3fff7a1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:35.484953 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bd0e8-e439-458c-85cc-aba3fff7a1ed admin admin] PATH_INFO: `/v3/projects/beb44630ca8541ea8a2d88821c98cc5c/users/76d68a5b995c4ad99c385ed8ba70a322/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:35.501929 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bd0e8-e439-458c-85cc-aba3fff7a1ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb44630ca8541ea8a2d88821c98cc5c, user_id=76d68a5b995c4ad99c385ed8ba70a322, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:35.504660 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3bd0e8-e439-458c-85cc-aba3fff7a1ed admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:35.516780 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5be505-91ac-49fd-94f2-df635db206c2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:35.518535 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-db5be505-91ac-49fd-94f2-df635db206c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:35.520490 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1042/2088] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:35 2022] PUT /identity/v3/projects/beb44630ca8541ea8a2d88821c98cc5c/users/76d68a5b995c4ad99c385ed8ba70a322/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:34:35.532428 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5be505-91ac-49fd-94f2-df635db206c2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:35.532768 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb29f23-d9d3-4337-829b-aaf27c2104d7 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:35.533233 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb29f23-d9d3-4337-829b-aaf27c2104d7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:35.533553 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb29f23-d9d3-4337-829b-aaf27c2104d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:35.564830 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-9eb29f23-d9d3-4337-829b-aaf27c2104d7 None None] MFA Rules not processed for user `76d68a5b995c4ad99c385ed8ba70a322`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:35.566141 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9eb29f23-d9d3-4337-829b-aaf27c2104d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:35.596181 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b9379-24c6-42c9-a124-3a01c586c0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:35.597089 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b9379-24c6-42c9-a124-3a01c586c0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:35.597394 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b9379-24c6-42c9-a124-3a01c586c0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:35.597661 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b9379-24c6-42c9-a124-3a01c586c0e5 admin admin] PATH_INFO: `/v3/users/be64be4d6efe45449807f7e5773f1ede` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:35.598850 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b9379-24c6-42c9-a124-3a01c586c0e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be64be4d6efe45449807f7e5773f1ede)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:35.600755 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b9379-24c6-42c9-a124-3a01c586c0e5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:35.637140 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1043/2089] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:34:35.639113 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb29f23-d9d3-4337-829b-aaf27c2104d7 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:35.649636 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb29f23-d9d3-4337-829b-aaf27c2104d7 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:35.650950 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6a7b9379-24c6-42c9-a124-3a01c586c0e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be64be4d6efe45449807f7e5773f1ede'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:35.655020 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0843bde-d7cf-457c-9ded-489ca8fd6024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:35.655663 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0843bde-d7cf-457c-9ded-489ca8fd6024 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:35.655943 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0843bde-d7cf-457c-9ded-489ca8fd6024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:35.656216 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0843bde-d7cf-457c-9ded-489ca8fd6024 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:35.656899 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0843bde-d7cf-457c-9ded-489ca8fd6024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:35.658269 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6a7b9379-24c6-42c9-a124-3a01c586c0e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be64be4d6efe45449807f7e5773f1ede'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:35.658928 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0843bde-d7cf-457c-9ded-489ca8fd6024 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:35.671154 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6a7b9379-24c6-42c9-a124-3a01c586c0e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be64be4d6efe45449807f7e5773f1ede'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:35.671905 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6a7b9379-24c6-42c9-a124-3a01c586c0e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be64be4d6efe45449807f7e5773f1ede'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:35.672918 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6a7b9379-24c6-42c9-a124-3a01c586c0e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be64be4d6efe45449807f7e5773f1ede'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:35.688587 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1047/2090] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:35 2022] DELETE /identity/v3/users/be64be4d6efe45449807f7e5773f1ede => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:34:35.693409 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df137-8eca-4e07-9039-1314ef57adf1 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:35.694802 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df137-8eca-4e07-9039-1314ef57adf1 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:35.694802 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df137-8eca-4e07-9039-1314ef57adf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:35.694987 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1044/2091] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:34:35 2022] POST /identity/v3/projects => generated 401 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:35.695496 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0843bde-d7cf-457c-9ded-489ca8fd6024 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:35.697840 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d0843bde-d7cf-457c-9ded-489ca8fd6024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:35.714718 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-199df137-8eca-4e07-9039-1314ef57adf1 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:35.715994 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-199df137-8eca-4e07-9039-1314ef57adf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:35.764034 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0843bde-d7cf-457c-9ded-489ca8fd6024 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:35.773146 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace5619-7d20-45b7-b7de-9290016d0613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:35.773858 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace5619-7d20-45b7-b7de-9290016d0613 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:35.774137 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace5619-7d20-45b7-b7de-9290016d0613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:35.774405 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace5619-7d20-45b7-b7de-9290016d0613 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:35.775205 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace5619-7d20-45b7-b7de-9290016d0613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:35.777741 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace5619-7d20-45b7-b7de-9290016d0613 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:35.779627 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1048/2092] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:35.789620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199df137-8eca-4e07-9039-1314ef57adf1 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:35.791319 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-199df137-8eca-4e07-9039-1314ef57adf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:35.806967 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1045/2093] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:34:35 2022] POST /identity/v3/users => generated 307 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:35.811686 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace5619-7d20-45b7-b7de-9290016d0613 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:35.824180 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace5619-7d20-45b7-b7de-9290016d0613 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:35.832391 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dddae-5c59-41b1-84c9-e9d79237001e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:35.832965 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dddae-5c59-41b1-84c9-e9d79237001e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:35.833875 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dddae-5c59-41b1-84c9-e9d79237001e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:35.833875 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31dddae-5c59-41b1-84c9-e9d79237001e admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:35.834800 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31dddae-5c59-41b1-84c9-e9d79237001e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:35.837084 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31dddae-5c59-41b1-84c9-e9d79237001e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:35.851459 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1046/2094] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:35.852765 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dddae-5c59-41b1-84c9-e9d79237001e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:35.866820 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31dddae-5c59-41b1-84c9-e9d79237001e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:35.872099 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a5332-a35a-4e85-9091-6155989b996b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:35.873858 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a5332-a35a-4e85-9091-6155989b996b admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:35.874214 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a5332-a35a-4e85-9091-6155989b996b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:35.874645 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a5332-a35a-4e85-9091-6155989b996b admin admin] PATH_INFO: `/v3/projects/189a9a1ff18d4ce18d6d177b71a3dfb9/users/27931cb95303412490f111f297d9dd52/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:35.890363 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199df137-8eca-4e07-9039-1314ef57adf1 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:35.894342 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bbf08-18b0-4a5c-bce3-27f2007f9b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:35.894505 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a5332-a35a-4e85-9091-6155989b996b admin admin] RBAC: Authorizing `identity:create_grant(project_id=189a9a1ff18d4ce18d6d177b71a3dfb9, user_id=27931cb95303412490f111f297d9dd52, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:35.895155 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bbf08-18b0-4a5c-bce3-27f2007f9b98 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:35.895440 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bbf08-18b0-4a5c-bce3-27f2007f9b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:35.895713 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687bbf08-18b0-4a5c-bce3-27f2007f9b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:35.897517 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a5332-a35a-4e85-9091-6155989b996b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:35.906901 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687bbf08-18b0-4a5c-bce3-27f2007f9b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:35.908766 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687bbf08-18b0-4a5c-bce3-27f2007f9b98 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:35.921298 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1047/2095] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:35 2022] PUT /identity/v3/projects/189a9a1ff18d4ce18d6d177b71a3dfb9/users/27931cb95303412490f111f297d9dd52/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:34:35.922382 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a5332-a35a-4e85-9091-6155989b996b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:35.923801 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1049/2096] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:34:36.001061 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a5332-a35a-4e85-9091-6155989b996b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:36.011146 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3e973-94ba-4bc6-aacc-1519ac98cdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:36.012339 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3e973-94ba-4bc6-aacc-1519ac98cdfc admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:36.013063 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3e973-94ba-4bc6-aacc-1519ac98cdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:36.013509 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3e973-94ba-4bc6-aacc-1519ac98cdfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:36.014430 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3e973-94ba-4bc6-aacc-1519ac98cdfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:36.016126 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3e973-94ba-4bc6-aacc-1519ac98cdfc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:36.027709 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1048/2097] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:36.032522 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bbf08-18b0-4a5c-bce3-27f2007f9b98 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:36.043330 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687bbf08-18b0-4a5c-bce3-27f2007f9b98 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:36.057040 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0afd5-bcdb-419c-b97e-5dea0edbe4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:36.057976 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0afd5-bcdb-419c-b97e-5dea0edbe4b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:36.058254 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0afd5-bcdb-419c-b97e-5dea0edbe4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:36.058520 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0afd5-bcdb-419c-b97e-5dea0edbe4b9 admin admin] PATH_INFO: `/v3/projects/189a9a1ff18d4ce18d6d177b71a3dfb9/users/27931cb95303412490f111f297d9dd52/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:36.060627 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0afd5-bcdb-419c-b97e-5dea0edbe4b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=189a9a1ff18d4ce18d6d177b71a3dfb9, user_id=27931cb95303412490f111f297d9dd52, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:36.063308 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0afd5-bcdb-419c-b97e-5dea0edbe4b9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:36.086631 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1050/2098] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:36 2022] PUT /identity/v3/projects/189a9a1ff18d4ce18d6d177b71a3dfb9/users/27931cb95303412490f111f297d9dd52/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:36.106586 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e2248-101d-4bdc-be6a-98c7fcc861c4 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:36.107463 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e2248-101d-4bdc-be6a-98c7fcc861c4 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:36.108023 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e2248-101d-4bdc-be6a-98c7fcc861c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:36.147507 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-872e2248-101d-4bdc-be6a-98c7fcc861c4 None None] MFA Rules not processed for user `27931cb95303412490f111f297d9dd52`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:36.149629 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-872e2248-101d-4bdc-be6a-98c7fcc861c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:36.261315 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1049/2099] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:36 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:36.272315 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0afd5-bcdb-419c-b97e-5dea0edbe4b9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:36.274068 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6fc0afd5-bcdb-419c-b97e-5dea0edbe4b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:36.346323 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0afd5-bcdb-419c-b97e-5dea0edbe4b9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:36.350066 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57804bae-afe6-4ef7-a128-392d68104600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:36.350723 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57804bae-afe6-4ef7-a128-392d68104600 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:36.351004 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57804bae-afe6-4ef7-a128-392d68104600 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:36.351284 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57804bae-afe6-4ef7-a128-392d68104600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:36.361839 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57804bae-afe6-4ef7-a128-392d68104600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:36.363365 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57804bae-afe6-4ef7-a128-392d68104600 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:36.379143 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1051/2100] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:36 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:36.463600 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e2248-101d-4bdc-be6a-98c7fcc861c4 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:36.473895 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e2248-101d-4bdc-be6a-98c7fcc861c4 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:36.477612 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ce355-61b8-4195-b760-a758ff02cf1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:36.478898 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ce355-61b8-4195-b760-a758ff02cf1a service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:36.478898 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ce355-61b8-4195-b760-a758ff02cf1a service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:36.478898 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ce355-61b8-4195-b760-a758ff02cf1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:36.481244 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-249ce355-61b8-4195-b760-a758ff02cf1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:36.553906 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57804bae-afe6-4ef7-a128-392d68104600 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:36.555391 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-57804bae-afe6-4ef7-a128-392d68104600 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:36.593138 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ce355-61b8-4195-b760-a758ff02cf1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:36.597873 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249ce355-61b8-4195-b760-a758ff02cf1a service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:36.610611 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1050/2101] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:36.658062 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57804bae-afe6-4ef7-a128-392d68104600 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:36.665401 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c9ba7-3e39-4060-8053-fdf8b5f44b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:36.666273 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c9ba7-3e39-4060-8053-fdf8b5f44b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:36.666555 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c9ba7-3e39-4060-8053-fdf8b5f44b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:36.666830 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c9ba7-3e39-4060-8053-fdf8b5f44b2e admin admin] PATH_INFO: `/v3/projects/d37ca84d2a1f43748ffc6c7a36d9a691` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:36.668030 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c9ba7-3e39-4060-8053-fdf8b5f44b2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d37ca84d2a1f43748ffc6c7a36d9a691)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:36.670310 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c9ba7-3e39-4060-8053-fdf8b5f44b2e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:36.739082 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-057c9ba7-3e39-4060-8053-fdf8b5f44b2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd37ca84d2a1f43748ffc6c7a36d9a691', 'request_id': 'req-057c9ba7-3e39-4060-8053-fdf8b5f44b2e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:36.746496 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-057c9ba7-3e39-4060-8053-fdf8b5f44b2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd37ca84d2a1f43748ffc6c7a36d9a691', 'request_id': 'req-057c9ba7-3e39-4060-8053-fdf8b5f44b2e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:36.753031 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-057c9ba7-3e39-4060-8053-fdf8b5f44b2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd37ca84d2a1f43748ffc6c7a36d9a691', 'request_id': 'req-057c9ba7-3e39-4060-8053-fdf8b5f44b2e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:36.765388 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-057c9ba7-3e39-4060-8053-fdf8b5f44b2e admin admin] The token cache is being invalidate because project d37ca84d2a1f43748ffc6c7a36d9a691 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:36.765692 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-057c9ba7-3e39-4060-8053-fdf8b5f44b2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:36.768266 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-057c9ba7-3e39-4060-8053-fdf8b5f44b2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:36.770025 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1052/2102] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:36 2022] DELETE /identity/v3/projects/d37ca84d2a1f43748ffc6c7a36d9a691 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:34:36.774350 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ce355-61b8-4195-b760-a758ff02cf1a service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:36.785423 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ce355-61b8-4195-b760-a758ff02cf1a service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:36.844845 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a02c76-c267-4534-b834-78313b5ff871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:36.845745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a02c76-c267-4534-b834-78313b5ff871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:36.846022 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a02c76-c267-4534-b834-78313b5ff871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:36.846307 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a02c76-c267-4534-b834-78313b5ff871 admin admin] PATH_INFO: `/v3/users/41d2e0381fd54e3e99605b2e512feea3` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:36.847569 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a02c76-c267-4534-b834-78313b5ff871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41d2e0381fd54e3e99605b2e512feea3)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:36.849464 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a02c76-c267-4534-b834-78313b5ff871 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:36.904532 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-98a02c76-c267-4534-b834-78313b5ff871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41d2e0381fd54e3e99605b2e512feea3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:36.917397 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-98a02c76-c267-4534-b834-78313b5ff871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41d2e0381fd54e3e99605b2e512feea3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:36.918355 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-98a02c76-c267-4534-b834-78313b5ff871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41d2e0381fd54e3e99605b2e512feea3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:36.919290 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-98a02c76-c267-4534-b834-78313b5ff871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41d2e0381fd54e3e99605b2e512feea3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:36.929025 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-98a02c76-c267-4534-b834-78313b5ff871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41d2e0381fd54e3e99605b2e512feea3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:36.942876 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1051/2103] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:36 2022] DELETE /identity/v3/users/41d2e0381fd54e3e99605b2e512feea3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:37.269990 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c9ba7-3e39-4060-8053-fdf8b5f44b2e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:37.271771 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-057c9ba7-3e39-4060-8053-fdf8b5f44b2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:37.286981 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c9ba7-3e39-4060-8053-fdf8b5f44b2e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:37.359556 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7d0f5-d494-4be1-af88-b46d64cf87db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:37.360414 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7d0f5-d494-4be1-af88-b46d64cf87db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:37.360870 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7d0f5-d494-4be1-af88-b46d64cf87db admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:37.361149 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7d0f5-d494-4be1-af88-b46d64cf87db admin admin] PATH_INFO: `/v3/projects/a6faa9dc34ea48ef8de1acbf62a83f90` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:37.362466 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7d0f5-d494-4be1-af88-b46d64cf87db admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6faa9dc34ea48ef8de1acbf62a83f90)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:37.364396 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7d0f5-d494-4be1-af88-b46d64cf87db admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:37.412446 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-32b7d0f5-d494-4be1-af88-b46d64cf87db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6faa9dc34ea48ef8de1acbf62a83f90', 'request_id': 'req-32b7d0f5-d494-4be1-af88-b46d64cf87db'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:37.424635 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-32b7d0f5-d494-4be1-af88-b46d64cf87db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6faa9dc34ea48ef8de1acbf62a83f90', 'request_id': 'req-32b7d0f5-d494-4be1-af88-b46d64cf87db'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:37.430883 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-32b7d0f5-d494-4be1-af88-b46d64cf87db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6faa9dc34ea48ef8de1acbf62a83f90', 'request_id': 'req-32b7d0f5-d494-4be1-af88-b46d64cf87db'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:37.442591 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-32b7d0f5-d494-4be1-af88-b46d64cf87db admin admin] The token cache is being invalidate because project a6faa9dc34ea48ef8de1acbf62a83f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:37.442900 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-32b7d0f5-d494-4be1-af88-b46d64cf87db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:37.443543 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-32b7d0f5-d494-4be1-af88-b46d64cf87db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:37.445052 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1053/2104] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:37 2022] DELETE /identity/v3/projects/a6faa9dc34ea48ef8de1acbf62a83f90 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:37.449167 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a02c76-c267-4534-b834-78313b5ff871 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:37.450624 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-98a02c76-c267-4534-b834-78313b5ff871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:37.462981 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a02c76-c267-4534-b834-78313b5ff871 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:37.517630 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2e911-e391-4212-b6f5-765461b8f0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:37.518480 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2e911-e391-4212-b6f5-765461b8f0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:37.518757 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2e911-e391-4212-b6f5-765461b8f0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:37.519030 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2e911-e391-4212-b6f5-765461b8f0eb admin admin] PATH_INFO: `/v3/users/f7011ea6568847d283ba729f7de761d6` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:37.520204 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2e911-e391-4212-b6f5-765461b8f0eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7011ea6568847d283ba729f7de761d6)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:37.522183 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2e911-e391-4212-b6f5-765461b8f0eb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:37.565670 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-fbb2e911-e391-4212-b6f5-765461b8f0eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7011ea6568847d283ba729f7de761d6'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:37.577464 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-fbb2e911-e391-4212-b6f5-765461b8f0eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7011ea6568847d283ba729f7de761d6'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:37.578193 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-fbb2e911-e391-4212-b6f5-765461b8f0eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7011ea6568847d283ba729f7de761d6'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:37.578789 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-fbb2e911-e391-4212-b6f5-765461b8f0eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7011ea6568847d283ba729f7de761d6'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:37.586080 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-fbb2e911-e391-4212-b6f5-765461b8f0eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7011ea6568847d283ba729f7de761d6'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:37.598884 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1052/2105] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:37 2022] DELETE /identity/v3/users/f7011ea6568847d283ba729f7de761d6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:37.867177 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7d0f5-d494-4be1-af88-b46d64cf87db admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:37.868608 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-32b7d0f5-d494-4be1-af88-b46d64cf87db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:37.882835 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7d0f5-d494-4be1-af88-b46d64cf87db admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:37.939861 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a255d2-197d-40c8-aac5-54de0b856c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:37.940769 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a255d2-197d-40c8-aac5-54de0b856c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:37.941003 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a255d2-197d-40c8-aac5-54de0b856c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:37.941314 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a255d2-197d-40c8-aac5-54de0b856c5f admin admin] PATH_INFO: `/v3/projects/4bd5bb333d3d4606a7c77045262cbce6` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:37.942749 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a255d2-197d-40c8-aac5-54de0b856c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bd5bb333d3d4606a7c77045262cbce6)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:37.944696 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a255d2-197d-40c8-aac5-54de0b856c5f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:37.994767 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-25a255d2-197d-40c8-aac5-54de0b856c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd5bb333d3d4606a7c77045262cbce6', 'request_id': 'req-25a255d2-197d-40c8-aac5-54de0b856c5f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:38.001489 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-25a255d2-197d-40c8-aac5-54de0b856c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd5bb333d3d4606a7c77045262cbce6', 'request_id': 'req-25a255d2-197d-40c8-aac5-54de0b856c5f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:38.007214 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-25a255d2-197d-40c8-aac5-54de0b856c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd5bb333d3d4606a7c77045262cbce6', 'request_id': 'req-25a255d2-197d-40c8-aac5-54de0b856c5f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:38.018795 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-25a255d2-197d-40c8-aac5-54de0b856c5f admin admin] The token cache is being invalidate because project 4bd5bb333d3d4606a7c77045262cbce6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:38.019083 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-25a255d2-197d-40c8-aac5-54de0b856c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:38.019724 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-25a255d2-197d-40c8-aac5-54de0b856c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:38.021273 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1054/2106] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:37 2022] DELETE /identity/v3/projects/4bd5bb333d3d4606a7c77045262cbce6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:38.026452 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc14c6-cbd4-43ad-b3ce-6d299847765a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:38.026929 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc14c6-cbd4-43ad-b3ce-6d299847765a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:38.027032 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc14c6-cbd4-43ad-b3ce-6d299847765a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:38.045620 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-2ffc14c6-cbd4-43ad-b3ce-6d299847765a None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:38.046837 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2ffc14c6-cbd4-43ad-b3ce-6d299847765a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:38.110197 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1053/2107] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:38.118052 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5325e5-d0d7-49a2-bdc2-2e75e4387701 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:38.118420 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5325e5-d0d7-49a2-bdc2-2e75e4387701 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:38.119213 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5325e5-d0d7-49a2-bdc2-2e75e4387701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:38.147633 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-7d5325e5-d0d7-49a2-bdc2-2e75e4387701 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:38.148838 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7d5325e5-d0d7-49a2-bdc2-2e75e4387701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:38.157410 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1055/2108] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:38.161779 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc14c6-cbd4-43ad-b3ce-6d299847765a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:38.171727 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc14c6-cbd4-43ad-b3ce-6d299847765a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:38.176622 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f013fb-f189-41e4-9317-1e67aed6ff88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:38.177307 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f013fb-f189-41e4-9317-1e67aed6ff88 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:38.177591 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f013fb-f189-41e4-9317-1e67aed6ff88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:38.178286 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f013fb-f189-41e4-9317-1e67aed6ff88 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:38.178588 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f013fb-f189-41e4-9317-1e67aed6ff88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:34:38.179582 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f013fb-f189-41e4-9317-1e67aed6ff88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:38.181205 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f013fb-f189-41e4-9317-1e67aed6ff88 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:38.193836 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1054/2109] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:34:38.198501 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5325e5-d0d7-49a2-bdc2-2e75e4387701 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:38.223815 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5325e5-d0d7-49a2-bdc2-2e75e4387701 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:38.230932 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec10e2-adae-4691-bad3-b3d1adf13a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:38.231635 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec10e2-adae-4691-bad3-b3d1adf13a6f admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:38.231916 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec10e2-adae-4691-bad3-b3d1adf13a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:38.232192 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec10e2-adae-4691-bad3-b3d1adf13a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:38.232883 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec10e2-adae-4691-bad3-b3d1adf13a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:38.234863 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec10e2-adae-4691-bad3-b3d1adf13a6f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:38.270243 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1056/2110] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:34:38 2022] POST /identity/v3/projects => generated 399 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:38.274984 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f013fb-f189-41e4-9317-1e67aed6ff88 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:38.285205 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f013fb-f189-41e4-9317-1e67aed6ff88 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:38.348645 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e15c68-7560-4ef6-b32b-e215d85ee857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:38.349421 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e15c68-7560-4ef6-b32b-e215d85ee857 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:38.349711 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e15c68-7560-4ef6-b32b-e215d85ee857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:38.350040 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e15c68-7560-4ef6-b32b-e215d85ee857 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:38.351039 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e15c68-7560-4ef6-b32b-e215d85ee857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:38.352740 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e15c68-7560-4ef6-b32b-e215d85ee857 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:38.381300 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1055/2111] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:34:38 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:38.384583 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec10e2-adae-4691-bad3-b3d1adf13a6f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:38.395660 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec10e2-adae-4691-bad3-b3d1adf13a6f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:38.400846 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9deca-9f75-4f14-810e-f9d94d635154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:38.401552 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9deca-9f75-4f14-810e-f9d94d635154 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:38.401837 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9deca-9f75-4f14-810e-f9d94d635154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:38.402115 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9deca-9f75-4f14-810e-f9d94d635154 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:38.403093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9deca-9f75-4f14-810e-f9d94d635154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:38.405307 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9deca-9f75-4f14-810e-f9d94d635154 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:38.421336 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1057/2112] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:38.426503 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e15c68-7560-4ef6-b32b-e215d85ee857 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:38.439642 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e15c68-7560-4ef6-b32b-e215d85ee857 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:38.448090 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0b8a3-e379-42a5-af16-83ba03447794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:38.448090 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0b8a3-e379-42a5-af16-83ba03447794 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:38.448090 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0b8a3-e379-42a5-af16-83ba03447794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:38.448090 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0b8a3-e379-42a5-af16-83ba03447794 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:38.448651 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0b8a3-e379-42a5-af16-83ba03447794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:38.450450 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0b8a3-e379-42a5-af16-83ba03447794 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:38.470279 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1056/2113] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:34:38.474456 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9deca-9f75-4f14-810e-f9d94d635154 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:38.490335 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9deca-9f75-4f14-810e-f9d94d635154 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:38.496964 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e159c-85c2-49d2-b6c6-acca9ac76eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:38.498214 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e159c-85c2-49d2-b6c6-acca9ac76eec admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:38.498663 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e159c-85c2-49d2-b6c6-acca9ac76eec admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:38.501819 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e159c-85c2-49d2-b6c6-acca9ac76eec admin admin] PATH_INFO: `/v3/projects/e50b0e0285284d8595dfb473c120ca05/users/1da296ac919f4dc681e0125d21f32bdf/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:38.530427 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e159c-85c2-49d2-b6c6-acca9ac76eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e50b0e0285284d8595dfb473c120ca05, user_id=1da296ac919f4dc681e0125d21f32bdf, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:38.532784 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e159c-85c2-49d2-b6c6-acca9ac76eec admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:38.551982 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1058/2114] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:38 2022] PUT /identity/v3/projects/e50b0e0285284d8595dfb473c120ca05/users/1da296ac919f4dc681e0125d21f32bdf/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:34:38.563329 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebabe0-e3c2-437d-8248-04bfdc0b4dc6 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:38.563538 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebabe0-e3c2-437d-8248-04bfdc0b4dc6 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:38.563812 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebabe0-e3c2-437d-8248-04bfdc0b4dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:38.595069 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-66ebabe0-e3c2-437d-8248-04bfdc0b4dc6 None None] MFA Rules not processed for user `1da296ac919f4dc681e0125d21f32bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:38.596381 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-66ebabe0-e3c2-437d-8248-04bfdc0b4dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:38.660695 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1057/2115] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:38.672704 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e159c-85c2-49d2-b6c6-acca9ac76eec admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:38.674406 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b69e159c-85c2-49d2-b6c6-acca9ac76eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:38.732668 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e159c-85c2-49d2-b6c6-acca9ac76eec admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:38.736416 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8d729-522d-47b7-9966-6761ddb52b9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:38.737089 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8d729-522d-47b7-9966-6761ddb52b9e service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:38.737383 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8d729-522d-47b7-9966-6761ddb52b9e service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:38.737653 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8d729-522d-47b7-9966-6761ddb52b9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:38.745868 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db8d729-522d-47b7-9966-6761ddb52b9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:38.747851 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db8d729-522d-47b7-9966-6761ddb52b9e service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:38.757710 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1059/2116] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:40.798446 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebabe0-e3c2-437d-8248-04bfdc0b4dc6 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:40.799838 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-66ebabe0-e3c2-437d-8248-04bfdc0b4dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:40.867624 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebabe0-e3c2-437d-8248-04bfdc0b4dc6 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:40.872183 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1f943-a572-484a-a671-6455df9ca29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:40.873074 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1f943-a572-484a-a671-6455df9ca29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:40.873384 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1f943-a572-484a-a671-6455df9ca29c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:40.873662 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1f943-a572-484a-a671-6455df9ca29c admin admin] PATH_INFO: `/v3/users/76d68a5b995c4ad99c385ed8ba70a322` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:40.874855 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1f943-a572-484a-a671-6455df9ca29c admin admin] RBAC: Authorizing `identity:delete_user(user_id=76d68a5b995c4ad99c385ed8ba70a322)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:40.876792 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1f943-a572-484a-a671-6455df9ca29c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:40.927285 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d2a1f943-a572-484a-a671-6455df9ca29c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76d68a5b995c4ad99c385ed8ba70a322'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:40.938635 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d2a1f943-a572-484a-a671-6455df9ca29c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76d68a5b995c4ad99c385ed8ba70a322'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:40.939350 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d2a1f943-a572-484a-a671-6455df9ca29c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76d68a5b995c4ad99c385ed8ba70a322'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:40.939953 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d2a1f943-a572-484a-a671-6455df9ca29c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76d68a5b995c4ad99c385ed8ba70a322'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:40.948475 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d2a1f943-a572-484a-a671-6455df9ca29c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76d68a5b995c4ad99c385ed8ba70a322'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:40.964639 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1058/2117] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:40 2022] DELETE /identity/v3/users/76d68a5b995c4ad99c385ed8ba70a322 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:40.969813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5147bc-0107-49d9-bff6-7cd631807469 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:40.970292 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5147bc-0107-49d9-bff6-7cd631807469 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:40.970408 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5147bc-0107-49d9-bff6-7cd631807469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:40.987533 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-bb5147bc-0107-49d9-bff6-7cd631807469 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:40.988705 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-bb5147bc-0107-49d9-bff6-7cd631807469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:41.049497 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1060/2118] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:34:41.059254 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1f943-a572-484a-a671-6455df9ca29c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:41.060796 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d2a1f943-a572-484a-a671-6455df9ca29c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:41.130154 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1f943-a572-484a-a671-6455df9ca29c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:41.134155 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2709f5-16c5-4332-9c3a-982286caeef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:41.134801 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2709f5-16c5-4332-9c3a-982286caeef7 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:41.135080 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2709f5-16c5-4332-9c3a-982286caeef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:41.135354 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2709f5-16c5-4332-9c3a-982286caeef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:41.145727 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2709f5-16c5-4332-9c3a-982286caeef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:41.147566 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2709f5-16c5-4332-9c3a-982286caeef7 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:41.158008 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1059/2119] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:41.479688 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5147bc-0107-49d9-bff6-7cd631807469 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:41.481235 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-bb5147bc-0107-49d9-bff6-7cd631807469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:41.495625 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5147bc-0107-49d9-bff6-7cd631807469 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:41.510679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9885fc-07dd-416f-9371-621c9dc56053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:41.511580 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9885fc-07dd-416f-9371-621c9dc56053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:41.512018 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9885fc-07dd-416f-9371-621c9dc56053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:41.512352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9885fc-07dd-416f-9371-621c9dc56053 admin admin] PATH_INFO: `/v3/projects/beb44630ca8541ea8a2d88821c98cc5c` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:41.514140 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9885fc-07dd-416f-9371-621c9dc56053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beb44630ca8541ea8a2d88821c98cc5c)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:41.516056 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9885fc-07dd-416f-9371-621c9dc56053 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:41.560959 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3a9885fc-07dd-416f-9371-621c9dc56053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beb44630ca8541ea8a2d88821c98cc5c', 'request_id': 'req-3a9885fc-07dd-416f-9371-621c9dc56053'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:41.567878 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3a9885fc-07dd-416f-9371-621c9dc56053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beb44630ca8541ea8a2d88821c98cc5c', 'request_id': 'req-3a9885fc-07dd-416f-9371-621c9dc56053'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:41.573774 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3a9885fc-07dd-416f-9371-621c9dc56053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beb44630ca8541ea8a2d88821c98cc5c', 'request_id': 'req-3a9885fc-07dd-416f-9371-621c9dc56053'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:41.586024 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3a9885fc-07dd-416f-9371-621c9dc56053 admin admin] The token cache is being invalidate because project beb44630ca8541ea8a2d88821c98cc5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:41.586310 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3a9885fc-07dd-416f-9371-621c9dc56053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:41.586967 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3a9885fc-07dd-416f-9371-621c9dc56053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:41.588526 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1061/2120] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:41 2022] DELETE /identity/v3/projects/beb44630ca8541ea8a2d88821c98cc5c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:41.593109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2709f5-16c5-4332-9c3a-982286caeef7 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:41.602580 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2709f5-16c5-4332-9c3a-982286caeef7 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:41.655332 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513bfff-db17-4e9b-9021-ac95fa43705e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:41.656184 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513bfff-db17-4e9b-9021-ac95fa43705e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:41.656465 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513bfff-db17-4e9b-9021-ac95fa43705e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:41.656739 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513bfff-db17-4e9b-9021-ac95fa43705e admin admin] PATH_INFO: `/v3/users/27931cb95303412490f111f297d9dd52` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:41.657943 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513bfff-db17-4e9b-9021-ac95fa43705e admin admin] RBAC: Authorizing `identity:delete_user(user_id=27931cb95303412490f111f297d9dd52)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:41.659879 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513bfff-db17-4e9b-9021-ac95fa43705e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:41.707557 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e513bfff-db17-4e9b-9021-ac95fa43705e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27931cb95303412490f111f297d9dd52'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:41.719987 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e513bfff-db17-4e9b-9021-ac95fa43705e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27931cb95303412490f111f297d9dd52'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:41.720670 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e513bfff-db17-4e9b-9021-ac95fa43705e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27931cb95303412490f111f297d9dd52'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:41.721289 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e513bfff-db17-4e9b-9021-ac95fa43705e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27931cb95303412490f111f297d9dd52'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:41.728261 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e513bfff-db17-4e9b-9021-ac95fa43705e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27931cb95303412490f111f297d9dd52'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:41.739805 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1060/2121] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:41 2022] DELETE /identity/v3/users/27931cb95303412490f111f297d9dd52 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:42.005424 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9885fc-07dd-416f-9371-621c9dc56053 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:42.008343 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3a9885fc-07dd-416f-9371-621c9dc56053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:42.030287 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9885fc-07dd-416f-9371-621c9dc56053 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:42.098667 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608fc4f6-c9b5-4e02-a3c3-7cf785212623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:42.099529 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fc4f6-c9b5-4e02-a3c3-7cf785212623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:42.099806 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fc4f6-c9b5-4e02-a3c3-7cf785212623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:42.100079 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608fc4f6-c9b5-4e02-a3c3-7cf785212623 admin admin] PATH_INFO: `/v3/projects/189a9a1ff18d4ce18d6d177b71a3dfb9` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:42.101383 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fc4f6-c9b5-4e02-a3c3-7cf785212623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=189a9a1ff18d4ce18d6d177b71a3dfb9)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:42.103283 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608fc4f6-c9b5-4e02-a3c3-7cf785212623 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:42.148559 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-608fc4f6-c9b5-4e02-a3c3-7cf785212623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '189a9a1ff18d4ce18d6d177b71a3dfb9', 'request_id': 'req-608fc4f6-c9b5-4e02-a3c3-7cf785212623'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:42.155377 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-608fc4f6-c9b5-4e02-a3c3-7cf785212623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '189a9a1ff18d4ce18d6d177b71a3dfb9', 'request_id': 'req-608fc4f6-c9b5-4e02-a3c3-7cf785212623'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:42.160776 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-608fc4f6-c9b5-4e02-a3c3-7cf785212623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '189a9a1ff18d4ce18d6d177b71a3dfb9', 'request_id': 'req-608fc4f6-c9b5-4e02-a3c3-7cf785212623'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:42.171964 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-608fc4f6-c9b5-4e02-a3c3-7cf785212623 admin admin] The token cache is being invalidate because project 189a9a1ff18d4ce18d6d177b71a3dfb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:42.172240 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-608fc4f6-c9b5-4e02-a3c3-7cf785212623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:42.173057 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-608fc4f6-c9b5-4e02-a3c3-7cf785212623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:42.174592 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1062/2122] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:42 2022] DELETE /identity/v3/projects/189a9a1ff18d4ce18d6d177b71a3dfb9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:42.180758 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f963ef-b7f6-4e54-b661-80ac3506212d None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:42.181355 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f963ef-b7f6-4e54-b661-80ac3506212d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:42.181355 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f963ef-b7f6-4e54-b661-80ac3506212d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:42.199033 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-08f963ef-b7f6-4e54-b661-80ac3506212d None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:42.200234 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-08f963ef-b7f6-4e54-b661-80ac3506212d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:42.256948 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1061/2123] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:42.265575 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9364b7-67f3-4f45-aa07-03bf9fcc02e0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:42.265861 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9364b7-67f3-4f45-aa07-03bf9fcc02e0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:42.266148 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9364b7-67f3-4f45-aa07-03bf9fcc02e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:42.284339 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2b9364b7-67f3-4f45-aa07-03bf9fcc02e0 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:42.285568 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2b9364b7-67f3-4f45-aa07-03bf9fcc02e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:42.293672 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1063/2124] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:42.298627 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f963ef-b7f6-4e54-b661-80ac3506212d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:42.308036 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f963ef-b7f6-4e54-b661-80ac3506212d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:42.313220 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c43f7-6e95-4362-8fc5-9419b9aeaf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:42.314211 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c43f7-6e95-4362-8fc5-9419b9aeaf1d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:42.314354 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c43f7-6e95-4362-8fc5-9419b9aeaf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:42.314546 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c43f7-6e95-4362-8fc5-9419b9aeaf1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:42.315274 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c43f7-6e95-4362-8fc5-9419b9aeaf1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:34:42.315579 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c43f7-6e95-4362-8fc5-9419b9aeaf1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:42.317200 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c43f7-6e95-4362-8fc5-9419b9aeaf1d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:42.330891 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1062/2125] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:34:42.333438 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9364b7-67f3-4f45-aa07-03bf9fcc02e0 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:42.343291 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9364b7-67f3-4f45-aa07-03bf9fcc02e0 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:42.348307 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b8858-c0f4-48db-8011-9b47d32b3797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:42.348909 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b8858-c0f4-48db-8011-9b47d32b3797 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:42.349284 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b8858-c0f4-48db-8011-9b47d32b3797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:42.349590 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b8858-c0f4-48db-8011-9b47d32b3797 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:42.350310 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b8858-c0f4-48db-8011-9b47d32b3797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:42.352239 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4b8858-c0f4-48db-8011-9b47d32b3797 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:42.386454 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1064/2126] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:34:42 2022] POST /identity/v3/projects => generated 359 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:34:42.387574 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c43f7-6e95-4362-8fc5-9419b9aeaf1d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:42.400310 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c43f7-6e95-4362-8fc5-9419b9aeaf1d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:42.465767 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8705d69-29ad-4469-af79-a53076d3de4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:42.466634 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8705d69-29ad-4469-af79-a53076d3de4f admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:42.466920 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8705d69-29ad-4469-af79-a53076d3de4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:42.467192 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8705d69-29ad-4469-af79-a53076d3de4f admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:42.467903 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8705d69-29ad-4469-af79-a53076d3de4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:42.469941 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8705d69-29ad-4469-af79-a53076d3de4f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:42.489974 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1063/2127] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:34:42 2022] POST /identity/v3/users => generated 280 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:34:42.494128 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b8858-c0f4-48db-8011-9b47d32b3797 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:42.504613 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b8858-c0f4-48db-8011-9b47d32b3797 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:42.509732 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc447e-36e7-4877-b31c-cd6fc3ccdd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:42.510671 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc447e-36e7-4877-b31c-cd6fc3ccdd83 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:42.510947 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc447e-36e7-4877-b31c-cd6fc3ccdd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:42.511287 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc447e-36e7-4877-b31c-cd6fc3ccdd83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:42.512700 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc447e-36e7-4877-b31c-cd6fc3ccdd83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:42.514872 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fc447e-36e7-4877-b31c-cd6fc3ccdd83 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:42.526422 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1065/2128] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:42.530399 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8705d69-29ad-4469-af79-a53076d3de4f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:42.540558 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8705d69-29ad-4469-af79-a53076d3de4f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:42.546044 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c08ad-95e5-45ee-ae35-89cf52ffdecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:42.546719 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c08ad-95e5-45ee-ae35-89cf52ffdecb admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:42.548217 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c08ad-95e5-45ee-ae35-89cf52ffdecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:42.548499 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c08ad-95e5-45ee-ae35-89cf52ffdecb admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:42.549227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c08ad-95e5-45ee-ae35-89cf52ffdecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:42.550870 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c08ad-95e5-45ee-ae35-89cf52ffdecb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:42.561313 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1064/2129] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:42.565464 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc447e-36e7-4877-b31c-cd6fc3ccdd83 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:42.575270 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc447e-36e7-4877-b31c-cd6fc3ccdd83 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:42.581011 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20637f-f22e-4031-a85c-a57e67180112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:42.581904 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20637f-f22e-4031-a85c-a57e67180112 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:42.582190 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20637f-f22e-4031-a85c-a57e67180112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:42.582464 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20637f-f22e-4031-a85c-a57e67180112 admin admin] PATH_INFO: `/v3/projects/eef815cb35fe4476a109dc62f5986b89/users/69736a6a1fa4482eae3967c135745fb6/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:42.597756 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20637f-f22e-4031-a85c-a57e67180112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eef815cb35fe4476a109dc62f5986b89, user_id=69736a6a1fa4482eae3967c135745fb6, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:42.600474 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20637f-f22e-4031-a85c-a57e67180112 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:42.613429 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1066/2130] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:42 2022] PUT /identity/v3/projects/eef815cb35fe4476a109dc62f5986b89/users/69736a6a1fa4482eae3967c135745fb6/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:34:42.625045 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b27210-7168-4045-8c3a-912b6decda11 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:42.625357 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b27210-7168-4045-8c3a-912b6decda11 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:42.625630 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b27210-7168-4045-8c3a-912b6decda11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:42.656246 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f1b27210-7168-4045-8c3a-912b6decda11 None None] MFA Rules not processed for user `69736a6a1fa4482eae3967c135745fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:42.657490 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f1b27210-7168-4045-8c3a-912b6decda11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:42.729890 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1065/2131] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:42 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:42.756831 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20637f-f22e-4031-a85c-a57e67180112 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:42.758509 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-de20637f-f22e-4031-a85c-a57e67180112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:42.814838 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20637f-f22e-4031-a85c-a57e67180112 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:42.818447 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263ad0e-fe28-4562-98a9-9d61fa447ad6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:42.819080 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263ad0e-fe28-4562-98a9-9d61fa447ad6 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:42.819362 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263ad0e-fe28-4562-98a9-9d61fa447ad6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:42.819636 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263ad0e-fe28-4562-98a9-9d61fa447ad6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:42.828511 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c263ad0e-fe28-4562-98a9-9d61fa447ad6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:42.829968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c263ad0e-fe28-4562-98a9-9d61fa447ad6 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:42.838568 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1067/2132] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:42 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:42.853820 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b27210-7168-4045-8c3a-912b6decda11 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:42.912514 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b27210-7168-4045-8c3a-912b6decda11 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:42.917100 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24276acc-ce8c-440a-921b-19bc6c69dfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:42.917985 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24276acc-ce8c-440a-921b-19bc6c69dfdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:42.918267 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24276acc-ce8c-440a-921b-19bc6c69dfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:42.918543 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24276acc-ce8c-440a-921b-19bc6c69dfdb admin admin] PATH_INFO: `/v3/users/69736a6a1fa4482eae3967c135745fb6` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:42.919803 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24276acc-ce8c-440a-921b-19bc6c69dfdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=69736a6a1fa4482eae3967c135745fb6)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:42.922097 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24276acc-ce8c-440a-921b-19bc6c69dfdb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:42.966946 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-24276acc-ce8c-440a-921b-19bc6c69dfdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69736a6a1fa4482eae3967c135745fb6'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:42.978062 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-24276acc-ce8c-440a-921b-19bc6c69dfdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69736a6a1fa4482eae3967c135745fb6'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:42.978805 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-24276acc-ce8c-440a-921b-19bc6c69dfdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69736a6a1fa4482eae3967c135745fb6'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:42.979445 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-24276acc-ce8c-440a-921b-19bc6c69dfdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69736a6a1fa4482eae3967c135745fb6'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:42.986227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-24276acc-ce8c-440a-921b-19bc6c69dfdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69736a6a1fa4482eae3967c135745fb6'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:42.998498 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1066/2133] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:42 2022] DELETE /identity/v3/users/69736a6a1fa4482eae3967c135745fb6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:43.003190 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb2882-35ad-4899-aec2-472d3ed5afdd None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:43.003508 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb2882-35ad-4899-aec2-472d3ed5afdd None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:43.003783 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb2882-35ad-4899-aec2-472d3ed5afdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:43.020811 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0efb2882-35ad-4899-aec2-472d3ed5afdd None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:43.022046 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0efb2882-35ad-4899-aec2-472d3ed5afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:43.081879 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1068/2134] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:43.091587 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24276acc-ce8c-440a-921b-19bc6c69dfdb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:43.092974 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-24276acc-ce8c-440a-921b-19bc6c69dfdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:43.148839 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24276acc-ce8c-440a-921b-19bc6c69dfdb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:43.152412 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca5422-c5b0-444c-bbe6-f84cd724e426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:43.153054 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca5422-c5b0-444c-bbe6-f84cd724e426 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:43.153385 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca5422-c5b0-444c-bbe6-f84cd724e426 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:43.153656 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca5422-c5b0-444c-bbe6-f84cd724e426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:43.164357 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca5422-c5b0-444c-bbe6-f84cd724e426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:43.165988 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca5422-c5b0-444c-bbe6-f84cd724e426 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:43.176444 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1067/2135] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:43.532860 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb2882-35ad-4899-aec2-472d3ed5afdd None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:43.534630 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0efb2882-35ad-4899-aec2-472d3ed5afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:43.551176 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb2882-35ad-4899-aec2-472d3ed5afdd None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:43.555875 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc3160-c8f1-4d39-afb9-327e2292faaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:43.556730 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc3160-c8f1-4d39-afb9-327e2292faaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:43.557013 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc3160-c8f1-4d39-afb9-327e2292faaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:43.557306 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc3160-c8f1-4d39-afb9-327e2292faaa admin admin] PATH_INFO: `/v3/projects/eef815cb35fe4476a109dc62f5986b89` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:43.558517 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc3160-c8f1-4d39-afb9-327e2292faaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=eef815cb35fe4476a109dc62f5986b89)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:43.560547 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc3160-c8f1-4d39-afb9-327e2292faaa admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:43.611557 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-37fc3160-c8f1-4d39-afb9-327e2292faaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eef815cb35fe4476a109dc62f5986b89', 'request_id': 'req-37fc3160-c8f1-4d39-afb9-327e2292faaa'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:43.619283 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-37fc3160-c8f1-4d39-afb9-327e2292faaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eef815cb35fe4476a109dc62f5986b89', 'request_id': 'req-37fc3160-c8f1-4d39-afb9-327e2292faaa'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:43.626103 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-37fc3160-c8f1-4d39-afb9-327e2292faaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eef815cb35fe4476a109dc62f5986b89', 'request_id': 'req-37fc3160-c8f1-4d39-afb9-327e2292faaa'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:43.637802 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-37fc3160-c8f1-4d39-afb9-327e2292faaa admin admin] The token cache is being invalidate because project eef815cb35fe4476a109dc62f5986b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:43.638218 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-37fc3160-c8f1-4d39-afb9-327e2292faaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:43.638997 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-37fc3160-c8f1-4d39-afb9-327e2292faaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:43.640673 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1069/2136] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:43 2022] DELETE /identity/v3/projects/eef815cb35fe4476a109dc62f5986b89 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:43.645639 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2707d1-4010-4f21-9333-df20afd38e27 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:43.646104 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2707d1-4010-4f21-9333-df20afd38e27 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:43.646210 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2707d1-4010-4f21-9333-df20afd38e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:43.664249 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-1d2707d1-4010-4f21-9333-df20afd38e27 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:43.665409 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-1d2707d1-4010-4f21-9333-df20afd38e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:43.723076 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1068/2137] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:43.730809 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31d24f-21bc-45f8-905f-2533daf8e917 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:43.731100 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31d24f-21bc-45f8-905f-2533daf8e917 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:43.731378 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31d24f-21bc-45f8-905f-2533daf8e917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:43.750179 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-cb31d24f-21bc-45f8-905f-2533daf8e917 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:43.751547 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cb31d24f-21bc-45f8-905f-2533daf8e917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:43.760330 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1070/2138] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:43.765057 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2707d1-4010-4f21-9333-df20afd38e27 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:43.774632 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2707d1-4010-4f21-9333-df20afd38e27 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:43.779911 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d7f19-73a6-4618-8c83-5c1e3af76169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:43.780541 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d7f19-73a6-4618-8c83-5c1e3af76169 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:43.780815 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d7f19-73a6-4618-8c83-5c1e3af76169 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:43.781083 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d7f19-73a6-4618-8c83-5c1e3af76169 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:43.781844 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d7f19-73a6-4618-8c83-5c1e3af76169 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:34:43.782139 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d7f19-73a6-4618-8c83-5c1e3af76169 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:43.783745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d7f19-73a6-4618-8c83-5c1e3af76169 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:43.794918 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1069/2139] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:34:43.799221 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31d24f-21bc-45f8-905f-2533daf8e917 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:43.808229 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31d24f-21bc-45f8-905f-2533daf8e917 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:43.812908 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4b92a-3381-4de8-bdc4-91659c874563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:43.813583 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4b92a-3381-4de8-bdc4-91659c874563 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:43.813863 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4b92a-3381-4de8-bdc4-91659c874563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:43.814135 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa4b92a-3381-4de8-bdc4-91659c874563 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:43.814815 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4b92a-3381-4de8-bdc4-91659c874563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:43.816738 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa4b92a-3381-4de8-bdc4-91659c874563 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:43.842099 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1071/2140] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:34:43 2022] POST /identity/v3/projects => generated 363 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:43.846156 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d7f19-73a6-4618-8c83-5c1e3af76169 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:43.855866 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d7f19-73a6-4618-8c83-5c1e3af76169 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:43.910991 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6cf712-6192-42a4-b4bf-f3163e44430d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:43.911657 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cf712-6192-42a4-b4bf-f3163e44430d admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:43.911941 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cf712-6192-42a4-b4bf-f3163e44430d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:43.912217 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cf712-6192-42a4-b4bf-f3163e44430d admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:43.912911 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6cf712-6192-42a4-b4bf-f3163e44430d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:43.914936 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6cf712-6192-42a4-b4bf-f3163e44430d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:43.934109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1070/2141] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:34:43 2022] POST /identity/v3/users => generated 282 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:34:43.938039 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4b92a-3381-4de8-bdc4-91659c874563 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:43.948135 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa4b92a-3381-4de8-bdc4-91659c874563 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:43.953344 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d68a9-b2be-4f10-bbac-a511451c6086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:43.954012 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d68a9-b2be-4f10-bbac-a511451c6086 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:43.954288 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d68a9-b2be-4f10-bbac-a511451c6086 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:43.954559 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d68a9-b2be-4f10-bbac-a511451c6086 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:43.955308 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d68a9-b2be-4f10-bbac-a511451c6086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:43.956890 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d68a9-b2be-4f10-bbac-a511451c6086 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:43.967600 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1072/2142] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:43.971284 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6cf712-6192-42a4-b4bf-f3163e44430d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:43.981120 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6cf712-6192-42a4-b4bf-f3163e44430d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:43.985924 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d80ad-e033-4ecc-8ee1-289a3f34e49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:43.986581 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d80ad-e033-4ecc-8ee1-289a3f34e49a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:43.986849 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d80ad-e033-4ecc-8ee1-289a3f34e49a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:43.987126 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d80ad-e033-4ecc-8ee1-289a3f34e49a admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:43.987849 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d80ad-e033-4ecc-8ee1-289a3f34e49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:43.989477 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d80ad-e033-4ecc-8ee1-289a3f34e49a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:43.998902 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1071/2143] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:34:44.002755 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d68a9-b2be-4f10-bbac-a511451c6086 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:44.012569 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d68a9-b2be-4f10-bbac-a511451c6086 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:44.019329 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf87a2-3144-4462-9e32-1426155d6396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:44.020180 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf87a2-3144-4462-9e32-1426155d6396 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:44.020459 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf87a2-3144-4462-9e32-1426155d6396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:44.020731 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf87a2-3144-4462-9e32-1426155d6396 admin admin] PATH_INFO: `/v3/projects/182857ffac364ab4ab8861d3146087aa/users/8372df8473a74d76bc4b51c5fbee0086/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:44.035338 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf87a2-3144-4462-9e32-1426155d6396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=182857ffac364ab4ab8861d3146087aa, user_id=8372df8473a74d76bc4b51c5fbee0086, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:44.038038 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf87a2-3144-4462-9e32-1426155d6396 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:44.051835 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1073/2144] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:34:44 2022] PUT /identity/v3/projects/182857ffac364ab4ab8861d3146087aa/users/8372df8473a74d76bc4b51c5fbee0086/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:44.063158 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a487d76-0370-431e-be5b-28d008b6b2f9 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:44.063450 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a487d76-0370-431e-be5b-28d008b6b2f9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:44.063727 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a487d76-0370-431e-be5b-28d008b6b2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:44.094195 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-9a487d76-0370-431e-be5b-28d008b6b2f9 None None] MFA Rules not processed for user `8372df8473a74d76bc4b51c5fbee0086`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:44.095420 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9a487d76-0370-431e-be5b-28d008b6b2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:44.168790 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1072/2145] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:44 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:44.179637 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf87a2-3144-4462-9e32-1426155d6396 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:44.181730 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-22bf87a2-3144-4462-9e32-1426155d6396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:44.265563 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf87a2-3144-4462-9e32-1426155d6396 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:44.270513 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300f6f2-1ca5-4e99-8328-1b346afce367 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:44.271386 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300f6f2-1ca5-4e99-8328-1b346afce367 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:44.271819 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300f6f2-1ca5-4e99-8328-1b346afce367 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:44.272598 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300f6f2-1ca5-4e99-8328-1b346afce367 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:44.284940 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300f6f2-1ca5-4e99-8328-1b346afce367 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:44.286431 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300f6f2-1ca5-4e99-8328-1b346afce367 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:44.297853 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1074/2146] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:44 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:47.063309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a487d76-0370-431e-be5b-28d008b6b2f9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:47.064702 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9a487d76-0370-431e-be5b-28d008b6b2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:47.130463 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a487d76-0370-431e-be5b-28d008b6b2f9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:47.135884 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b79a6a-d66d-46e4-9b62-5b04c3e6d436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:47.136965 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b79a6a-d66d-46e4-9b62-5b04c3e6d436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:47.137245 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b79a6a-d66d-46e4-9b62-5b04c3e6d436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:47.137553 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b79a6a-d66d-46e4-9b62-5b04c3e6d436 admin admin] PATH_INFO: `/v3/users/1da296ac919f4dc681e0125d21f32bdf` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:47.139513 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b79a6a-d66d-46e4-9b62-5b04c3e6d436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da296ac919f4dc681e0125d21f32bdf)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:47.141586 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b79a6a-d66d-46e4-9b62-5b04c3e6d436 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:47.188715 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-79b79a6a-d66d-46e4-9b62-5b04c3e6d436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da296ac919f4dc681e0125d21f32bdf'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:47.200211 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-79b79a6a-d66d-46e4-9b62-5b04c3e6d436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da296ac919f4dc681e0125d21f32bdf'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:47.201495 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-79b79a6a-d66d-46e4-9b62-5b04c3e6d436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da296ac919f4dc681e0125d21f32bdf'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:47.202530 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-79b79a6a-d66d-46e4-9b62-5b04c3e6d436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da296ac919f4dc681e0125d21f32bdf'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:47.209924 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-79b79a6a-d66d-46e4-9b62-5b04c3e6d436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da296ac919f4dc681e0125d21f32bdf'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:47.222244 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1073/2147] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:34:47 2022] DELETE /identity/v3/users/1da296ac919f4dc681e0125d21f32bdf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:34:47.226590 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95550a17-5750-417a-abd6-e1b4c1fd4cd8 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:47.227168 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95550a17-5750-417a-abd6-e1b4c1fd4cd8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:47.227452 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95550a17-5750-417a-abd6-e1b4c1fd4cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:47.244971 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-95550a17-5750-417a-abd6-e1b4c1fd4cd8 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:34:47.246262 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-95550a17-5750-417a-abd6-e1b4c1fd4cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:47.305324 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1075/2148] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:34:47.315704 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b79a6a-d66d-46e4-9b62-5b04c3e6d436 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:47.317431 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-79b79a6a-d66d-46e4-9b62-5b04c3e6d436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:47.375144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b79a6a-d66d-46e4-9b62-5b04c3e6d436 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:47.379036 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c27da6-2cce-4a7c-9d95-c5e0f0737fb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:47.379679 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c27da6-2cce-4a7c-9d95-c5e0f0737fb6 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:47.379960 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c27da6-2cce-4a7c-9d95-c5e0f0737fb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:47.380239 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c27da6-2cce-4a7c-9d95-c5e0f0737fb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:47.389234 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c27da6-2cce-4a7c-9d95-c5e0f0737fb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:47.390705 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c27da6-2cce-4a7c-9d95-c5e0f0737fb6 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:47.400193 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1074/2149] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:34:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:34:47.693457 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95550a17-5750-417a-abd6-e1b4c1fd4cd8 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:34:47.695224 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-95550a17-5750-417a-abd6-e1b4c1fd4cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:34:47.711052 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95550a17-5750-417a-abd6-e1b4c1fd4cd8 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:34:47.715968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc199b-e34f-4e28-bfb9-0dfdb5d7892f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:34:47.717676 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc199b-e34f-4e28-bfb9-0dfdb5d7892f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:34:47.718179 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc199b-e34f-4e28-bfb9-0dfdb5d7892f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:34:47.718644 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc199b-e34f-4e28-bfb9-0dfdb5d7892f admin admin] PATH_INFO: `/v3/projects/e50b0e0285284d8595dfb473c120ca05` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:34:47.720624 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc199b-e34f-4e28-bfb9-0dfdb5d7892f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e50b0e0285284d8595dfb473c120ca05)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:34:47.722818 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc199b-e34f-4e28-bfb9-0dfdb5d7892f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:34:47.769755 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-80bc199b-e34f-4e28-bfb9-0dfdb5d7892f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e50b0e0285284d8595dfb473c120ca05', 'request_id': 'req-80bc199b-e34f-4e28-bfb9-0dfdb5d7892f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:47.776635 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-80bc199b-e34f-4e28-bfb9-0dfdb5d7892f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e50b0e0285284d8595dfb473c120ca05', 'request_id': 'req-80bc199b-e34f-4e28-bfb9-0dfdb5d7892f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:47.783209 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-80bc199b-e34f-4e28-bfb9-0dfdb5d7892f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e50b0e0285284d8595dfb473c120ca05', 'request_id': 'req-80bc199b-e34f-4e28-bfb9-0dfdb5d7892f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:47.801557 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-80bc199b-e34f-4e28-bfb9-0dfdb5d7892f admin admin] The token cache is being invalidate because project e50b0e0285284d8595dfb473c120ca05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:34:47.801946 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-80bc199b-e34f-4e28-bfb9-0dfdb5d7892f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:47.802727 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-80bc199b-e34f-4e28-bfb9-0dfdb5d7892f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:34:47.817633 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1076/2150] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:34:47 2022] DELETE /identity/v3/projects/e50b0e0285284d8595dfb473c120ca05 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:35:01.468346 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9422a0-788a-4f80-8df9-2f77bea40aa3 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:01.468869 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9422a0-788a-4f80-8df9-2f77bea40aa3 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:01.469033 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9422a0-788a-4f80-8df9-2f77bea40aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:01.487227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-7f9422a0-788a-4f80-8df9-2f77bea40aa3 None None] MFA Rules not processed for user `4d22345d2e2646cc99c74a2f9692b648`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:35:01.488837 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7f9422a0-788a-4f80-8df9-2f77bea40aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:01.571582 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1075/2151] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Feb 16 05:35:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:35:01.631514 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc199b-e34f-4e28-bfb9-0dfdb5d7892f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:01.633615 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-80bc199b-e34f-4e28-bfb9-0dfdb5d7892f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:01.727520 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc199b-e34f-4e28-bfb9-0dfdb5d7892f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:01.734585 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96412d48-33e5-4c07-8139-80f164792a41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eb49cac0c94e73a70361831dd789b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:01.735958 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96412d48-33e5-4c07-8139-80f164792a41 service swift] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:01.736808 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96412d48-33e5-4c07-8139-80f164792a41 service swift] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:01.737092 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96412d48-33e5-4c07-8139-80f164792a41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:01.747945 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96412d48-33e5-4c07-8139-80f164792a41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:01.750364 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96412d48-33e5-4c07-8139-80f164792a41 service swift] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:01.781944 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1077/2152] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Feb 16 05:35:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:35:02.782006 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb041ad6-3cd2-48d4-b4c0-6abf019e0f42 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:02.783350 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb041ad6-3cd2-48d4-b4c0-6abf019e0f42 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:02.783864 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb041ad6-3cd2-48d4-b4c0-6abf019e0f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:02.808416 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-fb041ad6-3cd2-48d4-b4c0-6abf019e0f42 None None] MFA Rules not processed for user `65045a2a88084c12aeb9133bf0162193`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:35:02.809741 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fb041ad6-3cd2-48d4-b4c0-6abf019e0f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:02.870104 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1076/2153] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:35:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:35:21.614339 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96412d48-33e5-4c07-8139-80f164792a41 service swift] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:21.615897 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-96412d48-33e5-4c07-8139-80f164792a41 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:21.683314 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96412d48-33e5-4c07-8139-80f164792a41 service swift] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:21.688742 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf1ff7-fb78-4d70-9dfc-cc4228a13ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:21.689639 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf1ff7-fb78-4d70-9dfc-cc4228a13ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:21.689914 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf1ff7-fb78-4d70-9dfc-cc4228a13ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:21.690186 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf1ff7-fb78-4d70-9dfc-cc4228a13ad7 admin admin] PATH_INFO: `/v3/users/e523f071b1ce4fffb80924e66f5d5bb7` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:21.691430 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf1ff7-fb78-4d70-9dfc-cc4228a13ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e523f071b1ce4fffb80924e66f5d5bb7)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:21.693434 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf1ff7-fb78-4d70-9dfc-cc4228a13ad7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:21.754212 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c7cf1ff7-fb78-4d70-9dfc-cc4228a13ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e523f071b1ce4fffb80924e66f5d5bb7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:21.765174 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c7cf1ff7-fb78-4d70-9dfc-cc4228a13ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e523f071b1ce4fffb80924e66f5d5bb7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:21.779290 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c7cf1ff7-fb78-4d70-9dfc-cc4228a13ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e523f071b1ce4fffb80924e66f5d5bb7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:21.780426 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c7cf1ff7-fb78-4d70-9dfc-cc4228a13ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e523f071b1ce4fffb80924e66f5d5bb7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:21.781399 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c7cf1ff7-fb78-4d70-9dfc-cc4228a13ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e523f071b1ce4fffb80924e66f5d5bb7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:21.797780 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1078/2154] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:35:21 2022] DELETE /identity/v3/users/e523f071b1ce4fffb80924e66f5d5bb7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:35:21.802734 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed785ba0-68c1-42a9-b6dd-0d69a792079b None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:21.803890 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed785ba0-68c1-42a9-b6dd-0d69a792079b None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:21.804261 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed785ba0-68c1-42a9-b6dd-0d69a792079b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:21.827544 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ed785ba0-68c1-42a9-b6dd-0d69a792079b None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:35:21.829183 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ed785ba0-68c1-42a9-b6dd-0d69a792079b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:21.902170 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1077/2155] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:35:21.913752 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf1ff7-fb78-4d70-9dfc-cc4228a13ad7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:21.915709 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c7cf1ff7-fb78-4d70-9dfc-cc4228a13ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:22.012276 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf1ff7-fb78-4d70-9dfc-cc4228a13ad7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:22.016861 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5da60-d76d-4a26-90c9-08e99b38cc04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:22.017580 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5da60-d76d-4a26-90c9-08e99b38cc04 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:22.018003 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5da60-d76d-4a26-90c9-08e99b38cc04 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:22.018501 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5da60-d76d-4a26-90c9-08e99b38cc04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:22.028856 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5da60-d76d-4a26-90c9-08e99b38cc04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:22.030880 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca5da60-d76d-4a26-90c9-08e99b38cc04 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:22.040949 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1079/2156] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:35:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:35:22.652491 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed785ba0-68c1-42a9-b6dd-0d69a792079b None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:22.654020 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ed785ba0-68c1-42a9-b6dd-0d69a792079b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:22.668553 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed785ba0-68c1-42a9-b6dd-0d69a792079b None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:22.675784 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c4acc-8f1d-489b-8eb9-a0b6cfdc0d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:22.677079 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c4acc-8f1d-489b-8eb9-a0b6cfdc0d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:22.677481 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c4acc-8f1d-489b-8eb9-a0b6cfdc0d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:22.678051 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c4acc-8f1d-489b-8eb9-a0b6cfdc0d49 admin admin] PATH_INFO: `/v3/projects/ef5ac29a6d674d778718648b4bf05e17` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:22.679303 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c4acc-8f1d-489b-8eb9-a0b6cfdc0d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef5ac29a6d674d778718648b4bf05e17)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:22.681907 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c4acc-8f1d-489b-8eb9-a0b6cfdc0d49 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:22.739119 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-fb8c4acc-8f1d-489b-8eb9-a0b6cfdc0d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef5ac29a6d674d778718648b4bf05e17', 'request_id': 'req-fb8c4acc-8f1d-489b-8eb9-a0b6cfdc0d49'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:22.746908 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-fb8c4acc-8f1d-489b-8eb9-a0b6cfdc0d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef5ac29a6d674d778718648b4bf05e17', 'request_id': 'req-fb8c4acc-8f1d-489b-8eb9-a0b6cfdc0d49'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:22.752942 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-fb8c4acc-8f1d-489b-8eb9-a0b6cfdc0d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef5ac29a6d674d778718648b4bf05e17', 'request_id': 'req-fb8c4acc-8f1d-489b-8eb9-a0b6cfdc0d49'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:22.764159 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-fb8c4acc-8f1d-489b-8eb9-a0b6cfdc0d49 admin admin] The token cache is being invalidate because project ef5ac29a6d674d778718648b4bf05e17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:35:22.764485 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-fb8c4acc-8f1d-489b-8eb9-a0b6cfdc0d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:22.765149 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-fb8c4acc-8f1d-489b-8eb9-a0b6cfdc0d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:22.767135 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1078/2157] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:35:22 2022] DELETE /identity/v3/projects/ef5ac29a6d674d778718648b4bf05e17 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:35:22.771991 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc2945-ad71-46f4-b2c6-70c601c9653e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:22.772495 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc2945-ad71-46f4-b2c6-70c601c9653e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:22.772605 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc2945-ad71-46f4-b2c6-70c601c9653e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:22.790932 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-f1dc2945-ad71-46f4-b2c6-70c601c9653e None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:35:22.792143 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f1dc2945-ad71-46f4-b2c6-70c601c9653e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:22.869581 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1080/2158] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:35:22.871496 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d422ea3-40b3-44e3-bc3a-adea4cd46113 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:22.871969 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d422ea3-40b3-44e3-bc3a-adea4cd46113 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:22.872070 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d422ea3-40b3-44e3-bc3a-adea4cd46113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:22.895248 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-0d422ea3-40b3-44e3-bc3a-adea4cd46113 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:35:22.896557 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0d422ea3-40b3-44e3-bc3a-adea4cd46113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:22.913642 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1079/2159] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:35:22.917930 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc2945-ad71-46f4-b2c6-70c601c9653e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:22.929662 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc2945-ad71-46f4-b2c6-70c601c9653e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:22.935154 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8421a-042b-4c3d-8588-a570da57dd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:22.935827 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8421a-042b-4c3d-8588-a570da57dd19 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:22.936109 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8421a-042b-4c3d-8588-a570da57dd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:22.936400 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8421a-042b-4c3d-8588-a570da57dd19 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:22.937294 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8421a-042b-4c3d-8588-a570da57dd19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:35:22.937613 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8421a-042b-4c3d-8588-a570da57dd19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:22.940999 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8421a-042b-4c3d-8588-a570da57dd19 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:22.957622 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1081/2160] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:35:22.958638 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d422ea3-40b3-44e3-bc3a-adea4cd46113 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:22.970577 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d422ea3-40b3-44e3-bc3a-adea4cd46113 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:22.978482 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd7c21-5deb-41a2-8f70-f5d0a0a20434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:22.979074 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd7c21-5deb-41a2-8f70-f5d0a0a20434 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:22.979418 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd7c21-5deb-41a2-8f70-f5d0a0a20434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:22.979758 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd7c21-5deb-41a2-8f70-f5d0a0a20434 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:22.980590 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd7c21-5deb-41a2-8f70-f5d0a0a20434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:22.982553 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd7c21-5deb-41a2-8f70-f5d0a0a20434 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:23.019877 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1080/2161] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:35:22 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:35:23.023824 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8421a-042b-4c3d-8588-a570da57dd19 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:23.038191 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8421a-042b-4c3d-8588-a570da57dd19 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:23.104096 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75599746-63dd-48e4-aefd-c65261f47fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:23.104762 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75599746-63dd-48e4-aefd-c65261f47fab admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:23.105036 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75599746-63dd-48e4-aefd-c65261f47fab admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:23.105331 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75599746-63dd-48e4-aefd-c65261f47fab admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:23.106232 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75599746-63dd-48e4-aefd-c65261f47fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:23.108429 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75599746-63dd-48e4-aefd-c65261f47fab admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:23.130109 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1082/2162] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:35:23 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:35:23.135046 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd7c21-5deb-41a2-8f70-f5d0a0a20434 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:23.150624 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd7c21-5deb-41a2-8f70-f5d0a0a20434 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:23.158273 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5aef4e-a7d3-4324-8df6-7b533540fb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:23.159372 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5aef4e-a7d3-4324-8df6-7b533540fb76 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:23.159913 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5aef4e-a7d3-4324-8df6-7b533540fb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:23.160219 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5aef4e-a7d3-4324-8df6-7b533540fb76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:23.160973 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5aef4e-a7d3-4324-8df6-7b533540fb76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:23.162676 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5aef4e-a7d3-4324-8df6-7b533540fb76 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:23.175036 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1081/2163] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:35:23.179157 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75599746-63dd-48e4-aefd-c65261f47fab admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:23.191535 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75599746-63dd-48e4-aefd-c65261f47fab admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:23.196582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538987c-f678-4bb8-8e9b-934b56172d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:23.197432 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538987c-f678-4bb8-8e9b-934b56172d64 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:23.197811 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538987c-f678-4bb8-8e9b-934b56172d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:23.198193 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538987c-f678-4bb8-8e9b-934b56172d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:23.199021 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538987c-f678-4bb8-8e9b-934b56172d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:23.200732 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538987c-f678-4bb8-8e9b-934b56172d64 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:23.212120 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1083/2164] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:35:23.216479 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5aef4e-a7d3-4324-8df6-7b533540fb76 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:23.227386 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5aef4e-a7d3-4324-8df6-7b533540fb76 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:23.232111 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99809942-1f83-4d02-830a-aabaf99cc2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:23.232982 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99809942-1f83-4d02-830a-aabaf99cc2fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:23.233276 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99809942-1f83-4d02-830a-aabaf99cc2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:23.233568 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99809942-1f83-4d02-830a-aabaf99cc2fd admin admin] PATH_INFO: `/v3/projects/a642dcc1cb8a4c1bbd3b1450e060c74c/users/ae34f18423784b6d9e9bd45f2fa796e2/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:23.248395 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99809942-1f83-4d02-830a-aabaf99cc2fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a642dcc1cb8a4c1bbd3b1450e060c74c, user_id=ae34f18423784b6d9e9bd45f2fa796e2, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:23.251592 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99809942-1f83-4d02-830a-aabaf99cc2fd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:23.269342 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1082/2165] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:35:23 2022] PUT /identity/v3/projects/a642dcc1cb8a4c1bbd3b1450e060c74c/users/ae34f18423784b6d9e9bd45f2fa796e2/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:35:23.271247 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc595ae-2dd8-4c13-a3ae-290ad59171ce None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:23.271639 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc595ae-2dd8-4c13-a3ae-290ad59171ce None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:23.272128 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc595ae-2dd8-4c13-a3ae-290ad59171ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:23.291655 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-5dc595ae-2dd8-4c13-a3ae-290ad59171ce None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:35:23.292862 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5dc595ae-2dd8-4c13-a3ae-290ad59171ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:23.362874 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1084/2166] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:35:23.375833 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99809942-1f83-4d02-830a-aabaf99cc2fd admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:23.377940 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-99809942-1f83-4d02-830a-aabaf99cc2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:23.450299 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99809942-1f83-4d02-830a-aabaf99cc2fd admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:23.455080 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e57f6-58d9-4277-bb99-e4103bd4629d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:23.455753 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e57f6-58d9-4277-bb99-e4103bd4629d service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:23.456034 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e57f6-58d9-4277-bb99-e4103bd4629d service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:23.456311 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e57f6-58d9-4277-bb99-e4103bd4629d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:23.469050 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e57f6-58d9-4277-bb99-e4103bd4629d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:23.470565 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e57f6-58d9-4277-bb99-e4103bd4629d service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:23.482852 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1083/2167] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:35:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:35:24.223089 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b9fbe-a340-4e7e-a814-cbd34613e753 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:24.224194 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b9fbe-a340-4e7e-a814-cbd34613e753 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:24.224478 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b9fbe-a340-4e7e-a814-cbd34613e753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:24.263386 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-445b9fbe-a340-4e7e-a814-cbd34613e753 None None] MFA Rules not processed for user `ae34f18423784b6d9e9bd45f2fa796e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:35:24.264881 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-445b9fbe-a340-4e7e-a814-cbd34613e753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:24.349728 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1085/2168] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:35:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:35:24.360319 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e57f6-58d9-4277-bb99-e4103bd4629d service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:24.362677 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c51e57f6-58d9-4277-bb99-e4103bd4629d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:24.428874 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e57f6-58d9-4277-bb99-e4103bd4629d service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:24.436149 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9130b1b2-e13b-42cc-8c0b-cb62983afdec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:24.437112 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130b1b2-e13b-42cc-8c0b-cb62983afdec service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:24.437678 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130b1b2-e13b-42cc-8c0b-cb62983afdec service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:24.438039 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9130b1b2-e13b-42cc-8c0b-cb62983afdec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:24.449342 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130b1b2-e13b-42cc-8c0b-cb62983afdec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:24.451104 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9130b1b2-e13b-42cc-8c0b-cb62983afdec service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:24.461755 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1084/2169] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:35:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:35:25.860185 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77713a45-f019-49f9-a900-10b14cd6cdb9 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:25.860690 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77713a45-f019-49f9-a900-10b14cd6cdb9 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:25.860802 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77713a45-f019-49f9-a900-10b14cd6cdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:25.879409 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-77713a45-f019-49f9-a900-10b14cd6cdb9 None None] MFA Rules not processed for user `ae34f18423784b6d9e9bd45f2fa796e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:35:25.880600 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-77713a45-f019-49f9-a900-10b14cd6cdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:25.887424 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1086/2170] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:35:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:35:31.242896 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f09b23-4177-4c94-9949-a7f2cd5502ea None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:31.243447 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f09b23-4177-4c94-9949-a7f2cd5502ea None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:31.243447 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f09b23-4177-4c94-9949-a7f2cd5502ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:31.272591 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-09f09b23-4177-4c94-9949-a7f2cd5502ea None None] MFA Rules not processed for user `4d22345d2e2646cc99c74a2f9692b648`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:35:31.274172 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-09f09b23-4177-4c94-9949-a7f2cd5502ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:31.350068 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1085/2171] 10.222.0.75 () {58 vars in 967 bytes} [Wed Feb 16 05:35:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:35:31.362595 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77713a45-f019-49f9-a900-10b14cd6cdb9 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:31.363981 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-77713a45-f019-49f9-a900-10b14cd6cdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:31.461127 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77713a45-f019-49f9-a900-10b14cd6cdb9 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:31.466330 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f71fa-08ee-41f9-a92b-c0fba3ec2742 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eb49cac0c94e73a70361831dd789b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:31.466964 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f71fa-08ee-41f9-a92b-c0fba3ec2742 service swift] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:31.467247 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f71fa-08ee-41f9-a92b-c0fba3ec2742 service swift] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:31.467522 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f71fa-08ee-41f9-a92b-c0fba3ec2742 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:31.475957 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f71fa-08ee-41f9-a92b-c0fba3ec2742 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:31.477579 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f71fa-08ee-41f9-a92b-c0fba3ec2742 service swift] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:31.485314 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1087/2172] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Feb 16 05:35:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:35:33.785815 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f09b23-4177-4c94-9949-a7f2cd5502ea None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:33.787315 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-09f09b23-4177-4c94-9949-a7f2cd5502ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:33.813750 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f09b23-4177-4c94-9949-a7f2cd5502ea None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:33.818759 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe3eb1-f336-4d27-bd42-1a167044afa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:33.819623 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe3eb1-f336-4d27-bd42-1a167044afa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:33.819899 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe3eb1-f336-4d27-bd42-1a167044afa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:33.820165 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe3eb1-f336-4d27-bd42-1a167044afa6 admin admin] PATH_INFO: `/v3/users/7e792fde8d97434b95de7a9b58a41d14` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:33.821718 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe3eb1-f336-4d27-bd42-1a167044afa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e792fde8d97434b95de7a9b58a41d14)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:33.823972 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe3eb1-f336-4d27-bd42-1a167044afa6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:33.879422 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-dfbe3eb1-f336-4d27-bd42-1a167044afa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e792fde8d97434b95de7a9b58a41d14'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:33.893252 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-dfbe3eb1-f336-4d27-bd42-1a167044afa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e792fde8d97434b95de7a9b58a41d14'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:33.893946 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-dfbe3eb1-f336-4d27-bd42-1a167044afa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e792fde8d97434b95de7a9b58a41d14'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:33.894620 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-dfbe3eb1-f336-4d27-bd42-1a167044afa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e792fde8d97434b95de7a9b58a41d14'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:33.902818 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-dfbe3eb1-f336-4d27-bd42-1a167044afa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e792fde8d97434b95de7a9b58a41d14'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:33.916849 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1086/2173] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:35:33 2022] DELETE /identity/v3/users/7e792fde8d97434b95de7a9b58a41d14 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:35:34.134116 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f71fa-08ee-41f9-a92b-c0fba3ec2742 service swift] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:34.150191 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f71fa-08ee-41f9-a92b-c0fba3ec2742 service swift] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:34.258295 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a931c51-61cd-4ac3-8be9-cee7d8be2da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:34.260057 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a931c51-61cd-4ac3-8be9-cee7d8be2da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:34.260057 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a931c51-61cd-4ac3-8be9-cee7d8be2da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:34.260057 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a931c51-61cd-4ac3-8be9-cee7d8be2da9 admin admin] PATH_INFO: `/v3/projects/434acd7d54a24e18a504c01b72599c36` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:34.261659 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a931c51-61cd-4ac3-8be9-cee7d8be2da9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=434acd7d54a24e18a504c01b72599c36)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:34.264094 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a931c51-61cd-4ac3-8be9-cee7d8be2da9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:34.333182 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1a931c51-61cd-4ac3-8be9-cee7d8be2da9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '434acd7d54a24e18a504c01b72599c36', 'request_id': 'req-1a931c51-61cd-4ac3-8be9-cee7d8be2da9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:34.346232 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1a931c51-61cd-4ac3-8be9-cee7d8be2da9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '434acd7d54a24e18a504c01b72599c36', 'request_id': 'req-1a931c51-61cd-4ac3-8be9-cee7d8be2da9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:34.356919 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1a931c51-61cd-4ac3-8be9-cee7d8be2da9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '434acd7d54a24e18a504c01b72599c36', 'request_id': 'req-1a931c51-61cd-4ac3-8be9-cee7d8be2da9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:34.374740 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1a931c51-61cd-4ac3-8be9-cee7d8be2da9 admin admin] The token cache is being invalidate because project 434acd7d54a24e18a504c01b72599c36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:35:34.375394 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1a931c51-61cd-4ac3-8be9-cee7d8be2da9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:34.376123 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1a931c51-61cd-4ac3-8be9-cee7d8be2da9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:34.378346 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1088/2174] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:35:34 2022] DELETE /identity/v3/projects/434acd7d54a24e18a504c01b72599c36 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:35:34.383762 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d634db1-24d0-4ac8-9c48-124d797e9d02 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:34.384248 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d634db1-24d0-4ac8-9c48-124d797e9d02 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:34.384443 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d634db1-24d0-4ac8-9c48-124d797e9d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:34.441984 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-9d634db1-24d0-4ac8-9c48-124d797e9d02 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:35:34.443450 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9d634db1-24d0-4ac8-9c48-124d797e9d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:34.520643 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1087/2175] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:35:34.528369 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc89e9-303c-48cd-aa37-009393b4a9a1 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:34.528568 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc89e9-303c-48cd-aa37-009393b4a9a1 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:34.528841 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc89e9-303c-48cd-aa37-009393b4a9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:34.551812 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-17dc89e9-303c-48cd-aa37-009393b4a9a1 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:35:34.553171 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-17dc89e9-303c-48cd-aa37-009393b4a9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:34.561776 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1089/2176] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:35:34.566338 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d634db1-24d0-4ac8-9c48-124d797e9d02 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:34.586893 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d634db1-24d0-4ac8-9c48-124d797e9d02 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:34.586893 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a29e48-41a9-4847-bfff-d9749f5ca97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:34.586893 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a29e48-41a9-4847-bfff-d9749f5ca97a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:34.586893 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a29e48-41a9-4847-bfff-d9749f5ca97a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:34.587169 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a29e48-41a9-4847-bfff-d9749f5ca97a admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:34.587169 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a29e48-41a9-4847-bfff-d9749f5ca97a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:35:34.587169 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a29e48-41a9-4847-bfff-d9749f5ca97a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:34.587884 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a29e48-41a9-4847-bfff-d9749f5ca97a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:34.611277 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc89e9-303c-48cd-aa37-009393b4a9a1 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:34.612968 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1088/2177] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:35:34.627845 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc89e9-303c-48cd-aa37-009393b4a9a1 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:34.637008 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de600aba-5a93-47e8-a087-5bd8f5df3bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:34.638035 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de600aba-5a93-47e8-a087-5bd8f5df3bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:34.638544 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de600aba-5a93-47e8-a087-5bd8f5df3bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:34.639013 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de600aba-5a93-47e8-a087-5bd8f5df3bc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:34.641532 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de600aba-5a93-47e8-a087-5bd8f5df3bc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:34.644366 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de600aba-5a93-47e8-a087-5bd8f5df3bc4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:34.683619 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1090/2178] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:35:34 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:35:34.688855 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a29e48-41a9-4847-bfff-d9749f5ca97a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:34.699686 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a29e48-41a9-4847-bfff-d9749f5ca97a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:34.773672 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b522a-bc25-474e-982d-9a3d33a46b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:34.774347 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b522a-bc25-474e-982d-9a3d33a46b30 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:34.774619 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b522a-bc25-474e-982d-9a3d33a46b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:34.774911 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b522a-bc25-474e-982d-9a3d33a46b30 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:34.776334 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b522a-bc25-474e-982d-9a3d33a46b30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:34.778924 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b522a-bc25-474e-982d-9a3d33a46b30 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:34.805080 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1089/2179] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:35:34 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:35:34.809201 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de600aba-5a93-47e8-a087-5bd8f5df3bc4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:34.819375 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de600aba-5a93-47e8-a087-5bd8f5df3bc4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:34.827201 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8cc79-79a2-48be-a22c-312fa55781e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:34.827981 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8cc79-79a2-48be-a22c-312fa55781e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:34.828315 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8cc79-79a2-48be-a22c-312fa55781e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:34.828677 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8cc79-79a2-48be-a22c-312fa55781e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:34.829514 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8cc79-79a2-48be-a22c-312fa55781e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:34.831242 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c8cc79-79a2-48be-a22c-312fa55781e9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:34.842007 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1091/2180] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:35:34.846909 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b522a-bc25-474e-982d-9a3d33a46b30 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:34.856888 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b522a-bc25-474e-982d-9a3d33a46b30 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:34.862407 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68cd4e-fa82-4982-a503-e1329e975fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:34.863057 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68cd4e-fa82-4982-a503-e1329e975fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:34.863343 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68cd4e-fa82-4982-a503-e1329e975fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:34.863615 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68cd4e-fa82-4982-a503-e1329e975fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:34.864341 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68cd4e-fa82-4982-a503-e1329e975fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:34.866068 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68cd4e-fa82-4982-a503-e1329e975fb9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:34.876613 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1090/2181] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:35:34.880590 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8cc79-79a2-48be-a22c-312fa55781e9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:34.890777 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8cc79-79a2-48be-a22c-312fa55781e9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:34.895667 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadbf85-4ac0-4bca-89ff-8c4a48821c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:34.896541 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadbf85-4ac0-4bca-89ff-8c4a48821c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:34.896820 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadbf85-4ac0-4bca-89ff-8c4a48821c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:34.897093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadbf85-4ac0-4bca-89ff-8c4a48821c87 admin admin] PATH_INFO: `/v3/projects/f023f3a95ccd4bd98f7ec8357ce45d9f/users/8f7f361f58a84d0fa2ab7f0efd64e955/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:34.912570 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadbf85-4ac0-4bca-89ff-8c4a48821c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f023f3a95ccd4bd98f7ec8357ce45d9f, user_id=8f7f361f58a84d0fa2ab7f0efd64e955, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:34.915396 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcadbf85-4ac0-4bca-89ff-8c4a48821c87 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:34.929746 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1092/2182] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:35:34 2022] PUT /identity/v3/projects/f023f3a95ccd4bd98f7ec8357ce45d9f/users/8f7f361f58a84d0fa2ab7f0efd64e955/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:35:34.939962 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b71d5c-7b2d-4400-a6dc-5385ce692bbd None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:34.940250 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b71d5c-7b2d-4400-a6dc-5385ce692bbd None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:34.940528 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b71d5c-7b2d-4400-a6dc-5385ce692bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:34.966840 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-86b71d5c-7b2d-4400-a6dc-5385ce692bbd None None] MFA Rules not processed for user `8f7f361f58a84d0fa2ab7f0efd64e955`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:35:34.968096 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-86b71d5c-7b2d-4400-a6dc-5385ce692bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:35.031681 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1091/2183] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:35:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:35:35.043100 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadbf85-4ac0-4bca-89ff-8c4a48821c87 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:35.045064 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-dcadbf85-4ac0-4bca-89ff-8c4a48821c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:35.099265 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadbf85-4ac0-4bca-89ff-8c4a48821c87 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:35.102901 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4dd63-a4c5-4f75-af22-6f1833107f4e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8e4a7763524f4190c5cd66e27b5910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:35.103530 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4dd63-a4c5-4f75-af22-6f1833107f4e service glance] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:35.103808 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4dd63-a4c5-4f75-af22-6f1833107f4e service glance] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:35.104080 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4dd63-a4c5-4f75-af22-6f1833107f4e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:35.112826 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4dd63-a4c5-4f75-af22-6f1833107f4e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:35.114271 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4dd63-a4c5-4f75-af22-6f1833107f4e service glance] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:35.123082 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1093/2184] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:35:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:35:46.760787 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b71d5c-7b2d-4400-a6dc-5385ce692bbd None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:46.762377 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-86b71d5c-7b2d-4400-a6dc-5385ce692bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:46.854566 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b71d5c-7b2d-4400-a6dc-5385ce692bbd None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:46.859955 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568562a-20c7-44db-bccf-d3d3336d7cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:46.860821 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568562a-20c7-44db-bccf-d3d3336d7cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:46.861094 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568562a-20c7-44db-bccf-d3d3336d7cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:46.861394 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568562a-20c7-44db-bccf-d3d3336d7cd2 admin admin] PATH_INFO: `/v3/users/8372df8473a74d76bc4b51c5fbee0086` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:46.862618 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568562a-20c7-44db-bccf-d3d3336d7cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8372df8473a74d76bc4b51c5fbee0086)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:46.864556 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568562a-20c7-44db-bccf-d3d3336d7cd2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:46.922069 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3568562a-20c7-44db-bccf-d3d3336d7cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8372df8473a74d76bc4b51c5fbee0086'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:46.947006 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3568562a-20c7-44db-bccf-d3d3336d7cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8372df8473a74d76bc4b51c5fbee0086'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:46.947821 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3568562a-20c7-44db-bccf-d3d3336d7cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8372df8473a74d76bc4b51c5fbee0086'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:46.948457 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3568562a-20c7-44db-bccf-d3d3336d7cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8372df8473a74d76bc4b51c5fbee0086'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:46.956093 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3568562a-20c7-44db-bccf-d3d3336d7cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8372df8473a74d76bc4b51c5fbee0086'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:46.971159 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1092/2185] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:35:46 2022] DELETE /identity/v3/users/8372df8473a74d76bc4b51c5fbee0086 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:35:46.975924 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0626c-86e1-40a6-9631-494e77bb04b4 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:46.976436 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0626c-86e1-40a6-9631-494e77bb04b4 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:46.976639 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0626c-86e1-40a6-9631-494e77bb04b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:46.996991 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-bbd0626c-86e1-40a6-9631-494e77bb04b4 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:35:46.998247 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-bbd0626c-86e1-40a6-9631-494e77bb04b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:47.058181 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1094/2186] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:35:47.068382 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568562a-20c7-44db-bccf-d3d3336d7cd2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:47.069814 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3568562a-20c7-44db-bccf-d3d3336d7cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:47.157529 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568562a-20c7-44db-bccf-d3d3336d7cd2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:47.164925 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4afc4d-e361-4351-a5ab-9fadb899a372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:47.165626 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4afc4d-e361-4351-a5ab-9fadb899a372 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:47.165911 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4afc4d-e361-4351-a5ab-9fadb899a372 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:47.166227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4afc4d-e361-4351-a5ab-9fadb899a372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:47.176031 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4afc4d-e361-4351-a5ab-9fadb899a372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:47.177610 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4afc4d-e361-4351-a5ab-9fadb899a372 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:47.187094 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1093/2187] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:35:47.482156 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0626c-86e1-40a6-9631-494e77bb04b4 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:47.484629 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-bbd0626c-86e1-40a6-9631-494e77bb04b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:47.521584 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0626c-86e1-40a6-9631-494e77bb04b4 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:47.526568 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5652149-64ac-42d8-8028-814283dd1c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:47.527452 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5652149-64ac-42d8-8028-814283dd1c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:47.527796 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5652149-64ac-42d8-8028-814283dd1c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:47.528080 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5652149-64ac-42d8-8028-814283dd1c3e admin admin] PATH_INFO: `/v3/projects/182857ffac364ab4ab8861d3146087aa` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:47.529474 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5652149-64ac-42d8-8028-814283dd1c3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=182857ffac364ab4ab8861d3146087aa)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:47.531478 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5652149-64ac-42d8-8028-814283dd1c3e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:47.604031 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5652149-64ac-42d8-8028-814283dd1c3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '182857ffac364ab4ab8861d3146087aa', 'request_id': 'req-c5652149-64ac-42d8-8028-814283dd1c3e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:47.616833 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5652149-64ac-42d8-8028-814283dd1c3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '182857ffac364ab4ab8861d3146087aa', 'request_id': 'req-c5652149-64ac-42d8-8028-814283dd1c3e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:47.623957 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5652149-64ac-42d8-8028-814283dd1c3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '182857ffac364ab4ab8861d3146087aa', 'request_id': 'req-c5652149-64ac-42d8-8028-814283dd1c3e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:47.639382 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5652149-64ac-42d8-8028-814283dd1c3e admin admin] The token cache is being invalidate because project 182857ffac364ab4ab8861d3146087aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:35:47.639704 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5652149-64ac-42d8-8028-814283dd1c3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:47.640371 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5652149-64ac-42d8-8028-814283dd1c3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:35:47.642027 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1095/2188] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:35:47 2022] DELETE /identity/v3/projects/182857ffac364ab4ab8861d3146087aa => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:35:47.647278 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608073e7-02a9-41f2-9f9b-ea5722a3b1ea None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:47.652042 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608073e7-02a9-41f2-9f9b-ea5722a3b1ea None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:47.652428 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608073e7-02a9-41f2-9f9b-ea5722a3b1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:47.724630 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-608073e7-02a9-41f2-9f9b-ea5722a3b1ea None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:35:47.728580 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-608073e7-02a9-41f2-9f9b-ea5722a3b1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:47.839195 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1094/2189] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:35:47.848066 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9476cf-e1bb-49d9-8b75-35513c0378a2 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:47.848382 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9476cf-e1bb-49d9-8b75-35513c0378a2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:47.848636 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9476cf-e1bb-49d9-8b75-35513c0378a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:47.870796 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-eb9476cf-e1bb-49d9-8b75-35513c0378a2 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:35:47.872034 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-eb9476cf-e1bb-49d9-8b75-35513c0378a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:47.902727 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1096/2190] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:35:47.907598 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608073e7-02a9-41f2-9f9b-ea5722a3b1ea None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:47.917108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608073e7-02a9-41f2-9f9b-ea5722a3b1ea None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:47.922177 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bb855-171c-4f83-b323-c2b34e1f252f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:47.922898 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bb855-171c-4f83-b323-c2b34e1f252f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:47.923247 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bb855-171c-4f83-b323-c2b34e1f252f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:47.923588 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bb855-171c-4f83-b323-c2b34e1f252f admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:47.924318 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bb855-171c-4f83-b323-c2b34e1f252f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:35:47.924626 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bb855-171c-4f83-b323-c2b34e1f252f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:47.926282 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bb855-171c-4f83-b323-c2b34e1f252f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:47.942069 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1095/2191] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:35:47.944436 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9476cf-e1bb-49d9-8b75-35513c0378a2 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:47.955406 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9476cf-e1bb-49d9-8b75-35513c0378a2 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:47.961333 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a0f98-f7ca-448e-9406-38d1ed99d22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:47.962270 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0f98-f7ca-448e-9406-38d1ed99d22a admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:47.962621 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0f98-f7ca-448e-9406-38d1ed99d22a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:47.962973 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0f98-f7ca-448e-9406-38d1ed99d22a admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:47.964537 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a0f98-f7ca-448e-9406-38d1ed99d22a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:47.966997 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a0f98-f7ca-448e-9406-38d1ed99d22a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:47.997413 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1097/2192] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:35:47 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:35:48.001771 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bb855-171c-4f83-b323-c2b34e1f252f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:48.019543 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bb855-171c-4f83-b323-c2b34e1f252f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:48.086745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b101e0-3965-4d14-baae-522d244f5930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:48.087535 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b101e0-3965-4d14-baae-522d244f5930 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:48.087822 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b101e0-3965-4d14-baae-522d244f5930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:48.088097 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b101e0-3965-4d14-baae-522d244f5930 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:48.088919 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b101e0-3965-4d14-baae-522d244f5930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:48.090914 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b101e0-3965-4d14-baae-522d244f5930 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:48.111842 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1096/2193] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:35:48 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:35:48.117565 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a0f98-f7ca-448e-9406-38d1ed99d22a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:48.133142 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a0f98-f7ca-448e-9406-38d1ed99d22a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:48.138293 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae8354-eca6-4fbd-a8f3-42b141e4918c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:48.139057 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae8354-eca6-4fbd-a8f3-42b141e4918c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:48.139424 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae8354-eca6-4fbd-a8f3-42b141e4918c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:48.140031 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae8354-eca6-4fbd-a8f3-42b141e4918c admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:48.141005 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae8354-eca6-4fbd-a8f3-42b141e4918c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:48.143683 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae8354-eca6-4fbd-a8f3-42b141e4918c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:48.162117 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1098/2194] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:35:48.166017 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b101e0-3965-4d14-baae-522d244f5930 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:48.178587 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b101e0-3965-4d14-baae-522d244f5930 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:48.183615 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba136ff5-3d56-445a-9895-0e122377a9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:48.184340 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba136ff5-3d56-445a-9895-0e122377a9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:48.184778 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba136ff5-3d56-445a-9895-0e122377a9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:48.185051 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba136ff5-3d56-445a-9895-0e122377a9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:48.185806 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba136ff5-3d56-445a-9895-0e122377a9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:48.187440 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba136ff5-3d56-445a-9895-0e122377a9a2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:48.197618 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1097/2195] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:35:48.201777 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae8354-eca6-4fbd-a8f3-42b141e4918c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:48.214649 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae8354-eca6-4fbd-a8f3-42b141e4918c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:48.221782 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1b072-56b9-4c89-89ed-47eeda1fdc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:48.222528 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1b072-56b9-4c89-89ed-47eeda1fdc95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:48.222816 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1b072-56b9-4c89-89ed-47eeda1fdc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:48.223089 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1b072-56b9-4c89-89ed-47eeda1fdc95 admin admin] PATH_INFO: `/v3/projects/c3842ab0db9e47b49407435096f0a223/users/299705dbdd0e4cda82359be6a32faaa6/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:48.240881 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1b072-56b9-4c89-89ed-47eeda1fdc95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3842ab0db9e47b49407435096f0a223, user_id=299705dbdd0e4cda82359be6a32faaa6, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:48.243615 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1b072-56b9-4c89-89ed-47eeda1fdc95 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:48.258727 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1099/2196] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:35:48 2022] PUT /identity/v3/projects/c3842ab0db9e47b49407435096f0a223/users/299705dbdd0e4cda82359be6a32faaa6/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:35:48.270390 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f99d3-9041-4197-85b8-0ea7614bdfe4 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:48.270671 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f99d3-9041-4197-85b8-0ea7614bdfe4 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:48.270943 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f99d3-9041-4197-85b8-0ea7614bdfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:48.296752 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-1a3f99d3-9041-4197-85b8-0ea7614bdfe4 None None] MFA Rules not processed for user `299705dbdd0e4cda82359be6a32faaa6`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:35:48.297978 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-1a3f99d3-9041-4197-85b8-0ea7614bdfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:48.365658 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1098/2197] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:35:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:35:48.375864 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1b072-56b9-4c89-89ed-47eeda1fdc95 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:48.377694 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2db1b072-56b9-4c89-89ed-47eeda1fdc95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:48.440847 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1b072-56b9-4c89-89ed-47eeda1fdc95 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:48.444910 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe45753-f0e5-4b13-ac29-ab554c068dda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:48.445597 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe45753-f0e5-4b13-ac29-ab554c068dda service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:48.445883 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe45753-f0e5-4b13-ac29-ab554c068dda service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:48.446162 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe45753-f0e5-4b13-ac29-ab554c068dda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:48.456386 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe45753-f0e5-4b13-ac29-ab554c068dda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:48.457850 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe45753-f0e5-4b13-ac29-ab554c068dda service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:48.468484 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1100/2198] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:35:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:35:49.808320 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4fbc9-aee4-48e7-9a87-f590c9ed5c26 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:49.808856 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4fbc9-aee4-48e7-9a87-f590c9ed5c26 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:49.808856 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4fbc9-aee4-48e7-9a87-f590c9ed5c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:49.826327 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-e8a4fbc9-aee4-48e7-9a87-f590c9ed5c26 None None] MFA Rules not processed for user `299705dbdd0e4cda82359be6a32faaa6`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:35:49.827450 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e8a4fbc9-aee4-48e7-9a87-f590c9ed5c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:49.834327 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1099/2199] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:35:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:35:57.488005 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f5000-d437-433d-b209-dba68ebfcfff None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:57.488521 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f5000-d437-433d-b209-dba68ebfcfff None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:57.488619 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547f5000-d437-433d-b209-dba68ebfcfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:57.522700 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-547f5000-d437-433d-b209-dba68ebfcfff None None] MFA Rules not processed for user `4d22345d2e2646cc99c74a2f9692b648`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:35:57.522894 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-547f5000-d437-433d-b209-dba68ebfcfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:57.638883 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1101/2200] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Feb 16 05:35:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:35:57.652224 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4fbc9-aee4-48e7-9a87-f590c9ed5c26 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:35:57.653698 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e8a4fbc9-aee4-48e7-9a87-f590c9ed5c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:35:57.785488 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4fbc9-aee4-48e7-9a87-f590c9ed5c26 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:35:57.791130 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7c13a-ab20-4a6b-a535-13a8a2a302a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eb49cac0c94e73a70361831dd789b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:35:57.792005 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7c13a-ab20-4a6b-a535-13a8a2a302a0 service swift] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:35:57.792291 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7c13a-ab20-4a6b-a535-13a8a2a302a0 service swift] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:35:57.792569 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7c13a-ab20-4a6b-a535-13a8a2a302a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:35:57.801777 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7c13a-ab20-4a6b-a535-13a8a2a302a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:35:57.803404 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7c13a-ab20-4a6b-a535-13a8a2a302a0 service swift] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:35:57.832862 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1100/2201] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Feb 16 05:35:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:36:00.252967 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f5000-d437-433d-b209-dba68ebfcfff None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:00.254425 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-547f5000-d437-433d-b209-dba68ebfcfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:00.396850 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547f5000-d437-433d-b209-dba68ebfcfff None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:00.408715 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4f277-9f5e-43d6-a442-b2646fb9210a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:00.410100 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4f277-9f5e-43d6-a442-b2646fb9210a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:00.410562 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4f277-9f5e-43d6-a442-b2646fb9210a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:00.410985 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4f277-9f5e-43d6-a442-b2646fb9210a admin admin] PATH_INFO: `/v3/users/65045a2a88084c12aeb9133bf0162193` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:00.413136 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4f277-9f5e-43d6-a442-b2646fb9210a admin admin] RBAC: Authorizing `identity:delete_user(user_id=65045a2a88084c12aeb9133bf0162193)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:00.415959 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4f277-9f5e-43d6-a442-b2646fb9210a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:00.506899 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b0c4f277-9f5e-43d6-a442-b2646fb9210a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65045a2a88084c12aeb9133bf0162193'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:00.517922 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b0c4f277-9f5e-43d6-a442-b2646fb9210a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65045a2a88084c12aeb9133bf0162193'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:00.534583 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b0c4f277-9f5e-43d6-a442-b2646fb9210a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65045a2a88084c12aeb9133bf0162193'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:00.535629 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b0c4f277-9f5e-43d6-a442-b2646fb9210a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65045a2a88084c12aeb9133bf0162193'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:00.536240 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b0c4f277-9f5e-43d6-a442-b2646fb9210a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65045a2a88084c12aeb9133bf0162193'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:00.556271 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1102/2202] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:36:00 2022] DELETE /identity/v3/users/65045a2a88084c12aeb9133bf0162193 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:36:00.955426 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7c13a-ab20-4a6b-a535-13a8a2a302a0 service swift] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:00.974819 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7c13a-ab20-4a6b-a535-13a8a2a302a0 service swift] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:01.148990 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc092c9-6ce6-46a9-9176-2cbe1d37818a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:01.150282 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc092c9-6ce6-46a9-9176-2cbe1d37818a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:01.150712 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc092c9-6ce6-46a9-9176-2cbe1d37818a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:01.151002 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc092c9-6ce6-46a9-9176-2cbe1d37818a admin admin] PATH_INFO: `/v3/projects/1050764769f2439fae8ad76e27663aec` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:01.152307 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc092c9-6ce6-46a9-9176-2cbe1d37818a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1050764769f2439fae8ad76e27663aec)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:01.163425 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc092c9-6ce6-46a9-9176-2cbe1d37818a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:01.263484 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7dc092c9-6ce6-46a9-9176-2cbe1d37818a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1050764769f2439fae8ad76e27663aec', 'request_id': 'req-7dc092c9-6ce6-46a9-9176-2cbe1d37818a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:01.293379 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7dc092c9-6ce6-46a9-9176-2cbe1d37818a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1050764769f2439fae8ad76e27663aec', 'request_id': 'req-7dc092c9-6ce6-46a9-9176-2cbe1d37818a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:01.301803 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7dc092c9-6ce6-46a9-9176-2cbe1d37818a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1050764769f2439fae8ad76e27663aec', 'request_id': 'req-7dc092c9-6ce6-46a9-9176-2cbe1d37818a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:01.318102 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7dc092c9-6ce6-46a9-9176-2cbe1d37818a admin admin] The token cache is being invalidate because project 1050764769f2439fae8ad76e27663aec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:36:01.318536 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7dc092c9-6ce6-46a9-9176-2cbe1d37818a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:01.319326 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7dc092c9-6ce6-46a9-9176-2cbe1d37818a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:01.321417 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1101/2203] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:36:00 2022] DELETE /identity/v3/projects/1050764769f2439fae8ad76e27663aec => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:36:01.326213 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be9cd6-963b-4620-bc1d-60b0615844a9 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:01.326733 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be9cd6-963b-4620-bc1d-60b0615844a9 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:01.326733 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be9cd6-963b-4620-bc1d-60b0615844a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:01.371465 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-48be9cd6-963b-4620-bc1d-60b0615844a9 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:36:01.374118 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-48be9cd6-963b-4620-bc1d-60b0615844a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:01.503548 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1103/2204] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:36:01.511204 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c715a-74a4-4c6b-b051-ae1f71aee8f0 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:01.511494 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c715a-74a4-4c6b-b051-ae1f71aee8f0 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:01.511777 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c715a-74a4-4c6b-b051-ae1f71aee8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:01.543079 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-961c715a-74a4-4c6b-b051-ae1f71aee8f0 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:36:01.545213 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-961c715a-74a4-4c6b-b051-ae1f71aee8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:01.557037 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1102/2205] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:36:01.560709 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be9cd6-963b-4620-bc1d-60b0615844a9 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:01.575000 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be9cd6-963b-4620-bc1d-60b0615844a9 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:01.588100 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ff162-4334-4135-a31a-541a1d8024a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:01.588815 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ff162-4334-4135-a31a-541a1d8024a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:01.589093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ff162-4334-4135-a31a-541a1d8024a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:01.589398 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ff162-4334-4135-a31a-541a1d8024a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:01.590190 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ff162-4334-4135-a31a-541a1d8024a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:36:01.590501 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ff162-4334-4135-a31a-541a1d8024a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:01.592382 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ff162-4334-4135-a31a-541a1d8024a7 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:01.612127 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1104/2206] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:36:01.613518 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c715a-74a4-4c6b-b051-ae1f71aee8f0 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:01.626742 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c715a-74a4-4c6b-b051-ae1f71aee8f0 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:01.637951 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e85491-b025-48ce-a100-3dd7abc8a4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:01.638616 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e85491-b025-48ce-a100-3dd7abc8a4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:01.638899 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e85491-b025-48ce-a100-3dd7abc8a4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:01.639174 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e85491-b025-48ce-a100-3dd7abc8a4c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:01.639926 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e85491-b025-48ce-a100-3dd7abc8a4c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:01.642483 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e85491-b025-48ce-a100-3dd7abc8a4c3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:01.726021 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1103/2207] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:36:01 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:36:01.729534 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ff162-4334-4135-a31a-541a1d8024a7 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:01.755658 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ff162-4334-4135-a31a-541a1d8024a7 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:01.867100 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43981cc-dacf-4b80-84c4-46e93fc743c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:01.868194 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43981cc-dacf-4b80-84c4-46e93fc743c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:01.868520 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43981cc-dacf-4b80-84c4-46e93fc743c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:01.868806 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43981cc-dacf-4b80-84c4-46e93fc743c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:01.869552 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43981cc-dacf-4b80-84c4-46e93fc743c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:01.872034 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43981cc-dacf-4b80-84c4-46e93fc743c3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:01.926948 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1105/2208] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:36:01 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:36:01.928146 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e85491-b025-48ce-a100-3dd7abc8a4c3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:01.951705 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e85491-b025-48ce-a100-3dd7abc8a4c3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:01.968633 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e067d-d184-4567-8107-c441c60248b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:01.970326 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e067d-d184-4567-8107-c441c60248b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:01.970776 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e067d-d184-4567-8107-c441c60248b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:01.971204 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e067d-d184-4567-8107-c441c60248b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:01.972112 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e067d-d184-4567-8107-c441c60248b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:01.973963 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e067d-d184-4567-8107-c441c60248b0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:01.995573 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1104/2209] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:36:02.000796 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43981cc-dacf-4b80-84c4-46e93fc743c3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:02.015312 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43981cc-dacf-4b80-84c4-46e93fc743c3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:02.028421 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa7313-f947-4982-b6ab-7b226a75c880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:02.029627 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa7313-f947-4982-b6ab-7b226a75c880 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:02.030164 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa7313-f947-4982-b6ab-7b226a75c880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:02.030535 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa7313-f947-4982-b6ab-7b226a75c880 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:02.032844 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa7313-f947-4982-b6ab-7b226a75c880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:02.044571 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa7313-f947-4982-b6ab-7b226a75c880 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:02.071249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1106/2210] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:36:02.074519 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e067d-d184-4567-8107-c441c60248b0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:02.113067 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e067d-d184-4567-8107-c441c60248b0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:02.120125 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d4a41-1ced-49c5-aa26-d9070b380b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:02.122676 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d4a41-1ced-49c5-aa26-d9070b380b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:02.123775 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d4a41-1ced-49c5-aa26-d9070b380b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:02.124781 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d4a41-1ced-49c5-aa26-d9070b380b72 admin admin] PATH_INFO: `/v3/projects/8a63137b4af64f64bd9fa8cd0684c1e7/users/59d7008e629e45b89140a26abba0c3fb/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:02.161641 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d4a41-1ced-49c5-aa26-d9070b380b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a63137b4af64f64bd9fa8cd0684c1e7, user_id=59d7008e629e45b89140a26abba0c3fb, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:02.166841 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d4a41-1ced-49c5-aa26-d9070b380b72 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:02.186211 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1105/2211] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:36:02 2022] PUT /identity/v3/projects/8a63137b4af64f64bd9fa8cd0684c1e7/users/59d7008e629e45b89140a26abba0c3fb/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:36:02.195964 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08195f4-9d3f-4406-b8c4-f296cc9583f3 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:02.196253 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08195f4-9d3f-4406-b8c4-f296cc9583f3 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:02.197930 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08195f4-9d3f-4406-b8c4-f296cc9583f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:02.245407 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-b08195f4-9d3f-4406-b8c4-f296cc9583f3 None None] MFA Rules not processed for user `59d7008e629e45b89140a26abba0c3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:36:02.246636 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b08195f4-9d3f-4406-b8c4-f296cc9583f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:02.378226 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1107/2212] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:36:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:36:02.382816 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d4a41-1ced-49c5-aa26-d9070b380b72 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:02.497321 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d4a41-1ced-49c5-aa26-d9070b380b72 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:02.518100 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13e35b-6ee6-4d9c-8820-73e985390e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:02.519711 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13e35b-6ee6-4d9c-8820-73e985390e00 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:02.519884 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13e35b-6ee6-4d9c-8820-73e985390e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:02.520132 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13e35b-6ee6-4d9c-8820-73e985390e00 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:02.520855 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13e35b-6ee6-4d9c-8820-73e985390e00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:02.522941 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13e35b-6ee6-4d9c-8820-73e985390e00 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:02.588246 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1106/2213] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:36:02 2022] POST /identity/v3/projects => generated 371 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:36:02.588850 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08195f4-9d3f-4406-b8c4-f296cc9583f3 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:02.605997 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08195f4-9d3f-4406-b8c4-f296cc9583f3 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:02.694936 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebf501-5438-4943-9a9d-786518a6b880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:02.695965 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebf501-5438-4943-9a9d-786518a6b880 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:02.696393 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebf501-5438-4943-9a9d-786518a6b880 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:02.696688 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebf501-5438-4943-9a9d-786518a6b880 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:02.698062 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebf501-5438-4943-9a9d-786518a6b880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:02.700435 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebf501-5438-4943-9a9d-786518a6b880 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:02.738851 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13e35b-6ee6-4d9c-8820-73e985390e00 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:02.740844 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1108/2214] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:36:02 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:36:02.755669 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13e35b-6ee6-4d9c-8820-73e985390e00 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:02.762811 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd23f6-7758-4a72-9ed0-3a6d73a710b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:02.763774 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd23f6-7758-4a72-9ed0-3a6d73a710b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:02.764331 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd23f6-7758-4a72-9ed0-3a6d73a710b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:02.764812 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddd23f6-7758-4a72-9ed0-3a6d73a710b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:02.766577 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd23f6-7758-4a72-9ed0-3a6d73a710b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:02.776149 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddd23f6-7758-4a72-9ed0-3a6d73a710b0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:02.794507 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1107/2215] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:36:02.798523 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebf501-5438-4943-9a9d-786518a6b880 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:02.815494 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebf501-5438-4943-9a9d-786518a6b880 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:02.822281 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e50dd2-63bd-4671-ac03-a1edd49f4e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:02.825654 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e50dd2-63bd-4671-ac03-a1edd49f4e1a admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:02.826746 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e50dd2-63bd-4671-ac03-a1edd49f4e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:02.827244 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e50dd2-63bd-4671-ac03-a1edd49f4e1a admin admin] PATH_INFO: `/v3/projects/9950d37660b74bb68bdf8a11e91112a6/users/f1f3819298274e3193cfe59d2c4cf244/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:02.846247 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e50dd2-63bd-4671-ac03-a1edd49f4e1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9950d37660b74bb68bdf8a11e91112a6, user_id=f1f3819298274e3193cfe59d2c4cf244, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:02.849513 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e50dd2-63bd-4671-ac03-a1edd49f4e1a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:02.888933 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1109/2216] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:36:02 2022] PUT /identity/v3/projects/9950d37660b74bb68bdf8a11e91112a6/users/f1f3819298274e3193cfe59d2c4cf244/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:36:02.893432 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd23f6-7758-4a72-9ed0-3a6d73a710b0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:02.905933 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddd23f6-7758-4a72-9ed0-3a6d73a710b0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:02.996407 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51e29b-6f6b-4bcb-a646-ccac644c5cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:02.997078 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51e29b-6f6b-4bcb-a646-ccac644c5cef admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:02.997501 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51e29b-6f6b-4bcb-a646-ccac644c5cef admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:02.997955 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51e29b-6f6b-4bcb-a646-ccac644c5cef admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:02.998843 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51e29b-6f6b-4bcb-a646-ccac644c5cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:03.000672 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51e29b-6f6b-4bcb-a646-ccac644c5cef admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:03.026730 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1108/2217] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:36:03.030781 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e50dd2-63bd-4671-ac03-a1edd49f4e1a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:03.048427 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e50dd2-63bd-4671-ac03-a1edd49f4e1a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:03.065381 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ac599-f09f-4487-8cf5-b70006e82852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:03.067216 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ac599-f09f-4487-8cf5-b70006e82852 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:03.067508 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ac599-f09f-4487-8cf5-b70006e82852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:03.068274 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ac599-f09f-4487-8cf5-b70006e82852 admin admin] PATH_INFO: `/v3/projects/9950d37660b74bb68bdf8a11e91112a6/users/f1f3819298274e3193cfe59d2c4cf244/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:03.071311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ac599-f09f-4487-8cf5-b70006e82852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9950d37660b74bb68bdf8a11e91112a6, user_id=f1f3819298274e3193cfe59d2c4cf244, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:03.092509 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ac599-f09f-4487-8cf5-b70006e82852 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:03.120807 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1110/2218] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:36:03 2022] PUT /identity/v3/projects/9950d37660b74bb68bdf8a11e91112a6/users/f1f3819298274e3193cfe59d2c4cf244/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:36:03.131633 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8b63f-b53d-40e9-8aa6-77f3b35be851 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:03.131924 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8b63f-b53d-40e9-8aa6-77f3b35be851 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:03.132209 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8b63f-b53d-40e9-8aa6-77f3b35be851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:03.163305 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-21b8b63f-b53d-40e9-8aa6-77f3b35be851 None None] MFA Rules not processed for user `f1f3819298274e3193cfe59d2c4cf244`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:36:03.164808 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-21b8b63f-b53d-40e9-8aa6-77f3b35be851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:03.252641 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1109/2219] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:36:03 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:36:03.263172 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ac599-f09f-4487-8cf5-b70006e82852 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:03.265407 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a90ac599-f09f-4487-8cf5-b70006e82852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:03.339497 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ac599-f09f-4487-8cf5-b70006e82852 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:03.344283 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80e5e8-129b-4ebd-a79d-5f5097347874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:03.347786 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80e5e8-129b-4ebd-a79d-5f5097347874 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:03.348023 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80e5e8-129b-4ebd-a79d-5f5097347874 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:03.348265 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80e5e8-129b-4ebd-a79d-5f5097347874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:03.358442 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80e5e8-129b-4ebd-a79d-5f5097347874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:03.360783 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80e5e8-129b-4ebd-a79d-5f5097347874 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:03.398978 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1111/2220] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:36:03 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:36:03.503685 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8b63f-b53d-40e9-8aa6-77f3b35be851 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:03.514556 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8b63f-b53d-40e9-8aa6-77f3b35be851 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:03.521390 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce67d8a-4645-4286-b8f0-33e874f838d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:03.522560 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce67d8a-4645-4286-b8f0-33e874f838d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:03.523202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce67d8a-4645-4286-b8f0-33e874f838d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:03.523682 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce67d8a-4645-4286-b8f0-33e874f838d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:03.599340 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce67d8a-4645-4286-b8f0-33e874f838d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:03.600874 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce67d8a-4645-4286-b8f0-33e874f838d3 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:03.612618 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1110/2221] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:36:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:36:18.607852 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b998125-b744-41fe-94f7-9e18add11ee2 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:18.608376 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b998125-b744-41fe-94f7-9e18add11ee2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:18.608376 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b998125-b744-41fe-94f7-9e18add11ee2 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:18.610762 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1112/2222] 10.222.0.75 () {54 vars in 960 bytes} [Wed Feb 16 05:36:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:36:18.616201 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd3bba-58ad-44e5-9655-16f5ce20d708 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:18.616649 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd3bba-58ad-44e5-9655-16f5ce20d708 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:18.616857 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd3bba-58ad-44e5-9655-16f5ce20d708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:18.675785 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-e4cd3bba-58ad-44e5-9655-16f5ce20d708 None None] MFA Rules not processed for user `cc233f62146a49099216c6236fb2ee2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:36:18.677008 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e4cd3bba-58ad-44e5-9655-16f5ce20d708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:18.753447 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1111/2223] 10.222.0.75 () {58 vars in 1057 bytes} [Wed Feb 16 05:36:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:36:18.762091 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b998125-b744-41fe-94f7-9e18add11ee2 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:18.779183 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b998125-b744-41fe-94f7-9e18add11ee2 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:18.785389 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a24c5-d6a4-4362-976b-3bb466d8fd84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc233f62146a49099216c6236fb2ee2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:18.786041 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a24c5-d6a4-4362-976b-3bb466d8fd84 service placement] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:18.786929 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a24c5-d6a4-4362-976b-3bb466d8fd84 service placement] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:18.786929 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a24c5-d6a4-4362-976b-3bb466d8fd84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:18.788541 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-398a24c5-d6a4-4362-976b-3bb466d8fd84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:18.802534 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a24c5-d6a4-4362-976b-3bb466d8fd84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:18.804220 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a24c5-d6a4-4362-976b-3bb466d8fd84 service placement] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:18.814846 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1113/2224] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:36:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:36:20.497750 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608764f-fc4c-4433-8e9a-e4e616f6c81a None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:20.498729 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608764f-fc4c-4433-8e9a-e4e616f6c81a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:20.499116 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608764f-fc4c-4433-8e9a-e4e616f6c81a None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:20.502776 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1112/2225] 10.222.0.75 () {54 vars in 921 bytes} [Wed Feb 16 05:36:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:36:20.509106 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b1136-5a8b-42b0-ace0-80f25bbe2b86 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:20.509668 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b1136-5a8b-42b0-ace0-80f25bbe2b86 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:20.509668 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b1136-5a8b-42b0-ace0-80f25bbe2b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:20.572859 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-3d2b1136-5a8b-42b0-ace0-80f25bbe2b86 None None] MFA Rules not processed for user `6522d231532a48ad8dbc9c9e79a021dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:36:20.574522 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3d2b1136-5a8b-42b0-ace0-80f25bbe2b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:20.728987 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1114/2226] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Feb 16 05:36:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:36:20.747192 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608764f-fc4c-4433-8e9a-e4e616f6c81a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:20.750438 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7608764f-fc4c-4433-8e9a-e4e616f6c81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:20.834956 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608764f-fc4c-4433-8e9a-e4e616f6c81a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:20.838942 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02844d0-a446-4828-a61c-ec16482f16da service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8e4a7763524f4190c5cd66e27b5910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:20.839621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02844d0-a446-4828-a61c-ec16482f16da service glance] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:20.839900 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02844d0-a446-4828-a61c-ec16482f16da service glance] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:20.840167 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02844d0-a446-4828-a61c-ec16482f16da service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:20.852474 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02844d0-a446-4828-a61c-ec16482f16da service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:20.853976 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02844d0-a446-4828-a61c-ec16482f16da service glance] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:20.866867 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1113/2227] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:36:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:36:20.940312 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51613f2c-58aa-4608-b140-8e573d4446c8 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:20.940879 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51613f2c-58aa-4608-b140-8e573d4446c8 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:20.942433 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51613f2c-58aa-4608-b140-8e573d4446c8 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:20.944915 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1115/2228] 10.222.0.75 () {54 vars in 921 bytes} [Wed Feb 16 05:36:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:36:20.952165 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f90927-2075-4137-9203-154b06cea320 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:20.952458 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f90927-2075-4137-9203-154b06cea320 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:20.952781 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f90927-2075-4137-9203-154b06cea320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:20.974136 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f2f90927-2075-4137-9203-154b06cea320 None None] MFA Rules not processed for user `fd4eac62484c47988657d2a730f2d056`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:36:20.976215 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f2f90927-2075-4137-9203-154b06cea320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:21.029290 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1114/2229] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Feb 16 05:36:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:36:21.041628 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51613f2c-58aa-4608-b140-8e573d4446c8 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:21.044093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-51613f2c-58aa-4608-b140-8e573d4446c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:21.061653 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51613f2c-58aa-4608-b140-8e573d4446c8 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:21.066075 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adad5fd-0c50-4fb6-b7f6-26ab86145fa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:21.066732 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adad5fd-0c50-4fb6-b7f6-26ab86145fa3 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:21.067002 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adad5fd-0c50-4fb6-b7f6-26ab86145fa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:21.067277 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adad5fd-0c50-4fb6-b7f6-26ab86145fa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:21.075048 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adad5fd-0c50-4fb6-b7f6-26ab86145fa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:21.076607 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adad5fd-0c50-4fb6-b7f6-26ab86145fa3 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:21.085019 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1116/2230] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:36:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:36:21.180768 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984775b-31a0-4d4e-aee0-e5fa018b5ad4 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:21.181060 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984775b-31a0-4d4e-aee0-e5fa018b5ad4 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:21.181375 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984775b-31a0-4d4e-aee0-e5fa018b5ad4 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:21.183135 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1115/2231] 10.222.0.75 () {54 vars in 921 bytes} [Wed Feb 16 05:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:36:21.189291 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5219c9-696e-4248-81a9-a6e2e5315347 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:21.189573 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5219c9-696e-4248-81a9-a6e2e5315347 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:21.189843 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5219c9-696e-4248-81a9-a6e2e5315347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:21.208410 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-7e5219c9-696e-4248-81a9-a6e2e5315347 None None] MFA Rules not processed for user `6522d231532a48ad8dbc9c9e79a021dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:36:21.209788 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7e5219c9-696e-4248-81a9-a6e2e5315347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:21.219595 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1117/2232] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Feb 16 05:36:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:36:21.230007 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984775b-31a0-4d4e-aee0-e5fa018b5ad4 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:21.241279 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984775b-31a0-4d4e-aee0-e5fa018b5ad4 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:21.244833 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c68b0-701b-4bff-8076-1d4c5ed18927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:21.245506 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c68b0-701b-4bff-8076-1d4c5ed18927 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:21.245783 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c68b0-701b-4bff-8076-1d4c5ed18927 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:21.246051 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c68b0-701b-4bff-8076-1d4c5ed18927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:21.256653 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c68b0-701b-4bff-8076-1d4c5ed18927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:21.258116 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c68b0-701b-4bff-8076-1d4c5ed18927 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:21.269082 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1116/2233] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:36:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:36:22.257323 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9904cd-c7a9-4176-8c9a-c08b11b77753 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:22.257775 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9904cd-c7a9-4176-8c9a-c08b11b77753 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:22.257903 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9904cd-c7a9-4176-8c9a-c08b11b77753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:22.276032 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-6b9904cd-c7a9-4176-8c9a-c08b11b77753 None None] MFA Rules not processed for user `4d22345d2e2646cc99c74a2f9692b648`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:36:22.277325 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6b9904cd-c7a9-4176-8c9a-c08b11b77753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:22.331194 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1118/2234] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Feb 16 05:36:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:36:22.343973 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c68b0-701b-4bff-8076-1d4c5ed18927 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:22.345414 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b94c68b0-701b-4bff-8076-1d4c5ed18927 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:22.413748 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c68b0-701b-4bff-8076-1d4c5ed18927 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:22.418574 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40305c71-15ef-4bc4-bdf9-8a3e082343f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eb49cac0c94e73a70361831dd789b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:22.419456 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40305c71-15ef-4bc4-bdf9-8a3e082343f2 service swift] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:22.419733 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40305c71-15ef-4bc4-bdf9-8a3e082343f2 service swift] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:22.420002 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40305c71-15ef-4bc4-bdf9-8a3e082343f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:22.427960 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40305c71-15ef-4bc4-bdf9-8a3e082343f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:22.429597 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40305c71-15ef-4bc4-bdf9-8a3e082343f2 service swift] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:22.437579 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1117/2235] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Feb 16 05:36:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:36:23.002154 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c9a5f-f2cb-4a5d-870a-324cccf88629 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:23.002731 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c9a5f-f2cb-4a5d-870a-324cccf88629 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:23.003169 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c9a5f-f2cb-4a5d-870a-324cccf88629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:23.036864 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-b46c9a5f-f2cb-4a5d-870a-324cccf88629 None None] MFA Rules not processed for user `4d22345d2e2646cc99c74a2f9692b648`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:36:23.039120 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b46c9a5f-f2cb-4a5d-870a-324cccf88629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:23.051417 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1119/2236] 10.222.0.75 () {58 vars in 967 bytes} [Wed Feb 16 05:36:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:36:23.068775 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40305c71-15ef-4bc4-bdf9-8a3e082343f2 service swift] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:23.091647 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40305c71-15ef-4bc4-bdf9-8a3e082343f2 service swift] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:23.102464 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78b43a-dfe6-42b7-a0f2-098f84169fb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eb49cac0c94e73a70361831dd789b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:23.103119 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78b43a-dfe6-42b7-a0f2-098f84169fb5 service swift] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:23.103399 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78b43a-dfe6-42b7-a0f2-098f84169fb5 service swift] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:23.103684 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78b43a-dfe6-42b7-a0f2-098f84169fb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:23.115745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78b43a-dfe6-42b7-a0f2-098f84169fb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:23.117687 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78b43a-dfe6-42b7-a0f2-098f84169fb5 service swift] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:23.133101 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1118/2237] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Feb 16 05:36:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:36:23.322483 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108049b-76f4-4a36-bf1a-e028bbfd4bba None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:23.322944 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108049b-76f4-4a36-bf1a-e028bbfd4bba None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:23.323041 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108049b-76f4-4a36-bf1a-e028bbfd4bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:23.369084 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0108049b-76f4-4a36-bf1a-e028bbfd4bba None None] MFA Rules not processed for user `4d22345d2e2646cc99c74a2f9692b648`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:36:23.370307 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0108049b-76f4-4a36-bf1a-e028bbfd4bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:23.386733 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1120/2238] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Feb 16 05:36:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:36:23.399944 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78b43a-dfe6-42b7-a0f2-098f84169fb5 service swift] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:23.419957 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78b43a-dfe6-42b7-a0f2-098f84169fb5 service swift] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:23.424847 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf081174-93e3-4947-ae4e-4673e1cdd844 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eb49cac0c94e73a70361831dd789b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:23.425507 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf081174-93e3-4947-ae4e-4673e1cdd844 service swift] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:23.425786 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf081174-93e3-4947-ae4e-4673e1cdd844 service swift] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:23.426058 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf081174-93e3-4947-ae4e-4673e1cdd844 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:23.433871 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf081174-93e3-4947-ae4e-4673e1cdd844 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:23.435446 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf081174-93e3-4947-ae4e-4673e1cdd844 service swift] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:23.443803 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1119/2239] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Feb 16 05:36:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:36:23.757757 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c14be-1ee2-4768-8d36-fd3ae0f611ca None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:23.758046 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c14be-1ee2-4768-8d36-fd3ae0f611ca None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:23.758324 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c14be-1ee2-4768-8d36-fd3ae0f611ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:23.776137 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-7e9c14be-1ee2-4768-8d36-fd3ae0f611ca None None] MFA Rules not processed for user `4d22345d2e2646cc99c74a2f9692b648`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:36:23.777365 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7e9c14be-1ee2-4768-8d36-fd3ae0f611ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:23.786161 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1121/2240] 10.222.0.75 () {58 vars in 967 bytes} [Wed Feb 16 05:36:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:36:23.799041 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf081174-93e3-4947-ae4e-4673e1cdd844 service swift] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:23.809407 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf081174-93e3-4947-ae4e-4673e1cdd844 service swift] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:23.814442 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332ac8c-8858-4eb8-ab26-ba3bafcbe066 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eb49cac0c94e73a70361831dd789b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:23.815067 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332ac8c-8858-4eb8-ab26-ba3bafcbe066 service swift] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:23.815346 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332ac8c-8858-4eb8-ab26-ba3bafcbe066 service swift] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:23.815618 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332ac8c-8858-4eb8-ab26-ba3bafcbe066 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:23.823612 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332ac8c-8858-4eb8-ab26-ba3bafcbe066 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:23.825190 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332ac8c-8858-4eb8-ab26-ba3bafcbe066 service swift] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:23.833491 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1120/2241] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Feb 16 05:36:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:36:24.153798 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c14be-1ee2-4768-8d36-fd3ae0f611ca None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:24.155240 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7e9c14be-1ee2-4768-8d36-fd3ae0f611ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:24.270813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c14be-1ee2-4768-8d36-fd3ae0f611ca None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:24.275511 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e4e32-e948-441c-9508-cb11a869b672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:24.276367 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e4e32-e948-441c-9508-cb11a869b672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:24.276643 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e4e32-e948-441c-9508-cb11a869b672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:24.276913 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e4e32-e948-441c-9508-cb11a869b672 admin admin] PATH_INFO: `/v3/users/8f7f361f58a84d0fa2ab7f0efd64e955` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:24.278156 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e4e32-e948-441c-9508-cb11a869b672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f7f361f58a84d0fa2ab7f0efd64e955)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:24.280189 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e4e32-e948-441c-9508-cb11a869b672 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:24.342943 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8c3e4e32-e948-441c-9508-cb11a869b672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f7f361f58a84d0fa2ab7f0efd64e955'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:24.352315 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8c3e4e32-e948-441c-9508-cb11a869b672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f7f361f58a84d0fa2ab7f0efd64e955'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:24.373131 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8c3e4e32-e948-441c-9508-cb11a869b672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f7f361f58a84d0fa2ab7f0efd64e955'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:24.374321 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8c3e4e32-e948-441c-9508-cb11a869b672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f7f361f58a84d0fa2ab7f0efd64e955'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:24.375755 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8c3e4e32-e948-441c-9508-cb11a869b672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f7f361f58a84d0fa2ab7f0efd64e955'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:24.390721 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1122/2242] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:36:24 2022] DELETE /identity/v3/users/8f7f361f58a84d0fa2ab7f0efd64e955 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:36:24.395156 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07d911-9bcc-4fb6-bf59-0ffc33527ff4 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:24.395515 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07d911-9bcc-4fb6-bf59-0ffc33527ff4 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:24.395859 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07d911-9bcc-4fb6-bf59-0ffc33527ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:24.413099 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-7f07d911-9bcc-4fb6-bf59-0ffc33527ff4 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:36:24.414416 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7f07d911-9bcc-4fb6-bf59-0ffc33527ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:24.476365 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1121/2243] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:36:24.486730 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e4e32-e948-441c-9508-cb11a869b672 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:24.488286 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8c3e4e32-e948-441c-9508-cb11a869b672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:24.546010 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e4e32-e948-441c-9508-cb11a869b672 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:24.550131 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92188801-3da4-4cbc-be51-dbc61c9a2d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:24.550771 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92188801-3da4-4cbc-be51-dbc61c9a2d6f service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:24.551053 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92188801-3da4-4cbc-be51-dbc61c9a2d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:24.551329 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92188801-3da4-4cbc-be51-dbc61c9a2d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:24.560869 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92188801-3da4-4cbc-be51-dbc61c9a2d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:24.562890 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92188801-3da4-4cbc-be51-dbc61c9a2d6f service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:24.572761 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1123/2244] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:36:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:36:24.873132 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07d911-9bcc-4fb6-bf59-0ffc33527ff4 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:24.875288 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7f07d911-9bcc-4fb6-bf59-0ffc33527ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:24.888439 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07d911-9bcc-4fb6-bf59-0ffc33527ff4 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:24.898925 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e1279-220f-4223-8e94-12d8004cce60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:24.899791 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e1279-220f-4223-8e94-12d8004cce60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:24.900071 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e1279-220f-4223-8e94-12d8004cce60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:24.900342 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e1279-220f-4223-8e94-12d8004cce60 admin admin] PATH_INFO: `/v3/projects/f023f3a95ccd4bd98f7ec8357ce45d9f` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:24.901579 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e1279-220f-4223-8e94-12d8004cce60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f023f3a95ccd4bd98f7ec8357ce45d9f)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:24.903550 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e1279-220f-4223-8e94-12d8004cce60 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:24.950309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-148e1279-220f-4223-8e94-12d8004cce60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f023f3a95ccd4bd98f7ec8357ce45d9f', 'request_id': 'req-148e1279-220f-4223-8e94-12d8004cce60'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:24.958237 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-148e1279-220f-4223-8e94-12d8004cce60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f023f3a95ccd4bd98f7ec8357ce45d9f', 'request_id': 'req-148e1279-220f-4223-8e94-12d8004cce60'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:24.963513 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-148e1279-220f-4223-8e94-12d8004cce60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f023f3a95ccd4bd98f7ec8357ce45d9f', 'request_id': 'req-148e1279-220f-4223-8e94-12d8004cce60'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:24.974879 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-148e1279-220f-4223-8e94-12d8004cce60 admin admin] The token cache is being invalidate because project f023f3a95ccd4bd98f7ec8357ce45d9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:36:24.975160 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-148e1279-220f-4223-8e94-12d8004cce60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:24.975783 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-148e1279-220f-4223-8e94-12d8004cce60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:24.977336 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1122/2245] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:36:24 2022] DELETE /identity/v3/projects/f023f3a95ccd4bd98f7ec8357ce45d9f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:36:24.983443 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1761e2f-bf27-4ccb-92fa-9de6861c7e85 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:24.984399 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1761e2f-bf27-4ccb-92fa-9de6861c7e85 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:24.984679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1761e2f-bf27-4ccb-92fa-9de6861c7e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:25.001698 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d1761e2f-bf27-4ccb-92fa-9de6861c7e85 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:36:25.002882 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d1761e2f-bf27-4ccb-92fa-9de6861c7e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:25.059937 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1124/2246] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:36:25.067516 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83173af-465f-40c0-bb31-66d4540273a1 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:25.067801 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83173af-465f-40c0-bb31-66d4540273a1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:25.068106 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83173af-465f-40c0-bb31-66d4540273a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:25.086718 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f83173af-465f-40c0-bb31-66d4540273a1 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:36:25.087904 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f83173af-465f-40c0-bb31-66d4540273a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:25.102370 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1123/2247] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:36:25.106635 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1761e2f-bf27-4ccb-92fa-9de6861c7e85 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:25.118041 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1761e2f-bf27-4ccb-92fa-9de6861c7e85 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:25.122722 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75b27f-2061-4efe-8af6-df47b7e0d82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:25.123458 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75b27f-2061-4efe-8af6-df47b7e0d82f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:25.123737 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75b27f-2061-4efe-8af6-df47b7e0d82f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:25.124006 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75b27f-2061-4efe-8af6-df47b7e0d82f admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:25.125374 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75b27f-2061-4efe-8af6-df47b7e0d82f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:36:25.125701 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75b27f-2061-4efe-8af6-df47b7e0d82f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:25.127447 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75b27f-2061-4efe-8af6-df47b7e0d82f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:25.141372 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1125/2248] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:36:25.145783 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83173af-465f-40c0-bb31-66d4540273a1 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:25.154867 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83173af-465f-40c0-bb31-66d4540273a1 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:25.159658 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ddcae-d270-4fe6-a754-0af0b78c6f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:25.160289 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ddcae-d270-4fe6-a754-0af0b78c6f9e admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:25.160567 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ddcae-d270-4fe6-a754-0af0b78c6f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:25.160842 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ddcae-d270-4fe6-a754-0af0b78c6f9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:25.161586 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ddcae-d270-4fe6-a754-0af0b78c6f9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:25.163480 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ddcae-d270-4fe6-a754-0af0b78c6f9e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:25.191877 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1124/2249] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:36:25 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:36:25.195959 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75b27f-2061-4efe-8af6-df47b7e0d82f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:25.206313 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75b27f-2061-4efe-8af6-df47b7e0d82f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:25.263135 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193137c5-93fd-45d2-91ed-9aeabebe56ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:25.263795 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193137c5-93fd-45d2-91ed-9aeabebe56ea admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:25.264070 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193137c5-93fd-45d2-91ed-9aeabebe56ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:25.264340 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193137c5-93fd-45d2-91ed-9aeabebe56ea admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:25.265590 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193137c5-93fd-45d2-91ed-9aeabebe56ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:25.267502 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193137c5-93fd-45d2-91ed-9aeabebe56ea admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:25.293083 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1126/2250] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:36:25 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:36:25.294764 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ddcae-d270-4fe6-a754-0af0b78c6f9e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:25.319877 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ddcae-d270-4fe6-a754-0af0b78c6f9e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:25.325605 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83ca8c-b8e1-4829-9412-47add0d5159a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:25.326271 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83ca8c-b8e1-4829-9412-47add0d5159a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:25.326549 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83ca8c-b8e1-4829-9412-47add0d5159a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:25.326820 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83ca8c-b8e1-4829-9412-47add0d5159a admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:25.327603 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83ca8c-b8e1-4829-9412-47add0d5159a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:25.329371 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83ca8c-b8e1-4829-9412-47add0d5159a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:25.342154 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1125/2251] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:36:25.346105 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193137c5-93fd-45d2-91ed-9aeabebe56ea admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:25.357417 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193137c5-93fd-45d2-91ed-9aeabebe56ea admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:25.362949 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd24886-44b3-49b9-bff7-9317e76a7fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:25.363417 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd24886-44b3-49b9-bff7-9317e76a7fac admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:25.363702 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd24886-44b3-49b9-bff7-9317e76a7fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:25.363980 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd24886-44b3-49b9-bff7-9317e76a7fac admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:25.364714 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd24886-44b3-49b9-bff7-9317e76a7fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:25.366344 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd24886-44b3-49b9-bff7-9317e76a7fac admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:25.378819 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1127/2252] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:36:25.382811 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83ca8c-b8e1-4829-9412-47add0d5159a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:25.396029 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83ca8c-b8e1-4829-9412-47add0d5159a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:25.402525 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71123a90-0175-4647-93e7-3d992d19e7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:25.403366 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71123a90-0175-4647-93e7-3d992d19e7e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:25.403802 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71123a90-0175-4647-93e7-3d992d19e7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:25.404199 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71123a90-0175-4647-93e7-3d992d19e7e1 admin admin] PATH_INFO: `/v3/projects/c478141f5b76412a97a460b217fc2beb/users/cd4aea160f9947dd945f303d5b6cbd81/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:25.423214 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71123a90-0175-4647-93e7-3d992d19e7e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c478141f5b76412a97a460b217fc2beb, user_id=cd4aea160f9947dd945f303d5b6cbd81, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:25.426144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71123a90-0175-4647-93e7-3d992d19e7e1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:25.449602 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1126/2253] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:36:25 2022] PUT /identity/v3/projects/c478141f5b76412a97a460b217fc2beb/users/cd4aea160f9947dd945f303d5b6cbd81/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:36:25.460283 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db521e-0381-4c4b-9833-cac5c76e812c None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:25.460567 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db521e-0381-4c4b-9833-cac5c76e812c None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:25.461011 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db521e-0381-4c4b-9833-cac5c76e812c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:25.487481 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-a9db521e-0381-4c4b-9833-cac5c76e812c None None] MFA Rules not processed for user `cd4aea160f9947dd945f303d5b6cbd81`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:36:25.488674 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a9db521e-0381-4c4b-9833-cac5c76e812c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:25.550653 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1128/2254] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:36:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:36:25.560668 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71123a90-0175-4647-93e7-3d992d19e7e1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:25.562377 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-71123a90-0175-4647-93e7-3d992d19e7e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:25.639394 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71123a90-0175-4647-93e7-3d992d19e7e1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:25.643689 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0876f-acce-490b-84dd-e2ca6af27047 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:25.644317 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0876f-acce-490b-84dd-e2ca6af27047 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:25.644593 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0876f-acce-490b-84dd-e2ca6af27047 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:25.644862 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0876f-acce-490b-84dd-e2ca6af27047 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:25.652935 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0876f-acce-490b-84dd-e2ca6af27047 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:25.654425 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0876f-acce-490b-84dd-e2ca6af27047 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:25.662847 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1127/2255] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:36:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:36:25.689465 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db521e-0381-4c4b-9833-cac5c76e812c None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:25.754971 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db521e-0381-4c4b-9833-cac5c76e812c None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:25.760300 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17469a6-1cd8-4c47-8306-b294f48652e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:25.761331 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17469a6-1cd8-4c47-8306-b294f48652e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:25.761619 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17469a6-1cd8-4c47-8306-b294f48652e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:25.761898 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17469a6-1cd8-4c47-8306-b294f48652e1 admin admin] PATH_INFO: `/v3/users/cd4aea160f9947dd945f303d5b6cbd81` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:25.763186 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17469a6-1cd8-4c47-8306-b294f48652e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd4aea160f9947dd945f303d5b6cbd81)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:25.765661 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17469a6-1cd8-4c47-8306-b294f48652e1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:25.810068 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-a17469a6-1cd8-4c47-8306-b294f48652e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd4aea160f9947dd945f303d5b6cbd81'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:25.817132 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-a17469a6-1cd8-4c47-8306-b294f48652e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd4aea160f9947dd945f303d5b6cbd81'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:25.828793 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-a17469a6-1cd8-4c47-8306-b294f48652e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd4aea160f9947dd945f303d5b6cbd81'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:25.829485 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-a17469a6-1cd8-4c47-8306-b294f48652e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd4aea160f9947dd945f303d5b6cbd81'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:25.830090 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-a17469a6-1cd8-4c47-8306-b294f48652e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd4aea160f9947dd945f303d5b6cbd81'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:25.842437 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1129/2256] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:36:25 2022] DELETE /identity/v3/users/cd4aea160f9947dd945f303d5b6cbd81 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:36:25.847504 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8275f4-0bf1-47c3-aad6-f4f6e7dc595d None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:25.847794 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8275f4-0bf1-47c3-aad6-f4f6e7dc595d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:25.848069 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8275f4-0bf1-47c3-aad6-f4f6e7dc595d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:25.865518 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-8f8275f4-0bf1-47c3-aad6-f4f6e7dc595d None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:36:25.866699 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8f8275f4-0bf1-47c3-aad6-f4f6e7dc595d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:25.888138 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17469a6-1cd8-4c47-8306-b294f48652e1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:25.889551 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a17469a6-1cd8-4c47-8306-b294f48652e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:25.927234 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1128/2257] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:36:25.937133 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8275f4-0bf1-47c3-aad6-f4f6e7dc595d None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:25.938516 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8f8275f4-0bf1-47c3-aad6-f4f6e7dc595d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:25.954085 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17469a6-1cd8-4c47-8306-b294f48652e1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:25.958714 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c3e37-6f82-484e-843f-4af17f7a1e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:25.959567 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c3e37-6f82-484e-843f-4af17f7a1e76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:25.959847 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c3e37-6f82-484e-843f-4af17f7a1e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:25.960117 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c3e37-6f82-484e-843f-4af17f7a1e76 admin admin] PATH_INFO: `/v3/users/299705dbdd0e4cda82359be6a32faaa6` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:25.961333 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c3e37-6f82-484e-843f-4af17f7a1e76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=299705dbdd0e4cda82359be6a32faaa6)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:25.963250 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c3e37-6f82-484e-843f-4af17f7a1e76 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:25.992158 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8275f4-0bf1-47c3-aad6-f4f6e7dc595d None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:25.996339 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62cb71-1269-40ca-b544-6619919410d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:25.996982 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62cb71-1269-40ca-b544-6619919410d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:25.997282 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62cb71-1269-40ca-b544-6619919410d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:25.997576 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62cb71-1269-40ca-b544-6619919410d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:26.006682 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62cb71-1269-40ca-b544-6619919410d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:26.007788 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b04c3e37-6f82-484e-843f-4af17f7a1e76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '299705dbdd0e4cda82359be6a32faaa6'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:26.008062 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62cb71-1269-40ca-b544-6619919410d9 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:26.014330 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b04c3e37-6f82-484e-843f-4af17f7a1e76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '299705dbdd0e4cda82359be6a32faaa6'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:26.017821 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1129/2258] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:36:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:36:26.026766 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b04c3e37-6f82-484e-843f-4af17f7a1e76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '299705dbdd0e4cda82359be6a32faaa6'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:26.027461 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b04c3e37-6f82-484e-843f-4af17f7a1e76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '299705dbdd0e4cda82359be6a32faaa6'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:26.028065 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b04c3e37-6f82-484e-843f-4af17f7a1e76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '299705dbdd0e4cda82359be6a32faaa6'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:26.041651 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1130/2259] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:36:25 2022] DELETE /identity/v3/users/299705dbdd0e4cda82359be6a32faaa6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:36:26.046556 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bf337-d2cd-4d27-87f4-09b0a7c8273e None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:26.046896 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bf337-d2cd-4d27-87f4-09b0a7c8273e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:26.047173 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bf337-d2cd-4d27-87f4-09b0a7c8273e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:26.064130 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-715bf337-d2cd-4d27-87f4-09b0a7c8273e None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:36:26.065511 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-715bf337-d2cd-4d27-87f4-09b0a7c8273e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:26.129454 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1130/2260] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:36:26.139069 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c3e37-6f82-484e-843f-4af17f7a1e76 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:26.141434 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b04c3e37-6f82-484e-843f-4af17f7a1e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:26.200304 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c3e37-6f82-484e-843f-4af17f7a1e76 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:26.204070 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101de61-84fb-4392-93eb-891743ede815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:26.205315 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101de61-84fb-4392-93eb-891743ede815 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:26.205557 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101de61-84fb-4392-93eb-891743ede815 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:26.205845 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101de61-84fb-4392-93eb-891743ede815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:26.214881 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101de61-84fb-4392-93eb-891743ede815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:26.216297 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101de61-84fb-4392-93eb-891743ede815 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:26.226018 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1131/2261] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:36:26.327014 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bf337-d2cd-4d27-87f4-09b0a7c8273e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:26.329089 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-715bf337-d2cd-4d27-87f4-09b0a7c8273e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:26.341971 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bf337-d2cd-4d27-87f4-09b0a7c8273e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:26.352461 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d47ee-5380-436b-9fde-d855733b8e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:26.353345 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d47ee-5380-436b-9fde-d855733b8e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:26.353624 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d47ee-5380-436b-9fde-d855733b8e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:26.353891 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d47ee-5380-436b-9fde-d855733b8e22 admin admin] PATH_INFO: `/v3/projects/c478141f5b76412a97a460b217fc2beb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:26.361757 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d47ee-5380-436b-9fde-d855733b8e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c478141f5b76412a97a460b217fc2beb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:26.361757 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d47ee-5380-436b-9fde-d855733b8e22 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:26.428190 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-297d47ee-5380-436b-9fde-d855733b8e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c478141f5b76412a97a460b217fc2beb', 'request_id': 'req-297d47ee-5380-436b-9fde-d855733b8e22'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:26.441177 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-297d47ee-5380-436b-9fde-d855733b8e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c478141f5b76412a97a460b217fc2beb', 'request_id': 'req-297d47ee-5380-436b-9fde-d855733b8e22'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:26.446448 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101de61-84fb-4392-93eb-891743ede815 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:26.448430 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e101de61-84fb-4392-93eb-891743ede815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:26.453982 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-297d47ee-5380-436b-9fde-d855733b8e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c478141f5b76412a97a460b217fc2beb', 'request_id': 'req-297d47ee-5380-436b-9fde-d855733b8e22'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:26.462095 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101de61-84fb-4392-93eb-891743ede815 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:26.471966 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-297d47ee-5380-436b-9fde-d855733b8e22 admin admin] The token cache is being invalidate because project c478141f5b76412a97a460b217fc2beb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:36:26.472309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-297d47ee-5380-436b-9fde-d855733b8e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:26.472962 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-297d47ee-5380-436b-9fde-d855733b8e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:26.474975 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1131/2262] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:36:26 2022] DELETE /identity/v3/projects/c478141f5b76412a97a460b217fc2beb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:36:26.563810 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8117ea-29bb-4f24-ae23-7ba2291ca20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:26.567428 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8117ea-29bb-4f24-ae23-7ba2291ca20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:26.567745 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8117ea-29bb-4f24-ae23-7ba2291ca20b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:26.567980 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8117ea-29bb-4f24-ae23-7ba2291ca20b admin admin] PATH_INFO: `/v3/projects/c3842ab0db9e47b49407435096f0a223` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:26.570323 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8117ea-29bb-4f24-ae23-7ba2291ca20b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3842ab0db9e47b49407435096f0a223)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:26.572530 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8117ea-29bb-4f24-ae23-7ba2291ca20b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:26.645546 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ae8117ea-29bb-4f24-ae23-7ba2291ca20b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3842ab0db9e47b49407435096f0a223', 'request_id': 'req-ae8117ea-29bb-4f24-ae23-7ba2291ca20b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:26.651872 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ae8117ea-29bb-4f24-ae23-7ba2291ca20b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3842ab0db9e47b49407435096f0a223', 'request_id': 'req-ae8117ea-29bb-4f24-ae23-7ba2291ca20b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:26.659542 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ae8117ea-29bb-4f24-ae23-7ba2291ca20b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3842ab0db9e47b49407435096f0a223', 'request_id': 'req-ae8117ea-29bb-4f24-ae23-7ba2291ca20b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:26.673293 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ae8117ea-29bb-4f24-ae23-7ba2291ca20b admin admin] The token cache is being invalidate because project c3842ab0db9e47b49407435096f0a223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:36:26.674031 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ae8117ea-29bb-4f24-ae23-7ba2291ca20b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:26.674484 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ae8117ea-29bb-4f24-ae23-7ba2291ca20b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:26.675748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1132/2263] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:36:26 2022] DELETE /identity/v3/projects/c3842ab0db9e47b49407435096f0a223 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:36:45.164344 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16c8fd-9293-4206-ba57-b6accdbcebf5 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:45.164877 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16c8fd-9293-4206-ba57-b6accdbcebf5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:45.165200 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16c8fd-9293-4206-ba57-b6accdbcebf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:45.184383 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-2a16c8fd-9293-4206-ba57-b6accdbcebf5 None None] MFA Rules not processed for user `4d22345d2e2646cc99c74a2f9692b648`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:36:45.185729 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2a16c8fd-9293-4206-ba57-b6accdbcebf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:45.243599 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1132/2264] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Feb 16 05:36:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:36:45.257374 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8117ea-29bb-4f24-ae23-7ba2291ca20b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:45.258800 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ae8117ea-29bb-4f24-ae23-7ba2291ca20b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:45.339517 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8117ea-29bb-4f24-ae23-7ba2291ca20b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:45.345645 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f628d-4ca4-4901-8d0e-100d2d5d55fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eb49cac0c94e73a70361831dd789b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:45.346231 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f628d-4ca4-4901-8d0e-100d2d5d55fc service swift] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:45.346515 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f628d-4ca4-4901-8d0e-100d2d5d55fc service swift] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:45.346791 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f628d-4ca4-4901-8d0e-100d2d5d55fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:45.355051 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f628d-4ca4-4901-8d0e-100d2d5d55fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:45.356690 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f628d-4ca4-4901-8d0e-100d2d5d55fc service swift] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:45.365538 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1133/2265] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Feb 16 05:36:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:36:59.269505 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16c8fd-9293-4206-ba57-b6accdbcebf5 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:59.271421 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2a16c8fd-9293-4206-ba57-b6accdbcebf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:59.337386 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16c8fd-9293-4206-ba57-b6accdbcebf5 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:59.341873 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5ff8b-3089-49f3-b3c0-459d0ae333d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:59.343263 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5ff8b-3089-49f3-b3c0-459d0ae333d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:59.343547 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5ff8b-3089-49f3-b3c0-459d0ae333d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:59.343821 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5ff8b-3089-49f3-b3c0-459d0ae333d0 admin admin] PATH_INFO: `/v3/users/59d7008e629e45b89140a26abba0c3fb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:59.345006 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5ff8b-3089-49f3-b3c0-459d0ae333d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59d7008e629e45b89140a26abba0c3fb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:59.346968 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5ff8b-3089-49f3-b3c0-459d0ae333d0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:59.391017 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-28e5ff8b-3089-49f3-b3c0-459d0ae333d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59d7008e629e45b89140a26abba0c3fb'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:59.402643 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-28e5ff8b-3089-49f3-b3c0-459d0ae333d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59d7008e629e45b89140a26abba0c3fb'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:59.403383 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-28e5ff8b-3089-49f3-b3c0-459d0ae333d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59d7008e629e45b89140a26abba0c3fb'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:59.403991 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-28e5ff8b-3089-49f3-b3c0-459d0ae333d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59d7008e629e45b89140a26abba0c3fb'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:59.412984 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-28e5ff8b-3089-49f3-b3c0-459d0ae333d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59d7008e629e45b89140a26abba0c3fb'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:36:59.426380 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1133/2266] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:36:59 2022] DELETE /identity/v3/users/59d7008e629e45b89140a26abba0c3fb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:36:59.430416 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd270962-4a84-453a-b754-88ee8210b4a0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:59.430845 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd270962-4a84-453a-b754-88ee8210b4a0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:59.430971 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd270962-4a84-453a-b754-88ee8210b4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:59.447452 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-fd270962-4a84-453a-b754-88ee8210b4a0 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:36:59.448657 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-fd270962-4a84-453a-b754-88ee8210b4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:59.507152 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1134/2267] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:36:59.517174 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5ff8b-3089-49f3-b3c0-459d0ae333d0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:59.518647 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-28e5ff8b-3089-49f3-b3c0-459d0ae333d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:59.573028 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5ff8b-3089-49f3-b3c0-459d0ae333d0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:59.576735 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e85665-7023-43bf-86d8-066ac4bd26a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:59.577945 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e85665-7023-43bf-86d8-066ac4bd26a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:59.578230 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e85665-7023-43bf-86d8-066ac4bd26a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:59.578520 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e85665-7023-43bf-86d8-066ac4bd26a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:59.587890 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e85665-7023-43bf-86d8-066ac4bd26a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:59.589945 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e85665-7023-43bf-86d8-066ac4bd26a0 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:59.599559 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1134/2268] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:36:59.916134 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd270962-4a84-453a-b754-88ee8210b4a0 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:36:59.917604 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-fd270962-4a84-453a-b754-88ee8210b4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:36:59.931933 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd270962-4a84-453a-b754-88ee8210b4a0 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:36:59.937728 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ae441-00a2-483a-8501-3bd65d0ee0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:36:59.939494 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ae441-00a2-483a-8501-3bd65d0ee0d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:36:59.940009 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ae441-00a2-483a-8501-3bd65d0ee0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:36:59.940453 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ae441-00a2-483a-8501-3bd65d0ee0d4 admin admin] PATH_INFO: `/v3/projects/8a63137b4af64f64bd9fa8cd0684c1e7` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:36:59.942409 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ae441-00a2-483a-8501-3bd65d0ee0d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a63137b4af64f64bd9fa8cd0684c1e7)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:36:59.944651 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ae441-00a2-483a-8501-3bd65d0ee0d4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:36:59.996081 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-713ae441-00a2-483a-8501-3bd65d0ee0d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a63137b4af64f64bd9fa8cd0684c1e7', 'request_id': 'req-713ae441-00a2-483a-8501-3bd65d0ee0d4'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:00.005095 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-713ae441-00a2-483a-8501-3bd65d0ee0d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a63137b4af64f64bd9fa8cd0684c1e7', 'request_id': 'req-713ae441-00a2-483a-8501-3bd65d0ee0d4'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:00.010964 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-713ae441-00a2-483a-8501-3bd65d0ee0d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a63137b4af64f64bd9fa8cd0684c1e7', 'request_id': 'req-713ae441-00a2-483a-8501-3bd65d0ee0d4'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:00.024874 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-713ae441-00a2-483a-8501-3bd65d0ee0d4 admin admin] The token cache is being invalidate because project 8a63137b4af64f64bd9fa8cd0684c1e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:37:00.025286 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-713ae441-00a2-483a-8501-3bd65d0ee0d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:00.025951 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-713ae441-00a2-483a-8501-3bd65d0ee0d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:00.027507 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1135/2269] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:36:59 2022] DELETE /identity/v3/projects/8a63137b4af64f64bd9fa8cd0684c1e7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:00.031499 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e85665-7023-43bf-86d8-066ac4bd26a0 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:00.041225 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e85665-7023-43bf-86d8-066ac4bd26a0 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:00.100198 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb0456-80e0-432b-b79f-2ddb78a5db3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:00.101086 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb0456-80e0-432b-b79f-2ddb78a5db3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:00.101405 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb0456-80e0-432b-b79f-2ddb78a5db3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:00.101674 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb0456-80e0-432b-b79f-2ddb78a5db3b admin admin] PATH_INFO: `/v3/users/f1f3819298274e3193cfe59d2c4cf244` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:00.102897 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb0456-80e0-432b-b79f-2ddb78a5db3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1f3819298274e3193cfe59d2c4cf244)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:00.104841 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb0456-80e0-432b-b79f-2ddb78a5db3b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:00.148552 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-84eb0456-80e0-432b-b79f-2ddb78a5db3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1f3819298274e3193cfe59d2c4cf244'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:00.162692 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-84eb0456-80e0-432b-b79f-2ddb78a5db3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1f3819298274e3193cfe59d2c4cf244'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:00.163493 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-84eb0456-80e0-432b-b79f-2ddb78a5db3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1f3819298274e3193cfe59d2c4cf244'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:00.164240 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-84eb0456-80e0-432b-b79f-2ddb78a5db3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1f3819298274e3193cfe59d2c4cf244'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:00.173656 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-84eb0456-80e0-432b-b79f-2ddb78a5db3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1f3819298274e3193cfe59d2c4cf244'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:00.186617 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1135/2270] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:37:00 2022] DELETE /identity/v3/users/f1f3819298274e3193cfe59d2c4cf244 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:00.536331 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ae441-00a2-483a-8501-3bd65d0ee0d4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:00.537816 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-713ae441-00a2-483a-8501-3bd65d0ee0d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:00.552452 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ae441-00a2-483a-8501-3bd65d0ee0d4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:00.611476 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc1fc0-b25d-49e4-8b08-8ce3432cca09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:00.612326 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc1fc0-b25d-49e4-8b08-8ce3432cca09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:00.612610 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc1fc0-b25d-49e4-8b08-8ce3432cca09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:00.612887 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc1fc0-b25d-49e4-8b08-8ce3432cca09 admin admin] PATH_INFO: `/v3/projects/9950d37660b74bb68bdf8a11e91112a6` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:00.614145 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc1fc0-b25d-49e4-8b08-8ce3432cca09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9950d37660b74bb68bdf8a11e91112a6)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:00.616001 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc1fc0-b25d-49e4-8b08-8ce3432cca09 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:00.659590 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-a9fc1fc0-b25d-49e4-8b08-8ce3432cca09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9950d37660b74bb68bdf8a11e91112a6', 'request_id': 'req-a9fc1fc0-b25d-49e4-8b08-8ce3432cca09'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:00.666553 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-a9fc1fc0-b25d-49e4-8b08-8ce3432cca09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9950d37660b74bb68bdf8a11e91112a6', 'request_id': 'req-a9fc1fc0-b25d-49e4-8b08-8ce3432cca09'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:00.673688 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-a9fc1fc0-b25d-49e4-8b08-8ce3432cca09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9950d37660b74bb68bdf8a11e91112a6', 'request_id': 'req-a9fc1fc0-b25d-49e4-8b08-8ce3432cca09'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:00.688773 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-a9fc1fc0-b25d-49e4-8b08-8ce3432cca09 admin admin] The token cache is being invalidate because project 9950d37660b74bb68bdf8a11e91112a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:37:00.689060 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-a9fc1fc0-b25d-49e4-8b08-8ce3432cca09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:00.689756 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-a9fc1fc0-b25d-49e4-8b08-8ce3432cca09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:00.691289 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1136/2271] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:37:00 2022] DELETE /identity/v3/projects/9950d37660b74bb68bdf8a11e91112a6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:37:00.696351 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16353a3c-6097-4b65-ae8e-554a69a79eac None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:00.696805 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16353a3c-6097-4b65-ae8e-554a69a79eac None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:00.696916 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16353a3c-6097-4b65-ae8e-554a69a79eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:00.716901 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-16353a3c-6097-4b65-ae8e-554a69a79eac None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:00.718196 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-16353a3c-6097-4b65-ae8e-554a69a79eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:00.775421 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1136/2272] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:00.784762 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2f96f-c4ef-42b8-b8b6-abf6393eaec2 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:00.785043 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2f96f-c4ef-42b8-b8b6-abf6393eaec2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:00.785345 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c2f96f-c4ef-42b8-b8b6-abf6393eaec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:00.804067 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-42c2f96f-c4ef-42b8-b8b6-abf6393eaec2 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:00.805367 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-42c2f96f-c4ef-42b8-b8b6-abf6393eaec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:00.813812 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1137/2273] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:00.818159 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16353a3c-6097-4b65-ae8e-554a69a79eac None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:00.827415 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16353a3c-6097-4b65-ae8e-554a69a79eac None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:00.832542 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12aa42a-9022-4bf8-9030-2ce3693fdd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:00.833183 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12aa42a-9022-4bf8-9030-2ce3693fdd72 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:00.833508 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12aa42a-9022-4bf8-9030-2ce3693fdd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:00.833779 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12aa42a-9022-4bf8-9030-2ce3693fdd72 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:00.834663 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12aa42a-9022-4bf8-9030-2ce3693fdd72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:37:00.834969 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12aa42a-9022-4bf8-9030-2ce3693fdd72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:00.837449 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12aa42a-9022-4bf8-9030-2ce3693fdd72 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:00.849439 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1137/2274] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:37:00.853936 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2f96f-c4ef-42b8-b8b6-abf6393eaec2 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:00.864289 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c2f96f-c4ef-42b8-b8b6-abf6393eaec2 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:00.869039 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0121a-ebef-41a0-bf50-65f3c73727c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:00.869777 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0121a-ebef-41a0-bf50-65f3c73727c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:00.869985 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0121a-ebef-41a0-bf50-65f3c73727c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:00.870253 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0121a-ebef-41a0-bf50-65f3c73727c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:00.871448 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0121a-ebef-41a0-bf50-65f3c73727c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:00.872979 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0121a-ebef-41a0-bf50-65f3c73727c0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:00.901402 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1138/2275] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:37:00 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:37:00.905300 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12aa42a-9022-4bf8-9030-2ce3693fdd72 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:00.916339 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12aa42a-9022-4bf8-9030-2ce3693fdd72 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:00.975854 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160563cb-48fd-4150-8383-f34d6291cdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:00.976521 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160563cb-48fd-4150-8383-f34d6291cdff admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:00.976792 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160563cb-48fd-4150-8383-f34d6291cdff admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:00.977057 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160563cb-48fd-4150-8383-f34d6291cdff admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:00.977795 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160563cb-48fd-4150-8383-f34d6291cdff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:00.979733 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160563cb-48fd-4150-8383-f34d6291cdff admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:01.002928 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1138/2276] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:37:00 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:37:01.004153 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0121a-ebef-41a0-bf50-65f3c73727c0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:01.014546 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0121a-ebef-41a0-bf50-65f3c73727c0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:01.020008 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e122e84-92d3-4b26-9ce1-76038c240013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:01.020770 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e122e84-92d3-4b26-9ce1-76038c240013 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:01.020928 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e122e84-92d3-4b26-9ce1-76038c240013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:01.021249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e122e84-92d3-4b26-9ce1-76038c240013 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:01.022012 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e122e84-92d3-4b26-9ce1-76038c240013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:01.023598 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e122e84-92d3-4b26-9ce1-76038c240013 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:01.034636 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1139/2277] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:37:01.038669 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160563cb-48fd-4150-8383-f34d6291cdff admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:01.049230 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160563cb-48fd-4150-8383-f34d6291cdff admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:01.053857 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63602c67-47b0-473f-ab67-921b09afe364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:01.054501 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63602c67-47b0-473f-ab67-921b09afe364 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:01.054776 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63602c67-47b0-473f-ab67-921b09afe364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:01.055046 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63602c67-47b0-473f-ab67-921b09afe364 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:01.055823 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63602c67-47b0-473f-ab67-921b09afe364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:01.057444 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63602c67-47b0-473f-ab67-921b09afe364 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:01.066957 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1139/2278] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:37:01.070767 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e122e84-92d3-4b26-9ce1-76038c240013 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:01.080383 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e122e84-92d3-4b26-9ce1-76038c240013 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:01.084843 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b77bf6-5af9-4230-9cc6-0bf840b303ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:01.085837 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b77bf6-5af9-4230-9cc6-0bf840b303ff admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:01.086163 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b77bf6-5af9-4230-9cc6-0bf840b303ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:01.086416 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b77bf6-5af9-4230-9cc6-0bf840b303ff admin admin] PATH_INFO: `/v3/projects/aad731dbda5e453fa460b7aea2c587df/users/cc51f8cd227b4a52ae95b7742fe99c17/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:01.100637 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b77bf6-5af9-4230-9cc6-0bf840b303ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=aad731dbda5e453fa460b7aea2c587df, user_id=cc51f8cd227b4a52ae95b7742fe99c17, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:01.103306 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b77bf6-5af9-4230-9cc6-0bf840b303ff admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:01.116745 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1140/2279] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:01 2022] PUT /identity/v3/projects/aad731dbda5e453fa460b7aea2c587df/users/cc51f8cd227b4a52ae95b7742fe99c17/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:37:01.127159 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace55dd-7781-415e-a2be-5bac41614e96 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:01.127450 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace55dd-7781-415e-a2be-5bac41614e96 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:01.127754 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ace55dd-7781-415e-a2be-5bac41614e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:01.153430 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-1ace55dd-7781-415e-a2be-5bac41614e96 None None] MFA Rules not processed for user `cc51f8cd227b4a52ae95b7742fe99c17`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:01.154620 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-1ace55dd-7781-415e-a2be-5bac41614e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:01.216653 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1140/2280] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:37:01.221666 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b77bf6-5af9-4230-9cc6-0bf840b303ff admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:01.279686 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b77bf6-5af9-4230-9cc6-0bf840b303ff admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:01.284924 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872a4d3-1e15-4adc-8a13-23463ec524cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:01.285598 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872a4d3-1e15-4adc-8a13-23463ec524cf admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:01.285883 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872a4d3-1e15-4adc-8a13-23463ec524cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:01.286156 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872a4d3-1e15-4adc-8a13-23463ec524cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:01.286845 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872a4d3-1e15-4adc-8a13-23463ec524cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:01.288748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872a4d3-1e15-4adc-8a13-23463ec524cf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:01.312989 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1141/2281] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:37:01 2022] POST /identity/v3/projects => generated 369 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:01.316975 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace55dd-7781-415e-a2be-5bac41614e96 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:01.327370 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ace55dd-7781-415e-a2be-5bac41614e96 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:01.383627 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a70b67-c231-4d9d-92cb-6c0c4c9f0492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:01.384299 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a70b67-c231-4d9d-92cb-6c0c4c9f0492 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:01.384583 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a70b67-c231-4d9d-92cb-6c0c4c9f0492 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:01.385206 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a70b67-c231-4d9d-92cb-6c0c4c9f0492 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:01.385943 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a70b67-c231-4d9d-92cb-6c0c4c9f0492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:01.387917 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a70b67-c231-4d9d-92cb-6c0c4c9f0492 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:01.407862 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1141/2282] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:37:01 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:01.411751 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872a4d3-1e15-4adc-8a13-23463ec524cf admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:01.424005 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872a4d3-1e15-4adc-8a13-23463ec524cf admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:01.443697 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086a26b-1068-49c6-9035-85b32f767515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:01.444087 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086a26b-1068-49c6-9035-85b32f767515 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:01.444415 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086a26b-1068-49c6-9035-85b32f767515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:01.444634 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086a26b-1068-49c6-9035-85b32f767515 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:01.445531 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086a26b-1068-49c6-9035-85b32f767515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:01.449309 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086a26b-1068-49c6-9035-85b32f767515 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:01.473313 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1142/2283] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:01.474933 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a70b67-c231-4d9d-92cb-6c0c4c9f0492 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:01.486195 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a70b67-c231-4d9d-92cb-6c0c4c9f0492 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:01.491381 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf281b-50ee-4461-9ac1-a9d9f9e08deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:01.492262 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf281b-50ee-4461-9ac1-a9d9f9e08deb admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:01.492542 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf281b-50ee-4461-9ac1-a9d9f9e08deb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:01.492818 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf281b-50ee-4461-9ac1-a9d9f9e08deb admin admin] PATH_INFO: `/v3/projects/d37f1b106d5d494b9dfef6f1fd122403/users/85c3b35d418a40ae8f36e419ad1486e9/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:01.511780 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf281b-50ee-4461-9ac1-a9d9f9e08deb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37f1b106d5d494b9dfef6f1fd122403, user_id=85c3b35d418a40ae8f36e419ad1486e9, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:01.514764 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf281b-50ee-4461-9ac1-a9d9f9e08deb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:01.529738 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1142/2284] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:01 2022] PUT /identity/v3/projects/d37f1b106d5d494b9dfef6f1fd122403/users/85c3b35d418a40ae8f36e419ad1486e9/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:01.533977 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086a26b-1068-49c6-9035-85b32f767515 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:01.545711 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086a26b-1068-49c6-9035-85b32f767515 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:01.608434 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e162235-890e-46d3-b0af-de434e1f81de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:01.609084 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e162235-890e-46d3-b0af-de434e1f81de admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:01.609397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e162235-890e-46d3-b0af-de434e1f81de admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:01.610256 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e162235-890e-46d3-b0af-de434e1f81de admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:01.610966 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e162235-890e-46d3-b0af-de434e1f81de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:01.612549 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e162235-890e-46d3-b0af-de434e1f81de admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:01.621837 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1143/2285] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:01.625984 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf281b-50ee-4461-9ac1-a9d9f9e08deb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:01.636246 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf281b-50ee-4461-9ac1-a9d9f9e08deb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:01.640830 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a611fc-53a6-463d-8756-3ead6b743fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:01.641729 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a611fc-53a6-463d-8756-3ead6b743fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:01.642007 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a611fc-53a6-463d-8756-3ead6b743fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:01.642277 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a611fc-53a6-463d-8756-3ead6b743fbe admin admin] PATH_INFO: `/v3/projects/d37f1b106d5d494b9dfef6f1fd122403/users/85c3b35d418a40ae8f36e419ad1486e9/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:01.644249 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a611fc-53a6-463d-8756-3ead6b743fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37f1b106d5d494b9dfef6f1fd122403, user_id=85c3b35d418a40ae8f36e419ad1486e9, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:01.646937 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a611fc-53a6-463d-8756-3ead6b743fbe admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:01.657804 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1143/2286] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:01 2022] PUT /identity/v3/projects/d37f1b106d5d494b9dfef6f1fd122403/users/85c3b35d418a40ae8f36e419ad1486e9/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:01.667613 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947772b7-c16f-4da9-ab3f-a29ca238d96f None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:01.667911 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947772b7-c16f-4da9-ab3f-a29ca238d96f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:01.668546 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947772b7-c16f-4da9-ab3f-a29ca238d96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:01.695792 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-947772b7-c16f-4da9-ab3f-a29ca238d96f None None] MFA Rules not processed for user `85c3b35d418a40ae8f36e419ad1486e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:01.698729 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-947772b7-c16f-4da9-ab3f-a29ca238d96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:01.766753 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1144/2287] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:01 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:01.777011 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a611fc-53a6-463d-8756-3ead6b743fbe admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:01.778741 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d4a611fc-53a6-463d-8756-3ead6b743fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:01.834985 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a611fc-53a6-463d-8756-3ead6b743fbe admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:01.838784 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5fe32-b9f7-424d-9416-ed43a216e496 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:01.839415 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5fe32-b9f7-424d-9416-ed43a216e496 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:01.839694 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5fe32-b9f7-424d-9416-ed43a216e496 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:01.839973 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5fe32-b9f7-424d-9416-ed43a216e496 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:01.848961 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5fe32-b9f7-424d-9416-ed43a216e496 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:01.850457 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5fe32-b9f7-424d-9416-ed43a216e496 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:01.859947 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1144/2288] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:01 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:37:01.904819 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947772b7-c16f-4da9-ab3f-a29ca238d96f None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:01.906293 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-947772b7-c16f-4da9-ab3f-a29ca238d96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:01.918292 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947772b7-c16f-4da9-ab3f-a29ca238d96f None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:01.921960 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4194d-d8dd-4ea1-aaeb-e11b0e493d8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:01.922601 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4194d-d8dd-4ea1-aaeb-e11b0e493d8d service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:01.922868 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4194d-d8dd-4ea1-aaeb-e11b0e493d8d service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:01.923142 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4194d-d8dd-4ea1-aaeb-e11b0e493d8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:01.978437 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4194d-d8dd-4ea1-aaeb-e11b0e493d8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:01.979870 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4194d-d8dd-4ea1-aaeb-e11b0e493d8d service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:01.989377 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1145/2289] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:01 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:37:05.206487 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5fe32-b9f7-424d-9416-ed43a216e496 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:05.265176 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5fe32-b9f7-424d-9416-ed43a216e496 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:05.270205 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca639d6b-c4a0-4aaf-a165-57d5d361c6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:05.271042 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca639d6b-c4a0-4aaf-a165-57d5d361c6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:05.271321 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca639d6b-c4a0-4aaf-a165-57d5d361c6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:05.271593 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca639d6b-c4a0-4aaf-a165-57d5d361c6d5 admin admin] PATH_INFO: `/v3/users/cc51f8cd227b4a52ae95b7742fe99c17` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:05.272759 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca639d6b-c4a0-4aaf-a165-57d5d361c6d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc51f8cd227b4a52ae95b7742fe99c17)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:05.274708 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca639d6b-c4a0-4aaf-a165-57d5d361c6d5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:05.319190 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ca639d6b-c4a0-4aaf-a165-57d5d361c6d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc51f8cd227b4a52ae95b7742fe99c17'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:05.331123 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ca639d6b-c4a0-4aaf-a165-57d5d361c6d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc51f8cd227b4a52ae95b7742fe99c17'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:05.331791 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ca639d6b-c4a0-4aaf-a165-57d5d361c6d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc51f8cd227b4a52ae95b7742fe99c17'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:05.332409 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ca639d6b-c4a0-4aaf-a165-57d5d361c6d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc51f8cd227b4a52ae95b7742fe99c17'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:05.340966 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ca639d6b-c4a0-4aaf-a165-57d5d361c6d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc51f8cd227b4a52ae95b7742fe99c17'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:05.353412 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1145/2290] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:37:05 2022] DELETE /identity/v3/users/cc51f8cd227b4a52ae95b7742fe99c17 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:05.358190 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174b9ba-d365-450b-a10c-7247a32ca4b4 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:05.358687 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174b9ba-d365-450b-a10c-7247a32ca4b4 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:05.358784 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174b9ba-d365-450b-a10c-7247a32ca4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:05.375853 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-f174b9ba-d365-450b-a10c-7247a32ca4b4 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:05.377028 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f174b9ba-d365-450b-a10c-7247a32ca4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:05.432503 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1146/2291] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:37:05.442451 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca639d6b-c4a0-4aaf-a165-57d5d361c6d5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:05.443782 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ca639d6b-c4a0-4aaf-a165-57d5d361c6d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:05.497070 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca639d6b-c4a0-4aaf-a165-57d5d361c6d5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:05.501245 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397dd42-8385-4b85-80f1-d9b8d967677c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:05.501899 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397dd42-8385-4b85-80f1-d9b8d967677c service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:05.502175 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397dd42-8385-4b85-80f1-d9b8d967677c service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:05.502472 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397dd42-8385-4b85-80f1-d9b8d967677c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:05.511505 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397dd42-8385-4b85-80f1-d9b8d967677c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:05.512945 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397dd42-8385-4b85-80f1-d9b8d967677c service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:05.522621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1146/2292] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:37:05.805119 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174b9ba-d365-450b-a10c-7247a32ca4b4 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:05.806560 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f174b9ba-d365-450b-a10c-7247a32ca4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:05.819098 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174b9ba-d365-450b-a10c-7247a32ca4b4 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:05.824182 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eabfe1-69bf-4fc4-8d7d-68dd14ab5635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:05.825577 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eabfe1-69bf-4fc4-8d7d-68dd14ab5635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:05.825867 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eabfe1-69bf-4fc4-8d7d-68dd14ab5635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:05.826143 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eabfe1-69bf-4fc4-8d7d-68dd14ab5635 admin admin] PATH_INFO: `/v3/projects/aad731dbda5e453fa460b7aea2c587df` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:05.827549 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eabfe1-69bf-4fc4-8d7d-68dd14ab5635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aad731dbda5e453fa460b7aea2c587df)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:05.829506 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eabfe1-69bf-4fc4-8d7d-68dd14ab5635 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:05.874055 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e6eabfe1-69bf-4fc4-8d7d-68dd14ab5635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aad731dbda5e453fa460b7aea2c587df', 'request_id': 'req-e6eabfe1-69bf-4fc4-8d7d-68dd14ab5635'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:05.881426 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e6eabfe1-69bf-4fc4-8d7d-68dd14ab5635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aad731dbda5e453fa460b7aea2c587df', 'request_id': 'req-e6eabfe1-69bf-4fc4-8d7d-68dd14ab5635'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:05.886723 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e6eabfe1-69bf-4fc4-8d7d-68dd14ab5635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aad731dbda5e453fa460b7aea2c587df', 'request_id': 'req-e6eabfe1-69bf-4fc4-8d7d-68dd14ab5635'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:05.897850 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e6eabfe1-69bf-4fc4-8d7d-68dd14ab5635 admin admin] The token cache is being invalidate because project aad731dbda5e453fa460b7aea2c587df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:37:05.898134 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e6eabfe1-69bf-4fc4-8d7d-68dd14ab5635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:05.898748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e6eabfe1-69bf-4fc4-8d7d-68dd14ab5635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:05.900259 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1147/2293] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:37:05 2022] DELETE /identity/v3/projects/aad731dbda5e453fa460b7aea2c587df => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:05.904108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397dd42-8385-4b85-80f1-d9b8d967677c service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:05.914065 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397dd42-8385-4b85-80f1-d9b8d967677c service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:05.969992 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e3db3-2134-4f7f-9418-2ab7a8fea3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:05.970763 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e3db3-2134-4f7f-9418-2ab7a8fea3b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:05.971374 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e3db3-2134-4f7f-9418-2ab7a8fea3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:05.971659 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e3db3-2134-4f7f-9418-2ab7a8fea3b3 admin admin] PATH_INFO: `/v3/users/85c3b35d418a40ae8f36e419ad1486e9` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:05.972845 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e3db3-2134-4f7f-9418-2ab7a8fea3b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85c3b35d418a40ae8f36e419ad1486e9)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:05.974815 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e3db3-2134-4f7f-9418-2ab7a8fea3b3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:06.019352 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ca1e3db3-2134-4f7f-9418-2ab7a8fea3b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85c3b35d418a40ae8f36e419ad1486e9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:06.031030 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ca1e3db3-2134-4f7f-9418-2ab7a8fea3b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85c3b35d418a40ae8f36e419ad1486e9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:06.031748 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ca1e3db3-2134-4f7f-9418-2ab7a8fea3b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85c3b35d418a40ae8f36e419ad1486e9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:06.032359 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ca1e3db3-2134-4f7f-9418-2ab7a8fea3b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85c3b35d418a40ae8f36e419ad1486e9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:06.039324 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ca1e3db3-2134-4f7f-9418-2ab7a8fea3b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85c3b35d418a40ae8f36e419ad1486e9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:06.052164 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1147/2294] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:37:05 2022] DELETE /identity/v3/users/85c3b35d418a40ae8f36e419ad1486e9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:06.317513 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eabfe1-69bf-4fc4-8d7d-68dd14ab5635 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:06.318991 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e6eabfe1-69bf-4fc4-8d7d-68dd14ab5635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:06.332878 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eabfe1-69bf-4fc4-8d7d-68dd14ab5635 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:06.392273 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68704d43-a7f3-4859-8287-421a49cc5861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:06.393392 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68704d43-a7f3-4859-8287-421a49cc5861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:06.393629 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68704d43-a7f3-4859-8287-421a49cc5861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:06.393904 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68704d43-a7f3-4859-8287-421a49cc5861 admin admin] PATH_INFO: `/v3/projects/d37f1b106d5d494b9dfef6f1fd122403` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:06.395130 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68704d43-a7f3-4859-8287-421a49cc5861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d37f1b106d5d494b9dfef6f1fd122403)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:06.397078 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68704d43-a7f3-4859-8287-421a49cc5861 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:06.449411 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-68704d43-a7f3-4859-8287-421a49cc5861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd37f1b106d5d494b9dfef6f1fd122403', 'request_id': 'req-68704d43-a7f3-4859-8287-421a49cc5861'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:06.456642 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-68704d43-a7f3-4859-8287-421a49cc5861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd37f1b106d5d494b9dfef6f1fd122403', 'request_id': 'req-68704d43-a7f3-4859-8287-421a49cc5861'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:06.462130 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-68704d43-a7f3-4859-8287-421a49cc5861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd37f1b106d5d494b9dfef6f1fd122403', 'request_id': 'req-68704d43-a7f3-4859-8287-421a49cc5861'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:06.473428 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-68704d43-a7f3-4859-8287-421a49cc5861 admin admin] The token cache is being invalidate because project d37f1b106d5d494b9dfef6f1fd122403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:37:06.473713 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-68704d43-a7f3-4859-8287-421a49cc5861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:06.474336 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-68704d43-a7f3-4859-8287-421a49cc5861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:06.475950 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1148/2295] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:37:06 2022] DELETE /identity/v3/projects/d37f1b106d5d494b9dfef6f1fd122403 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:06.480696 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5b5d4-9235-4d6b-a244-a4d20aa14f3e None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:06.481203 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5b5d4-9235-4d6b-a244-a4d20aa14f3e None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:06.481351 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5b5d4-9235-4d6b-a244-a4d20aa14f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:06.498413 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-31c5b5d4-9235-4d6b-a244-a4d20aa14f3e None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:06.499612 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-31c5b5d4-9235-4d6b-a244-a4d20aa14f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:06.560047 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1148/2296] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:06.568930 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecaf0a-0b20-4298-8c84-40b051352812 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:06.569208 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecaf0a-0b20-4298-8c84-40b051352812 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:06.569513 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecaf0a-0b20-4298-8c84-40b051352812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:06.588074 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-15ecaf0a-0b20-4298-8c84-40b051352812 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:06.589267 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-15ecaf0a-0b20-4298-8c84-40b051352812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:06.597584 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1149/2297] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:06.601692 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5b5d4-9235-4d6b-a244-a4d20aa14f3e None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:06.614265 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5b5d4-9235-4d6b-a244-a4d20aa14f3e None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:06.615828 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62208d61-27d0-4e64-9bb0-e93da350d5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:06.616469 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62208d61-27d0-4e64-9bb0-e93da350d5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:06.616746 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62208d61-27d0-4e64-9bb0-e93da350d5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:06.617016 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62208d61-27d0-4e64-9bb0-e93da350d5f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:06.617780 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62208d61-27d0-4e64-9bb0-e93da350d5f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:37:06.618084 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62208d61-27d0-4e64-9bb0-e93da350d5f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:06.619694 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62208d61-27d0-4e64-9bb0-e93da350d5f7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:06.630893 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1149/2298] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:37:06.635393 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecaf0a-0b20-4298-8c84-40b051352812 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:06.645279 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecaf0a-0b20-4298-8c84-40b051352812 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:06.651280 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7c7ea-c25a-4e19-afd6-889bc1a99855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:06.651929 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7c7ea-c25a-4e19-afd6-889bc1a99855 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:06.652212 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7c7ea-c25a-4e19-afd6-889bc1a99855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:06.652487 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7c7ea-c25a-4e19-afd6-889bc1a99855 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:06.653176 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7c7ea-c25a-4e19-afd6-889bc1a99855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:06.655113 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7c7ea-c25a-4e19-afd6-889bc1a99855 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:06.682849 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1150/2299] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:37:06 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:06.688609 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62208d61-27d0-4e64-9bb0-e93da350d5f7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:06.698564 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62208d61-27d0-4e64-9bb0-e93da350d5f7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:06.756699 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e14f9e-ff0e-4e3c-a94a-268a5bd4b33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:06.757314 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e14f9e-ff0e-4e3c-a94a-268a5bd4b33f admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:06.757584 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e14f9e-ff0e-4e3c-a94a-268a5bd4b33f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:06.757858 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e14f9e-ff0e-4e3c-a94a-268a5bd4b33f admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:06.758539 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e14f9e-ff0e-4e3c-a94a-268a5bd4b33f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:06.760465 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e14f9e-ff0e-4e3c-a94a-268a5bd4b33f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:06.780174 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1150/2300] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:37:06 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:06.784651 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7c7ea-c25a-4e19-afd6-889bc1a99855 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:06.799893 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7c7ea-c25a-4e19-afd6-889bc1a99855 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:06.804912 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df43fd-86cb-47c9-b8a8-91e3ef7145ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:06.805602 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df43fd-86cb-47c9-b8a8-91e3ef7145ef admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:06.805879 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df43fd-86cb-47c9-b8a8-91e3ef7145ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:06.806145 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53df43fd-86cb-47c9-b8a8-91e3ef7145ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:06.806996 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df43fd-86cb-47c9-b8a8-91e3ef7145ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:06.808714 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53df43fd-86cb-47c9-b8a8-91e3ef7145ef admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:06.823464 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1151/2301] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:37:06.827585 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e14f9e-ff0e-4e3c-a94a-268a5bd4b33f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:06.838885 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e14f9e-ff0e-4e3c-a94a-268a5bd4b33f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:06.844380 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099ba41-6351-4f6f-8ca9-fadf8ee82580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:06.845047 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099ba41-6351-4f6f-8ca9-fadf8ee82580 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:06.845360 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099ba41-6351-4f6f-8ca9-fadf8ee82580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:06.845638 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099ba41-6351-4f6f-8ca9-fadf8ee82580 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:06.846374 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099ba41-6351-4f6f-8ca9-fadf8ee82580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:06.848005 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099ba41-6351-4f6f-8ca9-fadf8ee82580 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:06.860146 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1151/2302] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:06.864298 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df43fd-86cb-47c9-b8a8-91e3ef7145ef admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:06.874160 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53df43fd-86cb-47c9-b8a8-91e3ef7145ef admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:06.880874 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d4df4-c5a3-4733-8975-570f6a659739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:06.881796 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d4df4-c5a3-4733-8975-570f6a659739 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:06.882073 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d4df4-c5a3-4733-8975-570f6a659739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:06.882343 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d4df4-c5a3-4733-8975-570f6a659739 admin admin] PATH_INFO: `/v3/projects/8c593a65af0b4207b583a91e37fa06b4/users/cfb3e450ef32418d950ce4209029e87b/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:06.900732 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d4df4-c5a3-4733-8975-570f6a659739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c593a65af0b4207b583a91e37fa06b4, user_id=cfb3e450ef32418d950ce4209029e87b, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:06.904685 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d4df4-c5a3-4733-8975-570f6a659739 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:06.920428 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1152/2303] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:06 2022] PUT /identity/v3/projects/8c593a65af0b4207b583a91e37fa06b4/users/cfb3e450ef32418d950ce4209029e87b/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:06.932122 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e74e5-952e-4129-825c-481af8248552 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:06.932410 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e74e5-952e-4129-825c-481af8248552 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:06.932689 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e74e5-952e-4129-825c-481af8248552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:06.960714 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-718e74e5-952e-4129-825c-481af8248552 None None] MFA Rules not processed for user `cfb3e450ef32418d950ce4209029e87b`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:06.961827 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-718e74e5-952e-4129-825c-481af8248552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:07.036522 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1152/2304] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:07.041102 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d4df4-c5a3-4733-8975-570f6a659739 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:07.108976 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d4df4-c5a3-4733-8975-570f6a659739 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:07.114417 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361eaf7-8558-46fa-8722-5421eb40052e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:07.115161 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361eaf7-8558-46fa-8722-5421eb40052e admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:07.115513 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361eaf7-8558-46fa-8722-5421eb40052e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:07.115852 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361eaf7-8558-46fa-8722-5421eb40052e admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:07.116620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361eaf7-8558-46fa-8722-5421eb40052e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:07.118565 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361eaf7-8558-46fa-8722-5421eb40052e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:07.151327 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1153/2305] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:37:07 2022] POST /identity/v3/projects => generated 391 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:07.154286 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e74e5-952e-4129-825c-481af8248552 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:07.165245 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e74e5-952e-4129-825c-481af8248552 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:07.224356 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db70501-8f32-4b84-b56b-0c2773dd48a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:07.225025 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db70501-8f32-4b84-b56b-0c2773dd48a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:07.225339 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db70501-8f32-4b84-b56b-0c2773dd48a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:07.225621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db70501-8f32-4b84-b56b-0c2773dd48a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:07.226401 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db70501-8f32-4b84-b56b-0c2773dd48a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:07.228346 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db70501-8f32-4b84-b56b-0c2773dd48a2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:07.253356 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1153/2306] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:37:07 2022] POST /identity/v3/users => generated 302 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:07.258093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361eaf7-8558-46fa-8722-5421eb40052e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:07.279079 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361eaf7-8558-46fa-8722-5421eb40052e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:07.290424 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16dba2-e2fc-42c4-bdf6-afa90671720f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:07.291839 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16dba2-e2fc-42c4-bdf6-afa90671720f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:07.292458 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16dba2-e2fc-42c4-bdf6-afa90671720f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:07.293376 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a16dba2-e2fc-42c4-bdf6-afa90671720f admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:07.294814 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16dba2-e2fc-42c4-bdf6-afa90671720f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:07.298253 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a16dba2-e2fc-42c4-bdf6-afa90671720f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:07.311895 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1154/2307] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:07.316061 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db70501-8f32-4b84-b56b-0c2773dd48a2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:07.326448 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db70501-8f32-4b84-b56b-0c2773dd48a2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:07.332035 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f03f0b-3eb9-4afa-870b-2d199418ac84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:07.332924 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f03f0b-3eb9-4afa-870b-2d199418ac84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:07.333207 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f03f0b-3eb9-4afa-870b-2d199418ac84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:07.333512 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f03f0b-3eb9-4afa-870b-2d199418ac84 admin admin] PATH_INFO: `/v3/projects/4e3428b85b79409bbe67a246a82def93/users/81e7d28f1c1d4d6f952ec429216ec2de/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:07.348931 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f03f0b-3eb9-4afa-870b-2d199418ac84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3428b85b79409bbe67a246a82def93, user_id=81e7d28f1c1d4d6f952ec429216ec2de, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:07.351721 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f03f0b-3eb9-4afa-870b-2d199418ac84 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:07.365200 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1154/2308] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:07 2022] PUT /identity/v3/projects/4e3428b85b79409bbe67a246a82def93/users/81e7d28f1c1d4d6f952ec429216ec2de/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:07.368914 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16dba2-e2fc-42c4-bdf6-afa90671720f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:07.379307 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a16dba2-e2fc-42c4-bdf6-afa90671720f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:07.440855 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dda382-a126-4185-ad6a-c249bf3e05c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:07.441754 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dda382-a126-4185-ad6a-c249bf3e05c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:07.451880 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dda382-a126-4185-ad6a-c249bf3e05c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:07.454032 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dda382-a126-4185-ad6a-c249bf3e05c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:07.455543 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dda382-a126-4185-ad6a-c249bf3e05c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:07.457935 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dda382-a126-4185-ad6a-c249bf3e05c8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:07.473498 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1155/2309] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:07.485471 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f03f0b-3eb9-4afa-870b-2d199418ac84 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:07.496071 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f03f0b-3eb9-4afa-870b-2d199418ac84 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:07.500993 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946444e-388d-4daf-ae40-3ec110f465a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:07.501961 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946444e-388d-4daf-ae40-3ec110f465a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:07.502246 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946444e-388d-4daf-ae40-3ec110f465a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:07.502527 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946444e-388d-4daf-ae40-3ec110f465a8 admin admin] PATH_INFO: `/v3/projects/4e3428b85b79409bbe67a246a82def93/users/81e7d28f1c1d4d6f952ec429216ec2de/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:07.504518 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946444e-388d-4daf-ae40-3ec110f465a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3428b85b79409bbe67a246a82def93, user_id=81e7d28f1c1d4d6f952ec429216ec2de, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:07.507246 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946444e-388d-4daf-ae40-3ec110f465a8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:07.519173 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1155/2310] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:07 2022] PUT /identity/v3/projects/4e3428b85b79409bbe67a246a82def93/users/81e7d28f1c1d4d6f952ec429216ec2de/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:07.530234 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845a7b3-b50a-43a4-af9b-5031ef573bdd None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:07.530527 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845a7b3-b50a-43a4-af9b-5031ef573bdd None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:07.530811 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845a7b3-b50a-43a4-af9b-5031ef573bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:07.565017 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-a845a7b3-b50a-43a4-af9b-5031ef573bdd None None] MFA Rules not processed for user `81e7d28f1c1d4d6f952ec429216ec2de`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:07.566792 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a845a7b3-b50a-43a4-af9b-5031ef573bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:07.635411 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1156/2311] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:07 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:07.645332 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946444e-388d-4daf-ae40-3ec110f465a8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:07.647097 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7946444e-388d-4daf-ae40-3ec110f465a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:07.704756 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946444e-388d-4daf-ae40-3ec110f465a8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:07.708939 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c27789-5cea-4ad7-8dc3-fd5ccfd10705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:07.709695 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c27789-5cea-4ad7-8dc3-fd5ccfd10705 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:07.709918 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c27789-5cea-4ad7-8dc3-fd5ccfd10705 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:07.710189 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c27789-5cea-4ad7-8dc3-fd5ccfd10705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:07.720462 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c27789-5cea-4ad7-8dc3-fd5ccfd10705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:07.721957 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c27789-5cea-4ad7-8dc3-fd5ccfd10705 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:07.731867 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1156/2312] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:37:07.774402 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845a7b3-b50a-43a4-af9b-5031ef573bdd None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:07.775826 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a845a7b3-b50a-43a4-af9b-5031ef573bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:07.788050 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845a7b3-b50a-43a4-af9b-5031ef573bdd None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:07.791656 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee86dec-8edd-44ad-b70d-d3579f92a78c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:07.792287 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee86dec-8edd-44ad-b70d-d3579f92a78c service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:07.792563 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee86dec-8edd-44ad-b70d-d3579f92a78c service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:07.792838 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee86dec-8edd-44ad-b70d-d3579f92a78c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:07.848000 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee86dec-8edd-44ad-b70d-d3579f92a78c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:07.849463 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee86dec-8edd-44ad-b70d-d3579f92a78c service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:07.858347 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1157/2313] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:37:12.683714 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c8522-6dce-427a-912e-cdbfd6b85021 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:12.684327 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c8522-6dce-427a-912e-cdbfd6b85021 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:12.684327 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c8522-6dce-427a-912e-cdbfd6b85021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:12.703884 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f69c8522-6dce-427a-912e-cdbfd6b85021 None None] MFA Rules not processed for user `ae34f18423784b6d9e9bd45f2fa796e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:12.705146 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f69c8522-6dce-427a-912e-cdbfd6b85021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:12.776623 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1157/2314] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:13.243105 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee86dec-8edd-44ad-b70d-d3579f92a78c service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:13.338811 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee86dec-8edd-44ad-b70d-d3579f92a78c service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:13.343664 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b85cb2-2a84-4dda-b300-b2696f047295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:13.344677 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b85cb2-2a84-4dda-b300-b2696f047295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:13.345022 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b85cb2-2a84-4dda-b300-b2696f047295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:13.345398 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b85cb2-2a84-4dda-b300-b2696f047295 admin admin] PATH_INFO: `/v3/users/cfb3e450ef32418d950ce4209029e87b` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:13.346721 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b85cb2-2a84-4dda-b300-b2696f047295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb3e450ef32418d950ce4209029e87b)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:13.349576 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b85cb2-2a84-4dda-b300-b2696f047295 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:13.453973 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-49b85cb2-2a84-4dda-b300-b2696f047295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb3e450ef32418d950ce4209029e87b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:13.464218 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-49b85cb2-2a84-4dda-b300-b2696f047295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb3e450ef32418d950ce4209029e87b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:13.483347 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-49b85cb2-2a84-4dda-b300-b2696f047295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb3e450ef32418d950ce4209029e87b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:13.484849 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-49b85cb2-2a84-4dda-b300-b2696f047295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb3e450ef32418d950ce4209029e87b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:13.485640 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-49b85cb2-2a84-4dda-b300-b2696f047295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb3e450ef32418d950ce4209029e87b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:13.499102 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1158/2315] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:37:13 2022] DELETE /identity/v3/users/cfb3e450ef32418d950ce4209029e87b => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:13.508325 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75609d74-9782-4fcf-ab3c-4c9e4bdd83bc None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:13.508325 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75609d74-9782-4fcf-ab3c-4c9e4bdd83bc None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:13.508325 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75609d74-9782-4fcf-ab3c-4c9e4bdd83bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:13.523791 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-75609d74-9782-4fcf-ab3c-4c9e4bdd83bc None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:13.525021 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-75609d74-9782-4fcf-ab3c-4c9e4bdd83bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:13.593721 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1158/2316] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:13.603045 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b85cb2-2a84-4dda-b300-b2696f047295 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:13.604493 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-49b85cb2-2a84-4dda-b300-b2696f047295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:13.680292 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b85cb2-2a84-4dda-b300-b2696f047295 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:13.683958 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a34154-fd32-451f-afda-c096ca16b867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:13.684610 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a34154-fd32-451f-afda-c096ca16b867 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:13.685050 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a34154-fd32-451f-afda-c096ca16b867 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:13.685349 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a34154-fd32-451f-afda-c096ca16b867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:13.695144 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a34154-fd32-451f-afda-c096ca16b867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:13.696576 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a34154-fd32-451f-afda-c096ca16b867 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:13.706238 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1159/2317] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:37:14.324293 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75609d74-9782-4fcf-ab3c-4c9e4bdd83bc None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:14.325768 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-75609d74-9782-4fcf-ab3c-4c9e4bdd83bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:14.338766 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75609d74-9782-4fcf-ab3c-4c9e4bdd83bc None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:14.343898 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ec4f4-101b-47db-a5b8-442c1ee584d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:14.344743 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ec4f4-101b-47db-a5b8-442c1ee584d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:14.345019 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ec4f4-101b-47db-a5b8-442c1ee584d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:14.345330 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ec4f4-101b-47db-a5b8-442c1ee584d5 admin admin] PATH_INFO: `/v3/projects/8c593a65af0b4207b583a91e37fa06b4` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:14.346611 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ec4f4-101b-47db-a5b8-442c1ee584d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c593a65af0b4207b583a91e37fa06b4)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:14.348533 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ec4f4-101b-47db-a5b8-442c1ee584d5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:14.397201 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-220ec4f4-101b-47db-a5b8-442c1ee584d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c593a65af0b4207b583a91e37fa06b4', 'request_id': 'req-220ec4f4-101b-47db-a5b8-442c1ee584d5'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:14.404248 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-220ec4f4-101b-47db-a5b8-442c1ee584d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c593a65af0b4207b583a91e37fa06b4', 'request_id': 'req-220ec4f4-101b-47db-a5b8-442c1ee584d5'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:14.410134 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-220ec4f4-101b-47db-a5b8-442c1ee584d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c593a65af0b4207b583a91e37fa06b4', 'request_id': 'req-220ec4f4-101b-47db-a5b8-442c1ee584d5'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:14.420793 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-220ec4f4-101b-47db-a5b8-442c1ee584d5 admin admin] The token cache is being invalidate because project 8c593a65af0b4207b583a91e37fa06b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:37:14.421071 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-220ec4f4-101b-47db-a5b8-442c1ee584d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:14.422358 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-220ec4f4-101b-47db-a5b8-442c1ee584d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:14.423866 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1159/2318] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:37:14 2022] DELETE /identity/v3/projects/8c593a65af0b4207b583a91e37fa06b4 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:14.427943 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a34154-fd32-451f-afda-c096ca16b867 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:14.437981 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a34154-fd32-451f-afda-c096ca16b867 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:14.496396 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ab898-559d-41e7-9792-3ec268fcf87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:14.497339 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ab898-559d-41e7-9792-3ec268fcf87a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:14.497595 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ab898-559d-41e7-9792-3ec268fcf87a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:14.497887 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ab898-559d-41e7-9792-3ec268fcf87a admin admin] PATH_INFO: `/v3/users/81e7d28f1c1d4d6f952ec429216ec2de` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:14.499365 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ab898-559d-41e7-9792-3ec268fcf87a admin admin] RBAC: Authorizing `identity:delete_user(user_id=81e7d28f1c1d4d6f952ec429216ec2de)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:14.501964 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ab898-559d-41e7-9792-3ec268fcf87a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:14.546870 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8e0ab898-559d-41e7-9792-3ec268fcf87a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81e7d28f1c1d4d6f952ec429216ec2de'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:14.553678 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8e0ab898-559d-41e7-9792-3ec268fcf87a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81e7d28f1c1d4d6f952ec429216ec2de'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:14.566485 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8e0ab898-559d-41e7-9792-3ec268fcf87a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81e7d28f1c1d4d6f952ec429216ec2de'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:14.567217 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8e0ab898-559d-41e7-9792-3ec268fcf87a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81e7d28f1c1d4d6f952ec429216ec2de'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:14.567822 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8e0ab898-559d-41e7-9792-3ec268fcf87a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81e7d28f1c1d4d6f952ec429216ec2de'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:14.580985 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1160/2319] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:37:14 2022] DELETE /identity/v3/users/81e7d28f1c1d4d6f952ec429216ec2de => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:37:14.865230 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef149a-9407-4e8e-a65a-94f4657d0dab None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:14.865763 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef149a-9407-4e8e-a65a-94f4657d0dab None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:14.866130 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef149a-9407-4e8e-a65a-94f4657d0dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:14.898360 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-03ef149a-9407-4e8e-a65a-94f4657d0dab None None] MFA Rules not processed for user `4d22345d2e2646cc99c74a2f9692b648`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:14.900081 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-03ef149a-9407-4e8e-a65a-94f4657d0dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:14.909684 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ab898-559d-41e7-9792-3ec268fcf87a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:14.912168 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8e0ab898-559d-41e7-9792-3ec268fcf87a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:15.002281 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1160/2320] 10.222.0.75 () {58 vars in 967 bytes} [Wed Feb 16 05:37:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:15.008607 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ab898-559d-41e7-9792-3ec268fcf87a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:15.013903 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be887db-97e6-4a3c-9e41-27b31cfd3c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:15.014771 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be887db-97e6-4a3c-9e41-27b31cfd3c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:15.015041 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be887db-97e6-4a3c-9e41-27b31cfd3c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:15.016005 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be887db-97e6-4a3c-9e41-27b31cfd3c95 admin admin] PATH_INFO: `/v3/projects/4e3428b85b79409bbe67a246a82def93` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:15.017242 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be887db-97e6-4a3c-9e41-27b31cfd3c95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3428b85b79409bbe67a246a82def93)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:15.027446 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be887db-97e6-4a3c-9e41-27b31cfd3c95 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:15.029783 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef149a-9407-4e8e-a65a-94f4657d0dab None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:15.032087 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-03ef149a-9407-4e8e-a65a-94f4657d0dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:15.085142 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2be887db-97e6-4a3c-9e41-27b31cfd3c95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3428b85b79409bbe67a246a82def93', 'request_id': 'req-2be887db-97e6-4a3c-9e41-27b31cfd3c95'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:15.103786 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2be887db-97e6-4a3c-9e41-27b31cfd3c95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3428b85b79409bbe67a246a82def93', 'request_id': 'req-2be887db-97e6-4a3c-9e41-27b31cfd3c95'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:15.110293 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef149a-9407-4e8e-a65a-94f4657d0dab None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:15.119176 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2be887db-97e6-4a3c-9e41-27b31cfd3c95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3428b85b79409bbe67a246a82def93', 'request_id': 'req-2be887db-97e6-4a3c-9e41-27b31cfd3c95'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:15.132950 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2be887db-97e6-4a3c-9e41-27b31cfd3c95 admin admin] The token cache is being invalidate because project 4e3428b85b79409bbe67a246a82def93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:37:15.133252 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2be887db-97e6-4a3c-9e41-27b31cfd3c95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:15.133926 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2be887db-97e6-4a3c-9e41-27b31cfd3c95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:15.139729 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1161/2321] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:37:14 2022] DELETE /identity/v3/projects/4e3428b85b79409bbe67a246a82def93 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:37:15.141305 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dac62-fb87-4f1b-bf14-0f15e0e42e7d None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:15.141898 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dac62-fb87-4f1b-bf14-0f15e0e42e7d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:15.141898 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dac62-fb87-4f1b-bf14-0f15e0e42e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:15.161840 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-a74dac62-fb87-4f1b-bf14-0f15e0e42e7d None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:15.163551 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a74dac62-fb87-4f1b-bf14-0f15e0e42e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:15.178589 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44177b53-b134-4c46-9251-7ef4ea0bc5a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eb49cac0c94e73a70361831dd789b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:15.179250 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44177b53-b134-4c46-9251-7ef4ea0bc5a1 service swift] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:15.179530 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44177b53-b134-4c46-9251-7ef4ea0bc5a1 service swift] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:15.179804 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44177b53-b134-4c46-9251-7ef4ea0bc5a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:15.181725 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-44177b53-b134-4c46-9251-7ef4ea0bc5a1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:15.235202 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1162/2322] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:15.236838 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a7cfd-33d4-4207-a0d1-698353f972da None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:15.237123 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a7cfd-33d4-4207-a0d1-698353f972da None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:15.237436 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a7cfd-33d4-4207-a0d1-698353f972da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:15.247923 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44177b53-b134-4c46-9251-7ef4ea0bc5a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:15.250588 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44177b53-b134-4c46-9251-7ef4ea0bc5a1 service swift] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:15.255929 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-ac5a7cfd-33d4-4207-a0d1-698353f972da None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:15.257185 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ac5a7cfd-33d4-4207-a0d1-698353f972da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:15.259579 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1161/2323] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Feb 16 05:37:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 16 05:37:15.267017 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1163/2324] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:15.274337 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44177b53-b134-4c46-9251-7ef4ea0bc5a1 service swift] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:15.293583 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44177b53-b134-4c46-9251-7ef4ea0bc5a1 service swift] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:15.299648 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7eb285-24ac-416f-97c3-126dda52565f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:15.300468 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eb285-24ac-416f-97c3-126dda52565f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:15.300702 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eb285-24ac-416f-97c3-126dda52565f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:15.300928 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eb285-24ac-416f-97c3-126dda52565f admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:15.301571 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7eb285-24ac-416f-97c3-126dda52565f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:37:15.301982 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7eb285-24ac-416f-97c3-126dda52565f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:15.303666 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7eb285-24ac-416f-97c3-126dda52565f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:15.316707 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1162/2325] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:37:15.320759 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a7cfd-33d4-4207-a0d1-698353f972da None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:15.334224 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a7cfd-33d4-4207-a0d1-698353f972da None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:15.339677 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b3b83-01fd-428e-a150-7730f6af7cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:15.340323 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b3b83-01fd-428e-a150-7730f6af7cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:15.340724 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b3b83-01fd-428e-a150-7730f6af7cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:15.341001 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b3b83-01fd-428e-a150-7730f6af7cd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:15.341859 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b3b83-01fd-428e-a150-7730f6af7cd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:15.344762 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b3b83-01fd-428e-a150-7730f6af7cd6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:15.375371 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1164/2326] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:37:15 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:37:15.379332 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7eb285-24ac-416f-97c3-126dda52565f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:15.392307 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7eb285-24ac-416f-97c3-126dda52565f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:15.465796 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c41111-9fd6-40cb-9b3a-1d6db3ae4ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:15.467173 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c41111-9fd6-40cb-9b3a-1d6db3ae4ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:15.467554 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c41111-9fd6-40cb-9b3a-1d6db3ae4ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:15.468019 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c41111-9fd6-40cb-9b3a-1d6db3ae4ca6 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:15.468886 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c41111-9fd6-40cb-9b3a-1d6db3ae4ca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:15.471037 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c41111-9fd6-40cb-9b3a-1d6db3ae4ca6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:15.499604 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1163/2327] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:37:15 2022] POST /identity/v3/users => generated 294 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:15.504435 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b3b83-01fd-428e-a150-7730f6af7cd6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:15.515753 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b3b83-01fd-428e-a150-7730f6af7cd6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:15.520978 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3e135-cf23-4bd2-9e4d-39d32d59fbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:15.521677 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3e135-cf23-4bd2-9e4d-39d32d59fbda admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:15.521959 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3e135-cf23-4bd2-9e4d-39d32d59fbda admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:15.522233 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3e135-cf23-4bd2-9e4d-39d32d59fbda admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:15.522964 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3e135-cf23-4bd2-9e4d-39d32d59fbda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:15.524588 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3e135-cf23-4bd2-9e4d-39d32d59fbda admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:15.537575 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1165/2328] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:15.542179 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c41111-9fd6-40cb-9b3a-1d6db3ae4ca6 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:15.569639 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c41111-9fd6-40cb-9b3a-1d6db3ae4ca6 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:15.575317 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f71d6-42e8-4801-9d13-f2c7a5fb2fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:15.577279 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f71d6-42e8-4801-9d13-f2c7a5fb2fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:15.578696 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f71d6-42e8-4801-9d13-f2c7a5fb2fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:15.579359 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f71d6-42e8-4801-9d13-f2c7a5fb2fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:15.580385 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f71d6-42e8-4801-9d13-f2c7a5fb2fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:15.582626 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f71d6-42e8-4801-9d13-f2c7a5fb2fe0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:15.594749 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1164/2329] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:37:15.600343 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3e135-cf23-4bd2-9e4d-39d32d59fbda admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:15.612177 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3e135-cf23-4bd2-9e4d-39d32d59fbda admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:15.618621 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eabb5-dcef-4697-9af0-be4e01ef2937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:15.619531 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eabb5-dcef-4697-9af0-be4e01ef2937 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:15.619976 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eabb5-dcef-4697-9af0-be4e01ef2937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:15.620259 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9eabb5-dcef-4697-9af0-be4e01ef2937 admin admin] PATH_INFO: `/v3/projects/499b9ae060914f18ae2a08a5703e9cf4/users/f41a491a5c644f018eb60d975e1b0030/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:15.641781 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9eabb5-dcef-4697-9af0-be4e01ef2937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=499b9ae060914f18ae2a08a5703e9cf4, user_id=f41a491a5c644f018eb60d975e1b0030, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:15.644477 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9eabb5-dcef-4697-9af0-be4e01ef2937 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:15.667658 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1166/2330] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:15 2022] PUT /identity/v3/projects/499b9ae060914f18ae2a08a5703e9cf4/users/f41a491a5c644f018eb60d975e1b0030/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:15.678526 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777a9ef-ec3a-4600-87a2-8ac3c5d13dfd None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:15.678814 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777a9ef-ec3a-4600-87a2-8ac3c5d13dfd None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:15.679092 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777a9ef-ec3a-4600-87a2-8ac3c5d13dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:15.734397 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-9777a9ef-ec3a-4600-87a2-8ac3c5d13dfd None None] MFA Rules not processed for user `f41a491a5c644f018eb60d975e1b0030`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:15.736251 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9777a9ef-ec3a-4600-87a2-8ac3c5d13dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:15.846646 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1165/2331] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:15.850925 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eabb5-dcef-4697-9af0-be4e01ef2937 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:15.927016 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9eabb5-dcef-4697-9af0-be4e01ef2937 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:15.932477 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bae77-d17e-499d-8d7b-be5edad3113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:15.933137 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bae77-d17e-499d-8d7b-be5edad3113d admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:15.933508 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bae77-d17e-499d-8d7b-be5edad3113d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:15.933751 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bae77-d17e-499d-8d7b-be5edad3113d admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:15.934462 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bae77-d17e-499d-8d7b-be5edad3113d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:15.936663 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bae77-d17e-499d-8d7b-be5edad3113d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:15.971975 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1167/2332] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:37:15 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:37:15.982487 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777a9ef-ec3a-4600-87a2-8ac3c5d13dfd None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:15.997847 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777a9ef-ec3a-4600-87a2-8ac3c5d13dfd None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:16.068547 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c99e0c-bd18-4e7e-a0e4-07faefc60ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:16.069220 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c99e0c-bd18-4e7e-a0e4-07faefc60ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:16.069549 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c99e0c-bd18-4e7e-a0e4-07faefc60ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:16.069827 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c99e0c-bd18-4e7e-a0e4-07faefc60ea7 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:16.070520 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c99e0c-bd18-4e7e-a0e4-07faefc60ea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:16.072457 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c99e0c-bd18-4e7e-a0e4-07faefc60ea7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:16.098260 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1166/2333] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:37:15 2022] POST /identity/v3/users => generated 300 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:16.102171 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bae77-d17e-499d-8d7b-be5edad3113d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:16.115388 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bae77-d17e-499d-8d7b-be5edad3113d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:16.120170 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a677c07-1c66-403c-bffc-5541f26c5ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:16.120830 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a677c07-1c66-403c-bffc-5541f26c5ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:16.121112 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a677c07-1c66-403c-bffc-5541f26c5ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:16.121423 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a677c07-1c66-403c-bffc-5541f26c5ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:16.122672 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a677c07-1c66-403c-bffc-5541f26c5ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:16.124482 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a677c07-1c66-403c-bffc-5541f26c5ab2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:16.135422 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1168/2334] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:37:16.141158 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c99e0c-bd18-4e7e-a0e4-07faefc60ea7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:16.152472 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c99e0c-bd18-4e7e-a0e4-07faefc60ea7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:16.158653 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c79ee-46bd-494d-98f3-62b9542d49fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:16.159626 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c79ee-46bd-494d-98f3-62b9542d49fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:16.159909 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c79ee-46bd-494d-98f3-62b9542d49fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:16.160185 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c79ee-46bd-494d-98f3-62b9542d49fd admin admin] PATH_INFO: `/v3/projects/e8b50034133e4a7a929021fd5e3b5901/users/227b8ba2b18b4c2e92f9c93c340032f7/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:16.176394 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c79ee-46bd-494d-98f3-62b9542d49fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b50034133e4a7a929021fd5e3b5901, user_id=227b8ba2b18b4c2e92f9c93c340032f7, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:16.179130 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c79ee-46bd-494d-98f3-62b9542d49fd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:16.192004 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1167/2335] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:16 2022] PUT /identity/v3/projects/e8b50034133e4a7a929021fd5e3b5901/users/227b8ba2b18b4c2e92f9c93c340032f7/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:37:16.195857 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a677c07-1c66-403c-bffc-5541f26c5ab2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:16.206260 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a677c07-1c66-403c-bffc-5541f26c5ab2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:16.260306 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251914d2-468d-4f8e-a8c0-f9c628ca3078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:16.260970 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251914d2-468d-4f8e-a8c0-f9c628ca3078 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:16.261300 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251914d2-468d-4f8e-a8c0-f9c628ca3078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:16.261599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251914d2-468d-4f8e-a8c0-f9c628ca3078 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:16.262328 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251914d2-468d-4f8e-a8c0-f9c628ca3078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:16.263909 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251914d2-468d-4f8e-a8c0-f9c628ca3078 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:16.274222 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1169/2336] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:16.278525 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c79ee-46bd-494d-98f3-62b9542d49fd admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:16.290475 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c79ee-46bd-494d-98f3-62b9542d49fd admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:16.296071 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cf5e2-c1b3-4ecc-8799-a850a613cf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:16.297050 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cf5e2-c1b3-4ecc-8799-a850a613cf70 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:16.297502 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cf5e2-c1b3-4ecc-8799-a850a613cf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:16.297845 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cf5e2-c1b3-4ecc-8799-a850a613cf70 admin admin] PATH_INFO: `/v3/projects/e8b50034133e4a7a929021fd5e3b5901/users/227b8ba2b18b4c2e92f9c93c340032f7/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:16.299892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21cf5e2-c1b3-4ecc-8799-a850a613cf70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8b50034133e4a7a929021fd5e3b5901, user_id=227b8ba2b18b4c2e92f9c93c340032f7, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:16.302775 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21cf5e2-c1b3-4ecc-8799-a850a613cf70 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:16.314436 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1168/2337] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:16 2022] PUT /identity/v3/projects/e8b50034133e4a7a929021fd5e3b5901/users/227b8ba2b18b4c2e92f9c93c340032f7/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:16.325284 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c9741-dc99-4e0e-8f30-7c799e16486b None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:16.325574 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c9741-dc99-4e0e-8f30-7c799e16486b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:16.325852 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c9741-dc99-4e0e-8f30-7c799e16486b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:16.354236 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-458c9741-dc99-4e0e-8f30-7c799e16486b None None] MFA Rules not processed for user `227b8ba2b18b4c2e92f9c93c340032f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:16.355459 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-458c9741-dc99-4e0e-8f30-7c799e16486b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:16.427610 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1170/2338] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:16.437693 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cf5e2-c1b3-4ecc-8799-a850a613cf70 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:16.439462 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e21cf5e2-c1b3-4ecc-8799-a850a613cf70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:16.497810 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cf5e2-c1b3-4ecc-8799-a850a613cf70 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:16.502267 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51497d6c-5a74-47d1-847d-db2e0fba1125 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:16.502904 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51497d6c-5a74-47d1-847d-db2e0fba1125 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:16.503237 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51497d6c-5a74-47d1-847d-db2e0fba1125 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:16.503469 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51497d6c-5a74-47d1-847d-db2e0fba1125 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:16.513159 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51497d6c-5a74-47d1-847d-db2e0fba1125 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:16.514848 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51497d6c-5a74-47d1-847d-db2e0fba1125 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:16.525740 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1169/2339] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:37:17.116314 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c9741-dc99-4e0e-8f30-7c799e16486b None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:17.199976 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c9741-dc99-4e0e-8f30-7c799e16486b None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:17.205244 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f32c0-1c9e-4dc4-8733-88f85a2e76c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:17.206143 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f32c0-1c9e-4dc4-8733-88f85a2e76c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:17.206426 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f32c0-1c9e-4dc4-8733-88f85a2e76c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:17.206705 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f32c0-1c9e-4dc4-8733-88f85a2e76c2 admin admin] PATH_INFO: `/v3/users/f41a491a5c644f018eb60d975e1b0030` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:17.208596 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f32c0-1c9e-4dc4-8733-88f85a2e76c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f41a491a5c644f018eb60d975e1b0030)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:17.211239 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f32c0-1c9e-4dc4-8733-88f85a2e76c2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:17.263748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-608f32c0-1c9e-4dc4-8733-88f85a2e76c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f41a491a5c644f018eb60d975e1b0030'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:17.270554 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-608f32c0-1c9e-4dc4-8733-88f85a2e76c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f41a491a5c644f018eb60d975e1b0030'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:17.281687 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-608f32c0-1c9e-4dc4-8733-88f85a2e76c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f41a491a5c644f018eb60d975e1b0030'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:17.282401 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-608f32c0-1c9e-4dc4-8733-88f85a2e76c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f41a491a5c644f018eb60d975e1b0030'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:17.283006 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-608f32c0-1c9e-4dc4-8733-88f85a2e76c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f41a491a5c644f018eb60d975e1b0030'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:17.296115 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1171/2340] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:37:17 2022] DELETE /identity/v3/users/f41a491a5c644f018eb60d975e1b0030 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:17.301783 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6831f-36cc-4e0b-aeff-772737759670 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:17.302163 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6831f-36cc-4e0b-aeff-772737759670 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:17.302507 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6831f-36cc-4e0b-aeff-772737759670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:17.321720 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-b8d6831f-36cc-4e0b-aeff-772737759670 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:17.323078 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b8d6831f-36cc-4e0b-aeff-772737759670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:17.380531 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1170/2341] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:17.390218 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f32c0-1c9e-4dc4-8733-88f85a2e76c2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:17.391650 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-608f32c0-1c9e-4dc4-8733-88f85a2e76c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:17.449162 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f32c0-1c9e-4dc4-8733-88f85a2e76c2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:17.452874 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aaa908-54a7-4905-a957-6567b824079e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:17.453548 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaa908-54a7-4905-a957-6567b824079e service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:17.453829 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaa908-54a7-4905-a957-6567b824079e service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:17.454100 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaa908-54a7-4905-a957-6567b824079e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:17.463481 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aaa908-54a7-4905-a957-6567b824079e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:17.464911 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aaa908-54a7-4905-a957-6567b824079e service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:17.475741 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1172/2342] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:37:17.741498 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6831f-36cc-4e0b-aeff-772737759670 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:17.742907 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b8d6831f-36cc-4e0b-aeff-772737759670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:17.755340 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6831f-36cc-4e0b-aeff-772737759670 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:17.759968 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c7ed7-735f-41c0-a98f-9e88efd1888a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:17.760910 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c7ed7-735f-41c0-a98f-9e88efd1888a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:17.761287 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c7ed7-735f-41c0-a98f-9e88efd1888a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:17.761625 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c7ed7-735f-41c0-a98f-9e88efd1888a admin admin] PATH_INFO: `/v3/projects/499b9ae060914f18ae2a08a5703e9cf4` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:17.762875 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c7ed7-735f-41c0-a98f-9e88efd1888a admin admin] RBAC: Authorizing `identity:delete_project(project_id=499b9ae060914f18ae2a08a5703e9cf4)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:17.765147 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c7ed7-735f-41c0-a98f-9e88efd1888a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:17.810438 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1d2c7ed7-735f-41c0-a98f-9e88efd1888a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '499b9ae060914f18ae2a08a5703e9cf4', 'request_id': 'req-1d2c7ed7-735f-41c0-a98f-9e88efd1888a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:17.817493 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1d2c7ed7-735f-41c0-a98f-9e88efd1888a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '499b9ae060914f18ae2a08a5703e9cf4', 'request_id': 'req-1d2c7ed7-735f-41c0-a98f-9e88efd1888a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:17.822668 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1d2c7ed7-735f-41c0-a98f-9e88efd1888a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '499b9ae060914f18ae2a08a5703e9cf4', 'request_id': 'req-1d2c7ed7-735f-41c0-a98f-9e88efd1888a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:17.833087 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1d2c7ed7-735f-41c0-a98f-9e88efd1888a admin admin] The token cache is being invalidate because project 499b9ae060914f18ae2a08a5703e9cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:37:17.833405 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1d2c7ed7-735f-41c0-a98f-9e88efd1888a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:17.834031 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-1d2c7ed7-735f-41c0-a98f-9e88efd1888a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:17.835540 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1171/2343] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:37:17 2022] DELETE /identity/v3/projects/499b9ae060914f18ae2a08a5703e9cf4 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:17.843583 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aaa908-54a7-4905-a957-6567b824079e service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:17.852879 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aaa908-54a7-4905-a957-6567b824079e service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:17.913202 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deffda8-a109-4a40-b75b-b3662be6a02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:17.914090 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deffda8-a109-4a40-b75b-b3662be6a02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:17.914372 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deffda8-a109-4a40-b75b-b3662be6a02e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:17.914646 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deffda8-a109-4a40-b75b-b3662be6a02e admin admin] PATH_INFO: `/v3/users/227b8ba2b18b4c2e92f9c93c340032f7` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:17.915826 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deffda8-a109-4a40-b75b-b3662be6a02e admin admin] RBAC: Authorizing `identity:delete_user(user_id=227b8ba2b18b4c2e92f9c93c340032f7)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:17.918053 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deffda8-a109-4a40-b75b-b3662be6a02e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:17.961179 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5deffda8-a109-4a40-b75b-b3662be6a02e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '227b8ba2b18b4c2e92f9c93c340032f7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:17.967620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5deffda8-a109-4a40-b75b-b3662be6a02e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '227b8ba2b18b4c2e92f9c93c340032f7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:17.979195 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5deffda8-a109-4a40-b75b-b3662be6a02e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '227b8ba2b18b4c2e92f9c93c340032f7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:17.980410 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5deffda8-a109-4a40-b75b-b3662be6a02e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '227b8ba2b18b4c2e92f9c93c340032f7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:17.981010 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5deffda8-a109-4a40-b75b-b3662be6a02e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '227b8ba2b18b4c2e92f9c93c340032f7'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:17.992404 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1173/2344] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:37:17 2022] DELETE /identity/v3/users/227b8ba2b18b4c2e92f9c93c340032f7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:18.299837 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c7ed7-735f-41c0-a98f-9e88efd1888a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:18.301132 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-1d2c7ed7-735f-41c0-a98f-9e88efd1888a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:18.330351 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c7ed7-735f-41c0-a98f-9e88efd1888a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:18.388013 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156e96e-ad2f-46c3-ab65-7ebe4e72088e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:18.388873 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156e96e-ad2f-46c3-ab65-7ebe4e72088e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:18.389159 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156e96e-ad2f-46c3-ab65-7ebe4e72088e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:18.393561 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156e96e-ad2f-46c3-ab65-7ebe4e72088e admin admin] PATH_INFO: `/v3/projects/e8b50034133e4a7a929021fd5e3b5901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:18.394988 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156e96e-ad2f-46c3-ab65-7ebe4e72088e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8b50034133e4a7a929021fd5e3b5901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:18.397352 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156e96e-ad2f-46c3-ab65-7ebe4e72088e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:18.452483 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9156e96e-ad2f-46c3-ab65-7ebe4e72088e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8b50034133e4a7a929021fd5e3b5901', 'request_id': 'req-9156e96e-ad2f-46c3-ab65-7ebe4e72088e'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:18.461786 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9156e96e-ad2f-46c3-ab65-7ebe4e72088e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8b50034133e4a7a929021fd5e3b5901', 'request_id': 'req-9156e96e-ad2f-46c3-ab65-7ebe4e72088e'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:18.467464 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9156e96e-ad2f-46c3-ab65-7ebe4e72088e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8b50034133e4a7a929021fd5e3b5901', 'request_id': 'req-9156e96e-ad2f-46c3-ab65-7ebe4e72088e'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:18.478395 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9156e96e-ad2f-46c3-ab65-7ebe4e72088e admin admin] The token cache is being invalidate because project e8b50034133e4a7a929021fd5e3b5901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:37:18.478684 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9156e96e-ad2f-46c3-ab65-7ebe4e72088e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:18.479365 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9156e96e-ad2f-46c3-ab65-7ebe4e72088e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:18.481223 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1172/2345] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:37:18 2022] DELETE /identity/v3/projects/e8b50034133e4a7a929021fd5e3b5901 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:18.486462 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d850a-1a15-4503-8b95-a7827930d388 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:18.486944 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d850a-1a15-4503-8b95-a7827930d388 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:18.487081 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d850a-1a15-4503-8b95-a7827930d388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:18.507396 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-7d9d850a-1a15-4503-8b95-a7827930d388 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:18.508615 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7d9d850a-1a15-4503-8b95-a7827930d388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:18.566550 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1174/2346] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:37:18.574165 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa823f45-f85b-4464-8e20-9b25e71b6ad2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:18.574457 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa823f45-f85b-4464-8e20-9b25e71b6ad2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:18.574739 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa823f45-f85b-4464-8e20-9b25e71b6ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:18.592767 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-aa823f45-f85b-4464-8e20-9b25e71b6ad2 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:18.593933 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-aa823f45-f85b-4464-8e20-9b25e71b6ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:18.601881 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1173/2347] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:18.605967 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d850a-1a15-4503-8b95-a7827930d388 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:18.615956 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d850a-1a15-4503-8b95-a7827930d388 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:18.620526 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e91bd-e905-4426-b27a-5cceab3d0303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:18.621161 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e91bd-e905-4426-b27a-5cceab3d0303 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:18.621473 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e91bd-e905-4426-b27a-5cceab3d0303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:18.621747 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e91bd-e905-4426-b27a-5cceab3d0303 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:18.622460 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e91bd-e905-4426-b27a-5cceab3d0303 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:37:18.622766 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e91bd-e905-4426-b27a-5cceab3d0303 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:18.624360 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e91bd-e905-4426-b27a-5cceab3d0303 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:18.636080 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1175/2348] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:37:18.639974 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa823f45-f85b-4464-8e20-9b25e71b6ad2 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:18.648892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa823f45-f85b-4464-8e20-9b25e71b6ad2 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:18.653558 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838c5c0-1197-4a5f-b884-ec92ab0779a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:18.654194 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838c5c0-1197-4a5f-b884-ec92ab0779a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:18.654476 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838c5c0-1197-4a5f-b884-ec92ab0779a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:18.654777 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838c5c0-1197-4a5f-b884-ec92ab0779a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:18.655468 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838c5c0-1197-4a5f-b884-ec92ab0779a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:18.657425 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838c5c0-1197-4a5f-b884-ec92ab0779a7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:18.682543 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1174/2349] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:37:18 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:18.686685 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e91bd-e905-4426-b27a-5cceab3d0303 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:18.696966 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e91bd-e905-4426-b27a-5cceab3d0303 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:18.752444 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157057c4-b6a7-46cc-b824-45f8265647e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:18.753164 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157057c4-b6a7-46cc-b824-45f8265647e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:18.753467 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157057c4-b6a7-46cc-b824-45f8265647e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:18.753739 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157057c4-b6a7-46cc-b824-45f8265647e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:18.754428 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157057c4-b6a7-46cc-b824-45f8265647e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:18.756335 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157057c4-b6a7-46cc-b824-45f8265647e3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:18.775684 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1176/2350] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:37:18 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:37:18.779761 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838c5c0-1197-4a5f-b884-ec92ab0779a7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:18.790365 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838c5c0-1197-4a5f-b884-ec92ab0779a7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:18.795189 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119126f1-57d0-4656-833e-220e3963cace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:18.795828 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119126f1-57d0-4656-833e-220e3963cace admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:18.796114 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119126f1-57d0-4656-833e-220e3963cace admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:18.796383 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119126f1-57d0-4656-833e-220e3963cace admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:18.797127 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119126f1-57d0-4656-833e-220e3963cace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:18.798876 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119126f1-57d0-4656-833e-220e3963cace admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:18.808737 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1175/2351] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:18.813085 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157057c4-b6a7-46cc-b824-45f8265647e3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:18.822848 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157057c4-b6a7-46cc-b824-45f8265647e3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:18.827520 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce9c00-3751-4302-8f2e-ff605ebeb61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:18.828719 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce9c00-3751-4302-8f2e-ff605ebeb61d admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:18.828998 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce9c00-3751-4302-8f2e-ff605ebeb61d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:18.829309 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce9c00-3751-4302-8f2e-ff605ebeb61d admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:18.830023 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce9c00-3751-4302-8f2e-ff605ebeb61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:18.831596 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce9c00-3751-4302-8f2e-ff605ebeb61d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:18.841253 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1177/2352] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:18.845303 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119126f1-57d0-4656-833e-220e3963cace admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:18.854939 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119126f1-57d0-4656-833e-220e3963cace admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:18.859597 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba3ba3-6678-45ba-8af9-69d386e99c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:18.860458 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba3ba3-6678-45ba-8af9-69d386e99c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:18.860740 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba3ba3-6678-45ba-8af9-69d386e99c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:18.861018 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba3ba3-6678-45ba-8af9-69d386e99c1a admin admin] PATH_INFO: `/v3/projects/086f8305698c42cd8af42e8d0735a6d4/users/1481f121b20f4243ab94669b057779af/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:18.876442 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba3ba3-6678-45ba-8af9-69d386e99c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=086f8305698c42cd8af42e8d0735a6d4, user_id=1481f121b20f4243ab94669b057779af, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:18.879175 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba3ba3-6678-45ba-8af9-69d386e99c1a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:18.892319 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1176/2353] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:18 2022] PUT /identity/v3/projects/086f8305698c42cd8af42e8d0735a6d4/users/1481f121b20f4243ab94669b057779af/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:18.902595 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39989ba9-dc14-4b8a-839b-c3b57bbb0d18 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:18.902884 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39989ba9-dc14-4b8a-839b-c3b57bbb0d18 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:18.903156 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39989ba9-dc14-4b8a-839b-c3b57bbb0d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:18.931220 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-39989ba9-dc14-4b8a-839b-c3b57bbb0d18 None None] MFA Rules not processed for user `1481f121b20f4243ab94669b057779af`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:18.932426 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-39989ba9-dc14-4b8a-839b-c3b57bbb0d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:18.993383 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1178/2354] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:18.997855 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba3ba3-6678-45ba-8af9-69d386e99c1a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:19.056326 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba3ba3-6678-45ba-8af9-69d386e99c1a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:19.060792 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6689b-4b96-4ff6-b7b4-31f915c3bc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:19.061472 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6689b-4b96-4ff6-b7b4-31f915c3bc94 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:19.061757 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6689b-4b96-4ff6-b7b4-31f915c3bc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:19.062516 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6689b-4b96-4ff6-b7b4-31f915c3bc94 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:19.063183 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6689b-4b96-4ff6-b7b4-31f915c3bc94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:19.065085 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6689b-4b96-4ff6-b7b4-31f915c3bc94 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:19.089075 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1177/2355] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:37:18 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:19.093154 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39989ba9-dc14-4b8a-839b-c3b57bbb0d18 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:19.104404 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39989ba9-dc14-4b8a-839b-c3b57bbb0d18 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:19.157591 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923ed86-afe4-4001-b885-d8dc7f9e289e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:19.158247 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923ed86-afe4-4001-b885-d8dc7f9e289e admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:19.158531 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923ed86-afe4-4001-b885-d8dc7f9e289e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:19.158808 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923ed86-afe4-4001-b885-d8dc7f9e289e admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:19.159501 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923ed86-afe4-4001-b885-d8dc7f9e289e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:19.161433 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923ed86-afe4-4001-b885-d8dc7f9e289e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:19.180507 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1179/2356] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:37:19 2022] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:19.184547 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6689b-4b96-4ff6-b7b4-31f915c3bc94 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:19.195102 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6689b-4b96-4ff6-b7b4-31f915c3bc94 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:19.200806 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18281f71-6539-46f9-aae6-4c33dfe33de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:19.201605 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18281f71-6539-46f9-aae6-4c33dfe33de8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:19.201605 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18281f71-6539-46f9-aae6-4c33dfe33de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:19.201605 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18281f71-6539-46f9-aae6-4c33dfe33de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:19.204676 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18281f71-6539-46f9-aae6-4c33dfe33de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:19.206293 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18281f71-6539-46f9-aae6-4c33dfe33de8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:19.219701 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1178/2357] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:19.224324 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923ed86-afe4-4001-b885-d8dc7f9e289e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:19.234720 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923ed86-afe4-4001-b885-d8dc7f9e289e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:19.239339 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93c2c4-2a05-4103-96a9-718ee4a077be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:19.240204 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93c2c4-2a05-4103-96a9-718ee4a077be admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:19.240481 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93c2c4-2a05-4103-96a9-718ee4a077be admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:19.240752 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b93c2c4-2a05-4103-96a9-718ee4a077be admin admin] PATH_INFO: `/v3/projects/3fc2ac3ab5894771aacb08c903610510/users/37843852800743d680f0dfa2cad11665/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:19.254878 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93c2c4-2a05-4103-96a9-718ee4a077be admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fc2ac3ab5894771aacb08c903610510, user_id=37843852800743d680f0dfa2cad11665, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:19.257558 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b93c2c4-2a05-4103-96a9-718ee4a077be admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:19.270616 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1180/2358] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:19 2022] PUT /identity/v3/projects/3fc2ac3ab5894771aacb08c903610510/users/37843852800743d680f0dfa2cad11665/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:19.274461 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18281f71-6539-46f9-aae6-4c33dfe33de8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:19.284723 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18281f71-6539-46f9-aae6-4c33dfe33de8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:19.338605 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f99458-32ff-4da3-ba21-f2f9f0686fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:19.339269 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f99458-32ff-4da3-ba21-f2f9f0686fdd admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:19.339554 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f99458-32ff-4da3-ba21-f2f9f0686fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:19.339832 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f99458-32ff-4da3-ba21-f2f9f0686fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:19.340554 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f99458-32ff-4da3-ba21-f2f9f0686fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:19.342262 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f99458-32ff-4da3-ba21-f2f9f0686fdd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:19.355074 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1179/2359] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:19.356764 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93c2c4-2a05-4103-96a9-718ee4a077be admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:19.367546 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b93c2c4-2a05-4103-96a9-718ee4a077be admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:19.372442 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87f9dc-ccef-4363-8c55-8447bcd574e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:19.373543 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87f9dc-ccef-4363-8c55-8447bcd574e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:19.373889 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87f9dc-ccef-4363-8c55-8447bcd574e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:19.374232 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87f9dc-ccef-4363-8c55-8447bcd574e8 admin admin] PATH_INFO: `/v3/projects/3fc2ac3ab5894771aacb08c903610510/users/37843852800743d680f0dfa2cad11665/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:19.376536 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87f9dc-ccef-4363-8c55-8447bcd574e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fc2ac3ab5894771aacb08c903610510, user_id=37843852800743d680f0dfa2cad11665, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:19.379439 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87f9dc-ccef-4363-8c55-8447bcd574e8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:19.392024 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1181/2360] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:19 2022] PUT /identity/v3/projects/3fc2ac3ab5894771aacb08c903610510/users/37843852800743d680f0dfa2cad11665/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:19.403149 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43870021-5655-4571-a396-e5dd6348df59 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:19.403446 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43870021-5655-4571-a396-e5dd6348df59 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:19.403706 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43870021-5655-4571-a396-e5dd6348df59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:19.434137 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-43870021-5655-4571-a396-e5dd6348df59 None None] MFA Rules not processed for user `37843852800743d680f0dfa2cad11665`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:19.435473 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-43870021-5655-4571-a396-e5dd6348df59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:19.510488 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1180/2361] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:19.520748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87f9dc-ccef-4363-8c55-8447bcd574e8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:19.522543 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2a87f9dc-ccef-4363-8c55-8447bcd574e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:19.581236 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87f9dc-ccef-4363-8c55-8447bcd574e8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:19.584963 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d80c7-56de-4803-9e51-14d93d506a50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:19.585645 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d80c7-56de-4803-9e51-14d93d506a50 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:19.585926 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d80c7-56de-4803-9e51-14d93d506a50 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:19.586198 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d80c7-56de-4803-9e51-14d93d506a50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:19.595769 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d80c7-56de-4803-9e51-14d93d506a50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:19.597201 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d80c7-56de-4803-9e51-14d93d506a50 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:19.606804 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1182/2362] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:37:19.690861 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43870021-5655-4571-a396-e5dd6348df59 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:19.700403 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43870021-5655-4571-a396-e5dd6348df59 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:19.704134 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0652f98-b2fd-4365-8a8f-0bdacfa1f0cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:19.704770 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0652f98-b2fd-4365-8a8f-0bdacfa1f0cc service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:19.705072 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0652f98-b2fd-4365-8a8f-0bdacfa1f0cc service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:19.705379 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0652f98-b2fd-4365-8a8f-0bdacfa1f0cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:19.766451 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0652f98-b2fd-4365-8a8f-0bdacfa1f0cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:19.767896 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0652f98-b2fd-4365-8a8f-0bdacfa1f0cc service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:19.776489 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1181/2363] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:37:20.022133 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d80c7-56de-4803-9e51-14d93d506a50 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:20.080967 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d80c7-56de-4803-9e51-14d93d506a50 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:20.085395 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dd024-6480-49a8-86e7-a10a8ef18d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:20.086233 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dd024-6480-49a8-86e7-a10a8ef18d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:20.086503 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dd024-6480-49a8-86e7-a10a8ef18d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:20.086764 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dd024-6480-49a8-86e7-a10a8ef18d28 admin admin] PATH_INFO: `/v3/users/1481f121b20f4243ab94669b057779af` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:20.087914 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dd024-6480-49a8-86e7-a10a8ef18d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1481f121b20f4243ab94669b057779af)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:20.089851 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dd024-6480-49a8-86e7-a10a8ef18d28 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:20.134437 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3a4dd024-6480-49a8-86e7-a10a8ef18d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1481f121b20f4243ab94669b057779af'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:20.141345 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3a4dd024-6480-49a8-86e7-a10a8ef18d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1481f121b20f4243ab94669b057779af'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:20.152159 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3a4dd024-6480-49a8-86e7-a10a8ef18d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1481f121b20f4243ab94669b057779af'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:20.152807 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3a4dd024-6480-49a8-86e7-a10a8ef18d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1481f121b20f4243ab94669b057779af'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:20.153426 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3a4dd024-6480-49a8-86e7-a10a8ef18d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1481f121b20f4243ab94669b057779af'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:20.166269 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1183/2364] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:37:20 2022] DELETE /identity/v3/users/1481f121b20f4243ab94669b057779af => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:20.171002 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3272987-ab14-4cda-91a7-7cdae0981c23 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:20.171997 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3272987-ab14-4cda-91a7-7cdae0981c23 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:20.172216 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3272987-ab14-4cda-91a7-7cdae0981c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:20.189185 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-a3272987-ab14-4cda-91a7-7cdae0981c23 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:20.190404 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a3272987-ab14-4cda-91a7-7cdae0981c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:20.247177 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1182/2365] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:37:20.256679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dd024-6480-49a8-86e7-a10a8ef18d28 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:20.258142 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3a4dd024-6480-49a8-86e7-a10a8ef18d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:20.313827 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dd024-6480-49a8-86e7-a10a8ef18d28 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:20.317466 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d54e46-47c1-4512-98d9-dcac699f58c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:20.318094 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d54e46-47c1-4512-98d9-dcac699f58c6 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:20.318377 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d54e46-47c1-4512-98d9-dcac699f58c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:20.318648 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d54e46-47c1-4512-98d9-dcac699f58c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:20.327367 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d54e46-47c1-4512-98d9-dcac699f58c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:20.328794 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d54e46-47c1-4512-98d9-dcac699f58c6 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:20.338013 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1184/2366] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:37:20.760605 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3272987-ab14-4cda-91a7-7cdae0981c23 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:20.762565 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a3272987-ab14-4cda-91a7-7cdae0981c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:20.787279 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3272987-ab14-4cda-91a7-7cdae0981c23 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:20.793239 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab59a0-7565-4017-90d5-2360a0dbaf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:20.794142 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab59a0-7565-4017-90d5-2360a0dbaf9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:20.794410 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab59a0-7565-4017-90d5-2360a0dbaf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:20.794681 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab59a0-7565-4017-90d5-2360a0dbaf9b admin admin] PATH_INFO: `/v3/projects/086f8305698c42cd8af42e8d0735a6d4` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:20.797117 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab59a0-7565-4017-90d5-2360a0dbaf9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=086f8305698c42cd8af42e8d0735a6d4)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:20.800207 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab59a0-7565-4017-90d5-2360a0dbaf9b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:20.884295 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-afab59a0-7565-4017-90d5-2360a0dbaf9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '086f8305698c42cd8af42e8d0735a6d4', 'request_id': 'req-afab59a0-7565-4017-90d5-2360a0dbaf9b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:20.893713 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-afab59a0-7565-4017-90d5-2360a0dbaf9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '086f8305698c42cd8af42e8d0735a6d4', 'request_id': 'req-afab59a0-7565-4017-90d5-2360a0dbaf9b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:20.900250 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-afab59a0-7565-4017-90d5-2360a0dbaf9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '086f8305698c42cd8af42e8d0735a6d4', 'request_id': 'req-afab59a0-7565-4017-90d5-2360a0dbaf9b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:20.913397 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-afab59a0-7565-4017-90d5-2360a0dbaf9b admin admin] The token cache is being invalidate because project 086f8305698c42cd8af42e8d0735a6d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:37:20.913678 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-afab59a0-7565-4017-90d5-2360a0dbaf9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:20.914820 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-afab59a0-7565-4017-90d5-2360a0dbaf9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:20.916578 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1183/2367] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:37:20 2022] DELETE /identity/v3/projects/086f8305698c42cd8af42e8d0735a6d4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:20.920698 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d54e46-47c1-4512-98d9-dcac699f58c6 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:20.931995 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d54e46-47c1-4512-98d9-dcac699f58c6 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:20.995359 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683bb0d-7827-45b8-8ff6-156d4d263e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:20.996153 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683bb0d-7827-45b8-8ff6-156d4d263e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:20.996431 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683bb0d-7827-45b8-8ff6-156d4d263e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:20.996702 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683bb0d-7827-45b8-8ff6-156d4d263e73 admin admin] PATH_INFO: `/v3/users/37843852800743d680f0dfa2cad11665` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:20.998094 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683bb0d-7827-45b8-8ff6-156d4d263e73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37843852800743d680f0dfa2cad11665)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:21.000816 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683bb0d-7827-45b8-8ff6-156d4d263e73 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:21.050177 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1683bb0d-7827-45b8-8ff6-156d4d263e73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37843852800743d680f0dfa2cad11665'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:21.065708 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1683bb0d-7827-45b8-8ff6-156d4d263e73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37843852800743d680f0dfa2cad11665'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:21.077758 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1683bb0d-7827-45b8-8ff6-156d4d263e73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37843852800743d680f0dfa2cad11665'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:21.078570 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1683bb0d-7827-45b8-8ff6-156d4d263e73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37843852800743d680f0dfa2cad11665'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:21.079245 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-1683bb0d-7827-45b8-8ff6-156d4d263e73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37843852800743d680f0dfa2cad11665'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:21.096605 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1185/2368] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:37:20 2022] DELETE /identity/v3/users/37843852800743d680f0dfa2cad11665 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:21.394997 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab59a0-7565-4017-90d5-2360a0dbaf9b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:21.396907 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-afab59a0-7565-4017-90d5-2360a0dbaf9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:21.412345 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab59a0-7565-4017-90d5-2360a0dbaf9b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:21.470140 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ea6ba-4ec2-4148-ac2b-22aaeebb02a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:21.471044 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ea6ba-4ec2-4148-ac2b-22aaeebb02a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:21.471328 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ea6ba-4ec2-4148-ac2b-22aaeebb02a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:21.471627 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ea6ba-4ec2-4148-ac2b-22aaeebb02a4 admin admin] PATH_INFO: `/v3/projects/3fc2ac3ab5894771aacb08c903610510` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:21.472924 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ea6ba-4ec2-4148-ac2b-22aaeebb02a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fc2ac3ab5894771aacb08c903610510)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:21.474934 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ea6ba-4ec2-4148-ac2b-22aaeebb02a4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:21.519750 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-599ea6ba-4ec2-4148-ac2b-22aaeebb02a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fc2ac3ab5894771aacb08c903610510', 'request_id': 'req-599ea6ba-4ec2-4148-ac2b-22aaeebb02a4'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:21.526295 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-599ea6ba-4ec2-4148-ac2b-22aaeebb02a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fc2ac3ab5894771aacb08c903610510', 'request_id': 'req-599ea6ba-4ec2-4148-ac2b-22aaeebb02a4'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:21.532266 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-599ea6ba-4ec2-4148-ac2b-22aaeebb02a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fc2ac3ab5894771aacb08c903610510', 'request_id': 'req-599ea6ba-4ec2-4148-ac2b-22aaeebb02a4'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:21.543000 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-599ea6ba-4ec2-4148-ac2b-22aaeebb02a4 admin admin] The token cache is being invalidate because project 3fc2ac3ab5894771aacb08c903610510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:37:21.543285 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-599ea6ba-4ec2-4148-ac2b-22aaeebb02a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:21.543914 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-599ea6ba-4ec2-4148-ac2b-22aaeebb02a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:21.545559 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1184/2369] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:37:21 2022] DELETE /identity/v3/projects/3fc2ac3ab5894771aacb08c903610510 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:21.550495 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19d43f-27f7-472a-aae6-76478ba4f437 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:21.550789 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19d43f-27f7-472a-aae6-76478ba4f437 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:21.551069 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19d43f-27f7-472a-aae6-76478ba4f437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:21.568131 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-6e19d43f-27f7-472a-aae6-76478ba4f437 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:21.569368 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6e19d43f-27f7-472a-aae6-76478ba4f437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:21.627940 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1186/2370] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:21.635856 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddbd47-cd83-44c2-a8a0-ac1e8e913882 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:21.636144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddbd47-cd83-44c2-a8a0-ac1e8e913882 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:21.636424 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddbd47-cd83-44c2-a8a0-ac1e8e913882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:21.654263 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-e6ddbd47-cd83-44c2-a8a0-ac1e8e913882 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:21.655483 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e6ddbd47-cd83-44c2-a8a0-ac1e8e913882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:21.664265 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1185/2371] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:21.672312 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19d43f-27f7-472a-aae6-76478ba4f437 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:21.681940 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19d43f-27f7-472a-aae6-76478ba4f437 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:21.686599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e8512-f492-4382-b1f9-ca21ef944d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:21.687824 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e8512-f492-4382-b1f9-ca21ef944d38 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:21.688123 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e8512-f492-4382-b1f9-ca21ef944d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:21.688452 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e8512-f492-4382-b1f9-ca21ef944d38 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:21.689170 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e8512-f492-4382-b1f9-ca21ef944d38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:37:21.689503 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e8512-f492-4382-b1f9-ca21ef944d38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:21.691095 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e8512-f492-4382-b1f9-ca21ef944d38 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:21.702592 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1187/2372] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:37:21.707398 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddbd47-cd83-44c2-a8a0-ac1e8e913882 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:21.718564 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddbd47-cd83-44c2-a8a0-ac1e8e913882 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:21.723424 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81dc21-d31e-4b55-84ee-f85620e5cf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:21.724077 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81dc21-d31e-4b55-84ee-f85620e5cf2f admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:21.724386 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81dc21-d31e-4b55-84ee-f85620e5cf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:21.724660 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81dc21-d31e-4b55-84ee-f85620e5cf2f admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:21.725381 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81dc21-d31e-4b55-84ee-f85620e5cf2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:21.727338 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81dc21-d31e-4b55-84ee-f85620e5cf2f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:21.756986 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1186/2373] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:37:21 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:21.758327 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e8512-f492-4382-b1f9-ca21ef944d38 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:21.769954 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e8512-f492-4382-b1f9-ca21ef944d38 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:21.830205 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fed54-9267-4249-b95e-e1a9689b508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:21.830877 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fed54-9267-4249-b95e-e1a9689b508b admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:21.831158 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fed54-9267-4249-b95e-e1a9689b508b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:21.831430 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fed54-9267-4249-b95e-e1a9689b508b admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:21.832118 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fed54-9267-4249-b95e-e1a9689b508b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:21.834175 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fed54-9267-4249-b95e-e1a9689b508b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:21.856019 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1188/2374] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:37:21 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:37:21.860748 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81dc21-d31e-4b55-84ee-f85620e5cf2f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:21.871880 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81dc21-d31e-4b55-84ee-f85620e5cf2f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:21.876721 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da5ef9-44f8-4da6-9966-3a8a61cddba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:21.877405 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da5ef9-44f8-4da6-9966-3a8a61cddba3 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:21.877737 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da5ef9-44f8-4da6-9966-3a8a61cddba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:21.878014 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da5ef9-44f8-4da6-9966-3a8a61cddba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:21.878888 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da5ef9-44f8-4da6-9966-3a8a61cddba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:21.880567 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da5ef9-44f8-4da6-9966-3a8a61cddba3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:21.895956 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1187/2375] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:21.899763 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fed54-9267-4249-b95e-e1a9689b508b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:21.910478 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fed54-9267-4249-b95e-e1a9689b508b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:21.915681 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aca3b2-d08c-4520-9c77-7d0b7c3285cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:21.916343 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aca3b2-d08c-4520-9c77-7d0b7c3285cc admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:21.916626 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aca3b2-d08c-4520-9c77-7d0b7c3285cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:21.916898 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aca3b2-d08c-4520-9c77-7d0b7c3285cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:21.917921 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aca3b2-d08c-4520-9c77-7d0b7c3285cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:21.919525 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aca3b2-d08c-4520-9c77-7d0b7c3285cc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:21.931603 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1189/2376] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:21.938853 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da5ef9-44f8-4da6-9966-3a8a61cddba3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:21.948841 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da5ef9-44f8-4da6-9966-3a8a61cddba3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:21.954915 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6e9c8-a0f1-4b34-be05-09f7a9fc384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:21.955924 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6e9c8-a0f1-4b34-be05-09f7a9fc384e admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:21.956207 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6e9c8-a0f1-4b34-be05-09f7a9fc384e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:21.956482 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6e9c8-a0f1-4b34-be05-09f7a9fc384e admin admin] PATH_INFO: `/v3/projects/c4b178fee8f0425795cb68bc949785a3/users/7d9859792e8b4bde8b1cc808c89858f9/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:21.972078 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6e9c8-a0f1-4b34-be05-09f7a9fc384e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b178fee8f0425795cb68bc949785a3, user_id=7d9859792e8b4bde8b1cc808c89858f9, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:21.974886 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e6e9c8-a0f1-4b34-be05-09f7a9fc384e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:21.993143 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1188/2377] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:21 2022] PUT /identity/v3/projects/c4b178fee8f0425795cb68bc949785a3/users/7d9859792e8b4bde8b1cc808c89858f9/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:22.005105 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217253a-df49-4f21-b0b6-6fe8151157b0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:22.005713 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217253a-df49-4f21-b0b6-6fe8151157b0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:22.006025 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217253a-df49-4f21-b0b6-6fe8151157b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:22.037416 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-c217253a-df49-4f21-b0b6-6fe8151157b0 None None] MFA Rules not processed for user `7d9859792e8b4bde8b1cc808c89858f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:22.038737 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c217253a-df49-4f21-b0b6-6fe8151157b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:22.102378 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1190/2378] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:37:22.113781 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6e9c8-a0f1-4b34-be05-09f7a9fc384e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:22.115503 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e0e6e9c8-a0f1-4b34-be05-09f7a9fc384e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:22.192129 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e6e9c8-a0f1-4b34-be05-09f7a9fc384e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:22.195901 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2d639-d996-452e-8bd4-110ee5ec5604 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8e4a7763524f4190c5cd66e27b5910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:22.196535 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2d639-d996-452e-8bd4-110ee5ec5604 service glance] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:22.196816 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2d639-d996-452e-8bd4-110ee5ec5604 service glance] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:22.197091 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2d639-d996-452e-8bd4-110ee5ec5604 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:22.205982 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2d639-d996-452e-8bd4-110ee5ec5604 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:22.207430 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2d639-d996-452e-8bd4-110ee5ec5604 service glance] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:22.216097 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1189/2379] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:37:25.616605 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217253a-df49-4f21-b0b6-6fe8151157b0 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:25.619013 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c217253a-df49-4f21-b0b6-6fe8151157b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:25.734261 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217253a-df49-4f21-b0b6-6fe8151157b0 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:25.739343 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26723d2e-6da2-481a-9abd-3b79c5face37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:25.740471 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26723d2e-6da2-481a-9abd-3b79c5face37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:25.740925 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26723d2e-6da2-481a-9abd-3b79c5face37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:25.741200 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26723d2e-6da2-481a-9abd-3b79c5face37 admin admin] PATH_INFO: `/v3/users/e83de12959394ba5a75f5881741540a8` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:25.742650 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26723d2e-6da2-481a-9abd-3b79c5face37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e83de12959394ba5a75f5881741540a8)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:25.744658 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26723d2e-6da2-481a-9abd-3b79c5face37 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:25.818427 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-26723d2e-6da2-481a-9abd-3b79c5face37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e83de12959394ba5a75f5881741540a8'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:25.839966 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-26723d2e-6da2-481a-9abd-3b79c5face37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e83de12959394ba5a75f5881741540a8'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:25.854513 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-26723d2e-6da2-481a-9abd-3b79c5face37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e83de12959394ba5a75f5881741540a8'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:25.855223 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-26723d2e-6da2-481a-9abd-3b79c5face37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e83de12959394ba5a75f5881741540a8'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:25.855837 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-26723d2e-6da2-481a-9abd-3b79c5face37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e83de12959394ba5a75f5881741540a8'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:25.870184 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1191/2380] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:37:25 2022] DELETE /identity/v3/users/e83de12959394ba5a75f5881741540a8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:26.074045 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2d639-d996-452e-8bd4-110ee5ec5604 service glance] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:26.088260 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2d639-d996-452e-8bd4-110ee5ec5604 service glance] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:26.161040 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b2a9a-75ed-4c99-8b9a-26a64598a411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:26.161947 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b2a9a-75ed-4c99-8b9a-26a64598a411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:26.162227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b2a9a-75ed-4c99-8b9a-26a64598a411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:26.162496 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b2a9a-75ed-4c99-8b9a-26a64598a411 admin admin] PATH_INFO: `/v3/projects/971394cccbfa49b584616f61ed5eb8a2` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:26.163728 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b2a9a-75ed-4c99-8b9a-26a64598a411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=971394cccbfa49b584616f61ed5eb8a2)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:26.165722 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b2a9a-75ed-4c99-8b9a-26a64598a411 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:26.213522 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ee8b2a9a-75ed-4c99-8b9a-26a64598a411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '971394cccbfa49b584616f61ed5eb8a2', 'request_id': 'req-ee8b2a9a-75ed-4c99-8b9a-26a64598a411'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:26.222879 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ee8b2a9a-75ed-4c99-8b9a-26a64598a411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '971394cccbfa49b584616f61ed5eb8a2', 'request_id': 'req-ee8b2a9a-75ed-4c99-8b9a-26a64598a411'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:26.228697 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ee8b2a9a-75ed-4c99-8b9a-26a64598a411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '971394cccbfa49b584616f61ed5eb8a2', 'request_id': 'req-ee8b2a9a-75ed-4c99-8b9a-26a64598a411'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:26.240424 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ee8b2a9a-75ed-4c99-8b9a-26a64598a411 admin admin] The token cache is being invalidate because project 971394cccbfa49b584616f61ed5eb8a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:37:26.240708 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ee8b2a9a-75ed-4c99-8b9a-26a64598a411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:26.241581 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ee8b2a9a-75ed-4c99-8b9a-26a64598a411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:26.243127 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1190/2381] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:37:26 2022] DELETE /identity/v3/projects/971394cccbfa49b584616f61ed5eb8a2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:26.248083 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ffd5-d63e-49f2-8385-5062423bc586 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:26.248366 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ffd5-d63e-49f2-8385-5062423bc586 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:26.248636 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ffd5-d63e-49f2-8385-5062423bc586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:26.268692 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-9c04ffd5-d63e-49f2-8385-5062423bc586 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:26.269931 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9c04ffd5-d63e-49f2-8385-5062423bc586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:26.331590 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1192/2382] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:26.339477 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae974f8b-e57e-4e4b-8f36-5e1938ccc9d7 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:26.339836 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae974f8b-e57e-4e4b-8f36-5e1938ccc9d7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:26.340179 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae974f8b-e57e-4e4b-8f36-5e1938ccc9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:26.360650 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ae974f8b-e57e-4e4b-8f36-5e1938ccc9d7 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:26.361887 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ae974f8b-e57e-4e4b-8f36-5e1938ccc9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:26.369844 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1191/2383] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:26.373938 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04ffd5-d63e-49f2-8385-5062423bc586 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:26.383380 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04ffd5-d63e-49f2-8385-5062423bc586 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:26.387835 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a25f8-ad13-4f9a-bb3f-cbbe27008025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:26.388464 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a25f8-ad13-4f9a-bb3f-cbbe27008025 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:26.388740 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a25f8-ad13-4f9a-bb3f-cbbe27008025 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:26.389007 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a25f8-ad13-4f9a-bb3f-cbbe27008025 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:26.389747 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a25f8-ad13-4f9a-bb3f-cbbe27008025 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:37:26.390070 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a25f8-ad13-4f9a-bb3f-cbbe27008025 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:26.391647 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a25f8-ad13-4f9a-bb3f-cbbe27008025 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:26.402622 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1193/2384] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:37:26.407248 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae974f8b-e57e-4e4b-8f36-5e1938ccc9d7 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:26.421182 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae974f8b-e57e-4e4b-8f36-5e1938ccc9d7 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:26.422782 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ebc6c-aadf-4645-9611-4f271ba1b2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:26.423445 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ebc6c-aadf-4645-9611-4f271ba1b2bc admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:26.423722 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ebc6c-aadf-4645-9611-4f271ba1b2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:26.423987 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ebc6c-aadf-4645-9611-4f271ba1b2bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:26.424704 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ebc6c-aadf-4645-9611-4f271ba1b2bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:26.426650 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ebc6c-aadf-4645-9611-4f271ba1b2bc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:26.451664 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1192/2385] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:37:26 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:26.455652 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a25f8-ad13-4f9a-bb3f-cbbe27008025 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:26.465490 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a25f8-ad13-4f9a-bb3f-cbbe27008025 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:26.517722 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5ba9b-8d7b-42c0-85d7-cd959fe86f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:26.518364 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5ba9b-8d7b-42c0-85d7-cd959fe86f76 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:26.518646 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5ba9b-8d7b-42c0-85d7-cd959fe86f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:26.518912 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5ba9b-8d7b-42c0-85d7-cd959fe86f76 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:26.519582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5ba9b-8d7b-42c0-85d7-cd959fe86f76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:26.521695 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e5ba9b-8d7b-42c0-85d7-cd959fe86f76 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:26.545114 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1194/2386] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:37:26 2022] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:26.549541 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ebc6c-aadf-4645-9611-4f271ba1b2bc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:26.559471 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ebc6c-aadf-4645-9611-4f271ba1b2bc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:26.564092 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc4fb7-09f4-404f-9c95-e5f033c5a21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:26.564731 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc4fb7-09f4-404f-9c95-e5f033c5a21f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:26.565009 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc4fb7-09f4-404f-9c95-e5f033c5a21f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:26.565308 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc4fb7-09f4-404f-9c95-e5f033c5a21f admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:26.566035 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc4fb7-09f4-404f-9c95-e5f033c5a21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:26.567747 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc4fb7-09f4-404f-9c95-e5f033c5a21f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:26.586696 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1193/2387] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:26.590953 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5ba9b-8d7b-42c0-85d7-cd959fe86f76 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:26.601541 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5ba9b-8d7b-42c0-85d7-cd959fe86f76 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:26.606547 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412464a3-5cc3-4ceb-b390-617026ac5fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:26.607335 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412464a3-5cc3-4ceb-b390-617026ac5fcd admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:26.607748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412464a3-5cc3-4ceb-b390-617026ac5fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:26.608063 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412464a3-5cc3-4ceb-b390-617026ac5fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:26.609446 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412464a3-5cc3-4ceb-b390-617026ac5fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:26.612623 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412464a3-5cc3-4ceb-b390-617026ac5fcd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:26.628995 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1195/2388] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:26.633361 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc4fb7-09f4-404f-9c95-e5f033c5a21f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:26.643617 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc4fb7-09f4-404f-9c95-e5f033c5a21f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:26.648315 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2269ee-af21-409b-9097-86aca0c5e6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:26.649176 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2269ee-af21-409b-9097-86aca0c5e6d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:26.649509 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2269ee-af21-409b-9097-86aca0c5e6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:26.649784 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2269ee-af21-409b-9097-86aca0c5e6d8 admin admin] PATH_INFO: `/v3/projects/89e84e510d094126a993c6a889c3c067/users/888c491782644f9da67393f31752ebe2/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:26.665131 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2269ee-af21-409b-9097-86aca0c5e6d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89e84e510d094126a993c6a889c3c067, user_id=888c491782644f9da67393f31752ebe2, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:26.668136 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2269ee-af21-409b-9097-86aca0c5e6d8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:26.681894 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1194/2389] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:26 2022] PUT /identity/v3/projects/89e84e510d094126a993c6a889c3c067/users/888c491782644f9da67393f31752ebe2/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:26.691824 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53ec93-b12b-48f8-973b-5125dbf3189e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:26.692114 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53ec93-b12b-48f8-973b-5125dbf3189e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:26.692420 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53ec93-b12b-48f8-973b-5125dbf3189e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:26.721016 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2a53ec93-b12b-48f8-973b-5125dbf3189e None None] MFA Rules not processed for user `888c491782644f9da67393f31752ebe2`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:26.722370 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2a53ec93-b12b-48f8-973b-5125dbf3189e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:26.786947 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1196/2390] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:26.796431 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2269ee-af21-409b-9097-86aca0c5e6d8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:26.798132 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2c2269ee-af21-409b-9097-86aca0c5e6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:26.864815 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2269ee-af21-409b-9097-86aca0c5e6d8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:26.869817 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa965cd-30b4-4a18-b562-7c42bbb83256 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:26.870570 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa965cd-30b4-4a18-b562-7c42bbb83256 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:26.871275 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa965cd-30b4-4a18-b562-7c42bbb83256 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:26.871275 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa965cd-30b4-4a18-b562-7c42bbb83256 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:26.885572 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa965cd-30b4-4a18-b562-7c42bbb83256 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:26.887089 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa965cd-30b4-4a18-b562-7c42bbb83256 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:26.897462 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1195/2391] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:37:38.290628 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53ec93-b12b-48f8-973b-5125dbf3189e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:38.352052 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53ec93-b12b-48f8-973b-5125dbf3189e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:38.356642 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f09ba-c06b-4858-be11-be3d3843e467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:38.357533 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f09ba-c06b-4858-be11-be3d3843e467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:38.357818 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f09ba-c06b-4858-be11-be3d3843e467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:38.358094 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f09ba-c06b-4858-be11-be3d3843e467 admin admin] PATH_INFO: `/v3/users/888c491782644f9da67393f31752ebe2` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:38.359291 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f09ba-c06b-4858-be11-be3d3843e467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=888c491782644f9da67393f31752ebe2)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:38.361231 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f09ba-c06b-4858-be11-be3d3843e467 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:38.416315 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-004f09ba-c06b-4858-be11-be3d3843e467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '888c491782644f9da67393f31752ebe2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:38.423330 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-004f09ba-c06b-4858-be11-be3d3843e467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '888c491782644f9da67393f31752ebe2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:38.434750 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-004f09ba-c06b-4858-be11-be3d3843e467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '888c491782644f9da67393f31752ebe2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:38.435443 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-004f09ba-c06b-4858-be11-be3d3843e467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '888c491782644f9da67393f31752ebe2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:38.436038 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-004f09ba-c06b-4858-be11-be3d3843e467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '888c491782644f9da67393f31752ebe2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:38.448734 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1197/2392] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:37:38 2022] DELETE /identity/v3/users/888c491782644f9da67393f31752ebe2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:38.453946 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05d95e-834f-4b16-b308-03bc172a27e2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:38.454413 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05d95e-834f-4b16-b308-03bc172a27e2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:38.454507 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05d95e-834f-4b16-b308-03bc172a27e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:38.471282 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-7c05d95e-834f-4b16-b308-03bc172a27e2 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:38.472516 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7c05d95e-834f-4b16-b308-03bc172a27e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:38.527514 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1196/2393] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:38.537176 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f09ba-c06b-4858-be11-be3d3843e467 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:38.538597 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-004f09ba-c06b-4858-be11-be3d3843e467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:38.593527 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f09ba-c06b-4858-be11-be3d3843e467 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:38.597729 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8107e71-78f9-4f6c-8a49-989941f98e46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:38.598045 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8107e71-78f9-4f6c-8a49-989941f98e46 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:38.598323 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8107e71-78f9-4f6c-8a49-989941f98e46 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:38.598594 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8107e71-78f9-4f6c-8a49-989941f98e46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:38.607402 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8107e71-78f9-4f6c-8a49-989941f98e46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:38.608826 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8107e71-78f9-4f6c-8a49-989941f98e46 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:38.617981 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1198/2394] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:37:38.874476 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05d95e-834f-4b16-b308-03bc172a27e2 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:38.875887 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7c05d95e-834f-4b16-b308-03bc172a27e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:38.888819 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05d95e-834f-4b16-b308-03bc172a27e2 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:38.894262 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc0c882-3a39-47c8-ab11-2c905fdd2545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:38.895125 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0c882-3a39-47c8-ab11-2c905fdd2545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:38.895402 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0c882-3a39-47c8-ab11-2c905fdd2545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:38.895674 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0c882-3a39-47c8-ab11-2c905fdd2545 admin admin] PATH_INFO: `/v3/projects/89e84e510d094126a993c6a889c3c067` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:38.896904 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0c882-3a39-47c8-ab11-2c905fdd2545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89e84e510d094126a993c6a889c3c067)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:38.898851 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc0c882-3a39-47c8-ab11-2c905fdd2545 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:38.944395 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ebc0c882-3a39-47c8-ab11-2c905fdd2545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89e84e510d094126a993c6a889c3c067', 'request_id': 'req-ebc0c882-3a39-47c8-ab11-2c905fdd2545'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:38.951409 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ebc0c882-3a39-47c8-ab11-2c905fdd2545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89e84e510d094126a993c6a889c3c067', 'request_id': 'req-ebc0c882-3a39-47c8-ab11-2c905fdd2545'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:38.957117 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ebc0c882-3a39-47c8-ab11-2c905fdd2545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89e84e510d094126a993c6a889c3c067', 'request_id': 'req-ebc0c882-3a39-47c8-ab11-2c905fdd2545'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:38.968448 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ebc0c882-3a39-47c8-ab11-2c905fdd2545 admin admin] The token cache is being invalidate because project 89e84e510d094126a993c6a889c3c067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:37:38.968725 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ebc0c882-3a39-47c8-ab11-2c905fdd2545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:38.969421 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ebc0c882-3a39-47c8-ab11-2c905fdd2545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:38.971012 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1197/2395] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:37:38 2022] DELETE /identity/v3/projects/89e84e510d094126a993c6a889c3c067 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:38.976435 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6a245-7e49-4e34-a884-00e2fe613547 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:38.976833 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6a245-7e49-4e34-a884-00e2fe613547 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:38.977211 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6a245-7e49-4e34-a884-00e2fe613547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:38.999842 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-fce6a245-7e49-4e34-a884-00e2fe613547 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:39.001493 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-fce6a245-7e49-4e34-a884-00e2fe613547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:39.065088 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1199/2396] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:39.072645 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff621f3e-5b21-4be4-b3e2-b62dae9fc9a4 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:39.072927 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff621f3e-5b21-4be4-b3e2-b62dae9fc9a4 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:39.073196 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff621f3e-5b21-4be4-b3e2-b62dae9fc9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:39.091659 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ff621f3e-5b21-4be4-b3e2-b62dae9fc9a4 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:39.092886 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ff621f3e-5b21-4be4-b3e2-b62dae9fc9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:39.100537 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1198/2397] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:39.104591 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6a245-7e49-4e34-a884-00e2fe613547 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:39.113990 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6a245-7e49-4e34-a884-00e2fe613547 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:39.118631 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe08eb1-7816-4f79-99ee-d2a5f19cab59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:39.119291 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe08eb1-7816-4f79-99ee-d2a5f19cab59 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:39.119572 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe08eb1-7816-4f79-99ee-d2a5f19cab59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:39.119869 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe08eb1-7816-4f79-99ee-d2a5f19cab59 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:39.120572 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe08eb1-7816-4f79-99ee-d2a5f19cab59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:37:39.120879 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe08eb1-7816-4f79-99ee-d2a5f19cab59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:39.122532 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe08eb1-7816-4f79-99ee-d2a5f19cab59 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:39.134389 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1200/2398] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:37:39.138490 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff621f3e-5b21-4be4-b3e2-b62dae9fc9a4 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:39.148032 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff621f3e-5b21-4be4-b3e2-b62dae9fc9a4 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:39.152717 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c56e7c-f546-45c4-94c8-0eff00fb877d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:39.153383 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c56e7c-f546-45c4-94c8-0eff00fb877d admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:39.153666 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c56e7c-f546-45c4-94c8-0eff00fb877d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:39.153937 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c56e7c-f546-45c4-94c8-0eff00fb877d admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:39.154630 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c56e7c-f546-45c4-94c8-0eff00fb877d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:39.156551 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c56e7c-f546-45c4-94c8-0eff00fb877d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:39.181170 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1199/2399] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:37:39 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:39.185882 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe08eb1-7816-4f79-99ee-d2a5f19cab59 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:39.199437 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe08eb1-7816-4f79-99ee-d2a5f19cab59 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:39.256437 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957051c-0da7-4c76-a53c-b31338de0cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:39.257102 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957051c-0da7-4c76-a53c-b31338de0cfe admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:39.257412 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957051c-0da7-4c76-a53c-b31338de0cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:39.257686 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957051c-0da7-4c76-a53c-b31338de0cfe admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:39.258384 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957051c-0da7-4c76-a53c-b31338de0cfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:39.260334 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957051c-0da7-4c76-a53c-b31338de0cfe admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:39.279343 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1201/2400] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:37:39 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:39.283560 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c56e7c-f546-45c4-94c8-0eff00fb877d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:39.293769 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c56e7c-f546-45c4-94c8-0eff00fb877d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:39.298350 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6253b7b-9516-4fbc-8efd-2e438cfc570f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:39.298995 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6253b7b-9516-4fbc-8efd-2e438cfc570f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:39.299273 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6253b7b-9516-4fbc-8efd-2e438cfc570f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:39.299546 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6253b7b-9516-4fbc-8efd-2e438cfc570f admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:39.300267 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6253b7b-9516-4fbc-8efd-2e438cfc570f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:39.301906 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6253b7b-9516-4fbc-8efd-2e438cfc570f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:39.312440 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1200/2401] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:39.316385 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957051c-0da7-4c76-a53c-b31338de0cfe admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:39.325867 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957051c-0da7-4c76-a53c-b31338de0cfe admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:39.331082 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19549ec7-af6a-453d-8941-4ff9cee020b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:39.331721 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19549ec7-af6a-453d-8941-4ff9cee020b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:39.331998 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19549ec7-af6a-453d-8941-4ff9cee020b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:39.332267 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19549ec7-af6a-453d-8941-4ff9cee020b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:39.332983 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19549ec7-af6a-453d-8941-4ff9cee020b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:39.334607 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19549ec7-af6a-453d-8941-4ff9cee020b5 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:39.344260 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1202/2402] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:39.348411 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6253b7b-9516-4fbc-8efd-2e438cfc570f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:39.357983 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6253b7b-9516-4fbc-8efd-2e438cfc570f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:39.362512 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103611d9-0b63-42a4-8f43-fa6e1db29eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:39.363360 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103611d9-0b63-42a4-8f43-fa6e1db29eba admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:39.363633 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103611d9-0b63-42a4-8f43-fa6e1db29eba admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:39.363901 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103611d9-0b63-42a4-8f43-fa6e1db29eba admin admin] PATH_INFO: `/v3/projects/3d38d320a60c4b5bbb8bb8d9fdd5b42c/users/d1a9df71e915461d8fc8774d5657205f/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:39.378120 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103611d9-0b63-42a4-8f43-fa6e1db29eba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d38d320a60c4b5bbb8bb8d9fdd5b42c, user_id=d1a9df71e915461d8fc8774d5657205f, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:39.380754 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103611d9-0b63-42a4-8f43-fa6e1db29eba admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:39.394198 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1201/2403] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:39 2022] PUT /identity/v3/projects/3d38d320a60c4b5bbb8bb8d9fdd5b42c/users/d1a9df71e915461d8fc8774d5657205f/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:37:39.404332 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4b43d-be51-4695-9ac7-0b4439daa4d2 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:39.404621 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4b43d-be51-4695-9ac7-0b4439daa4d2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:39.404923 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4b43d-be51-4695-9ac7-0b4439daa4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:39.436107 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-49e4b43d-be51-4695-9ac7-0b4439daa4d2 None None] MFA Rules not processed for user `d1a9df71e915461d8fc8774d5657205f`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:39.438806 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-49e4b43d-be51-4695-9ac7-0b4439daa4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:39.519206 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1203/2404] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:39.524126 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103611d9-0b63-42a4-8f43-fa6e1db29eba admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:39.583215 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103611d9-0b63-42a4-8f43-fa6e1db29eba admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:39.587694 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bced679-24b3-4c4e-8336-b553e2b071a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:39.588332 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bced679-24b3-4c4e-8336-b553e2b071a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:39.588607 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bced679-24b3-4c4e-8336-b553e2b071a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:39.588878 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bced679-24b3-4c4e-8336-b553e2b071a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:39.589594 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bced679-24b3-4c4e-8336-b553e2b071a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:39.591530 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bced679-24b3-4c4e-8336-b553e2b071a9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:39.618333 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1202/2405] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:37:39 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:39.622413 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4b43d-be51-4695-9ac7-0b4439daa4d2 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:39.633956 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4b43d-be51-4695-9ac7-0b4439daa4d2 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:39.688482 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c899bc1-9737-4d7e-bc97-ae374010fb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:39.689174 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c899bc1-9737-4d7e-bc97-ae374010fb5d admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:39.689502 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c899bc1-9737-4d7e-bc97-ae374010fb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:39.689761 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c899bc1-9737-4d7e-bc97-ae374010fb5d admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:39.690453 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c899bc1-9737-4d7e-bc97-ae374010fb5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:39.692370 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c899bc1-9737-4d7e-bc97-ae374010fb5d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:39.712168 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1204/2406] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:37:39 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:37:39.716232 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bced679-24b3-4c4e-8336-b553e2b071a9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:39.726560 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bced679-24b3-4c4e-8336-b553e2b071a9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:39.731181 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d8ec8-cca1-4b7d-b13b-f0c530684df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:39.731842 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d8ec8-cca1-4b7d-b13b-f0c530684df2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:39.732106 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d8ec8-cca1-4b7d-b13b-f0c530684df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:39.732379 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d8ec8-cca1-4b7d-b13b-f0c530684df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:39.733668 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d8ec8-cca1-4b7d-b13b-f0c530684df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:39.735258 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d8ec8-cca1-4b7d-b13b-f0c530684df2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:39.745370 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1203/2407] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:39.750183 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c899bc1-9737-4d7e-bc97-ae374010fb5d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:39.759922 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c899bc1-9737-4d7e-bc97-ae374010fb5d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:39.764466 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4f9be-b0a7-4848-8ee9-2ecb3d4e1cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:39.765352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4f9be-b0a7-4848-8ee9-2ecb3d4e1cbf admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:39.765629 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4f9be-b0a7-4848-8ee9-2ecb3d4e1cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:39.765891 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4f9be-b0a7-4848-8ee9-2ecb3d4e1cbf admin admin] PATH_INFO: `/v3/projects/2ed2a1f18b6e448cb760512da8ed3026/users/eef770fcc37843fc8a5ec921d806e598/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:39.779684 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4f9be-b0a7-4848-8ee9-2ecb3d4e1cbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed2a1f18b6e448cb760512da8ed3026, user_id=eef770fcc37843fc8a5ec921d806e598, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:39.782408 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4f9be-b0a7-4848-8ee9-2ecb3d4e1cbf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:39.795062 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1205/2408] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:39 2022] PUT /identity/v3/projects/2ed2a1f18b6e448cb760512da8ed3026/users/eef770fcc37843fc8a5ec921d806e598/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:37:39.799593 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d8ec8-cca1-4b7d-b13b-f0c530684df2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:39.809489 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d8ec8-cca1-4b7d-b13b-f0c530684df2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:39.863535 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf2287-4472-4f1b-8864-234480dd3af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:39.864113 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf2287-4472-4f1b-8864-234480dd3af2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:39.864387 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf2287-4472-4f1b-8864-234480dd3af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:39.864654 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf2287-4472-4f1b-8864-234480dd3af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:39.865408 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf2287-4472-4f1b-8864-234480dd3af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:39.867033 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf2287-4472-4f1b-8864-234480dd3af2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:39.876365 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1204/2409] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:39.880530 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4f9be-b0a7-4848-8ee9-2ecb3d4e1cbf admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:39.890516 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4f9be-b0a7-4848-8ee9-2ecb3d4e1cbf admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:39.895078 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2ede8-3f19-4a52-96be-3cd5c8416450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:39.895934 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2ede8-3f19-4a52-96be-3cd5c8416450 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:39.896208 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2ede8-3f19-4a52-96be-3cd5c8416450 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:39.896472 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb2ede8-3f19-4a52-96be-3cd5c8416450 admin admin] PATH_INFO: `/v3/projects/2ed2a1f18b6e448cb760512da8ed3026/users/eef770fcc37843fc8a5ec921d806e598/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:39.898461 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2ede8-3f19-4a52-96be-3cd5c8416450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed2a1f18b6e448cb760512da8ed3026, user_id=eef770fcc37843fc8a5ec921d806e598, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:39.901118 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb2ede8-3f19-4a52-96be-3cd5c8416450 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:39.911795 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1206/2410] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:39 2022] PUT /identity/v3/projects/2ed2a1f18b6e448cb760512da8ed3026/users/eef770fcc37843fc8a5ec921d806e598/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:39.923994 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e649e-c977-4db0-89b6-aceb5287be73 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:39.924282 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e649e-c977-4db0-89b6-aceb5287be73 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:39.924558 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e649e-c977-4db0-89b6-aceb5287be73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:39.950822 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-536e649e-c977-4db0-89b6-aceb5287be73 None None] MFA Rules not processed for user `eef770fcc37843fc8a5ec921d806e598`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:39.952033 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-536e649e-c977-4db0-89b6-aceb5287be73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:40.019487 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1205/2411] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:40.029430 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2ede8-3f19-4a52-96be-3cd5c8416450 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:40.031173 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4bb2ede8-3f19-4a52-96be-3cd5c8416450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:40.085610 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb2ede8-3f19-4a52-96be-3cd5c8416450 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:40.089153 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e104217-ff39-4bcf-bc9e-3fddea387ecd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:40.089803 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e104217-ff39-4bcf-bc9e-3fddea387ecd service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:40.090081 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e104217-ff39-4bcf-bc9e-3fddea387ecd service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:40.090351 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e104217-ff39-4bcf-bc9e-3fddea387ecd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:40.098991 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e104217-ff39-4bcf-bc9e-3fddea387ecd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:40.100406 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e104217-ff39-4bcf-bc9e-3fddea387ecd service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:40.109357 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1207/2412] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:37:40.176958 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e649e-c977-4db0-89b6-aceb5287be73 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:40.186869 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e649e-c977-4db0-89b6-aceb5287be73 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:40.191696 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ca8fa-68d6-4317-831e-e7304a1b836f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:40.192321 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ca8fa-68d6-4317-831e-e7304a1b836f service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:40.192603 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ca8fa-68d6-4317-831e-e7304a1b836f service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:40.192878 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ca8fa-68d6-4317-831e-e7304a1b836f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:40.246651 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ca8fa-68d6-4317-831e-e7304a1b836f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:40.248096 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ca8fa-68d6-4317-831e-e7304a1b836f service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:40.257236 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1206/2413] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:37:45.031169 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e104217-ff39-4bcf-bc9e-3fddea387ecd service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:45.032592 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4e104217-ff39-4bcf-bc9e-3fddea387ecd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:45.096156 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e104217-ff39-4bcf-bc9e-3fddea387ecd service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:45.100722 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e508cc8-d518-40ca-b8e8-a121e4e90dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:45.101611 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e508cc8-d518-40ca-b8e8-a121e4e90dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:45.101894 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e508cc8-d518-40ca-b8e8-a121e4e90dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:45.102169 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e508cc8-d518-40ca-b8e8-a121e4e90dad admin admin] PATH_INFO: `/v3/users/7d9859792e8b4bde8b1cc808c89858f9` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:45.103341 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e508cc8-d518-40ca-b8e8-a121e4e90dad admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d9859792e8b4bde8b1cc808c89858f9)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:45.105275 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e508cc8-d518-40ca-b8e8-a121e4e90dad admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:45.148991 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4e508cc8-d518-40ca-b8e8-a121e4e90dad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d9859792e8b4bde8b1cc808c89858f9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:45.156129 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4e508cc8-d518-40ca-b8e8-a121e4e90dad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d9859792e8b4bde8b1cc808c89858f9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:45.167200 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4e508cc8-d518-40ca-b8e8-a121e4e90dad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d9859792e8b4bde8b1cc808c89858f9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:45.168112 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4e508cc8-d518-40ca-b8e8-a121e4e90dad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d9859792e8b4bde8b1cc808c89858f9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:45.168713 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4e508cc8-d518-40ca-b8e8-a121e4e90dad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d9859792e8b4bde8b1cc808c89858f9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:45.181612 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1208/2414] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:37:45 2022] DELETE /identity/v3/users/7d9859792e8b4bde8b1cc808c89858f9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:45.186081 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085ee6b-e241-4948-91c7-4d5a7f3eb8c6 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:45.186546 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085ee6b-e241-4948-91c7-4d5a7f3eb8c6 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:45.186659 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085ee6b-e241-4948-91c7-4d5a7f3eb8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:45.203421 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-0085ee6b-e241-4948-91c7-4d5a7f3eb8c6 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:45.204611 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0085ee6b-e241-4948-91c7-4d5a7f3eb8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:45.260587 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1207/2415] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:45.270273 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e508cc8-d518-40ca-b8e8-a121e4e90dad admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:45.271613 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4e508cc8-d518-40ca-b8e8-a121e4e90dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:45.326110 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e508cc8-d518-40ca-b8e8-a121e4e90dad admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:45.329728 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99371173-f67f-48fa-9152-5f77fdb9342b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:45.330373 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99371173-f67f-48fa-9152-5f77fdb9342b service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:45.330656 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99371173-f67f-48fa-9152-5f77fdb9342b service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:45.330926 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99371173-f67f-48fa-9152-5f77fdb9342b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:45.339566 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99371173-f67f-48fa-9152-5f77fdb9342b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:45.340981 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99371173-f67f-48fa-9152-5f77fdb9342b service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:45.351278 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1209/2416] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:37:45.607514 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085ee6b-e241-4948-91c7-4d5a7f3eb8c6 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:45.608947 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0085ee6b-e241-4948-91c7-4d5a7f3eb8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:45.623763 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085ee6b-e241-4948-91c7-4d5a7f3eb8c6 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:45.628463 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e15e6-e165-490f-9c4d-213a030249a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:45.629337 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e15e6-e165-490f-9c4d-213a030249a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:45.629601 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e15e6-e165-490f-9c4d-213a030249a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:45.629873 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e15e6-e165-490f-9c4d-213a030249a3 admin admin] PATH_INFO: `/v3/projects/c4b178fee8f0425795cb68bc949785a3` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:45.631084 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e15e6-e165-490f-9c4d-213a030249a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4b178fee8f0425795cb68bc949785a3)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:45.632969 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e15e6-e165-490f-9c4d-213a030249a3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:45.678666 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f79e15e6-e165-490f-9c4d-213a030249a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4b178fee8f0425795cb68bc949785a3', 'request_id': 'req-f79e15e6-e165-490f-9c4d-213a030249a3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:45.685950 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f79e15e6-e165-490f-9c4d-213a030249a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4b178fee8f0425795cb68bc949785a3', 'request_id': 'req-f79e15e6-e165-490f-9c4d-213a030249a3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:45.691258 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f79e15e6-e165-490f-9c4d-213a030249a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4b178fee8f0425795cb68bc949785a3', 'request_id': 'req-f79e15e6-e165-490f-9c4d-213a030249a3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:45.711536 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f79e15e6-e165-490f-9c4d-213a030249a3 admin admin] The token cache is being invalidate because project c4b178fee8f0425795cb68bc949785a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:37:45.711784 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f79e15e6-e165-490f-9c4d-213a030249a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:45.712530 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f79e15e6-e165-490f-9c4d-213a030249a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:45.714559 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1208/2417] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:37:45 2022] DELETE /identity/v3/projects/c4b178fee8f0425795cb68bc949785a3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:45.720169 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a76ad-16e0-49ae-a3d4-af591bc2f7b3 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:45.720477 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a76ad-16e0-49ae-a3d4-af591bc2f7b3 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:45.720751 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a76ad-16e0-49ae-a3d4-af591bc2f7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:45.738644 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2a3a76ad-16e0-49ae-a3d4-af591bc2f7b3 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:45.739872 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2a3a76ad-16e0-49ae-a3d4-af591bc2f7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:45.806716 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1210/2418] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:45.814760 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac20145-4147-41c7-8a48-6285d55f5acc None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:45.815041 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac20145-4147-41c7-8a48-6285d55f5acc None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:45.815309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac20145-4147-41c7-8a48-6285d55f5acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:45.833558 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-5ac20145-4147-41c7-8a48-6285d55f5acc None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:45.834734 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5ac20145-4147-41c7-8a48-6285d55f5acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:45.842460 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1209/2419] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:45.846575 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a76ad-16e0-49ae-a3d4-af591bc2f7b3 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:45.855984 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a76ad-16e0-49ae-a3d4-af591bc2f7b3 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:45.860496 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010c0ce-1ae8-4201-9daa-23472b1d7c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:45.861137 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010c0ce-1ae8-4201-9daa-23472b1d7c6a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:45.861452 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010c0ce-1ae8-4201-9daa-23472b1d7c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:45.861720 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010c0ce-1ae8-4201-9daa-23472b1d7c6a admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:45.862431 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010c0ce-1ae8-4201-9daa-23472b1d7c6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:37:45.862732 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010c0ce-1ae8-4201-9daa-23472b1d7c6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:45.864350 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010c0ce-1ae8-4201-9daa-23472b1d7c6a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:45.875981 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1211/2420] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:37:45.880164 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac20145-4147-41c7-8a48-6285d55f5acc None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:45.889103 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac20145-4147-41c7-8a48-6285d55f5acc None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:45.894565 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6b5fc-f1dd-487d-bbe5-08e9b36ad5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:45.895211 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6b5fc-f1dd-487d-bbe5-08e9b36ad5ae admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:45.895500 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6b5fc-f1dd-487d-bbe5-08e9b36ad5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:45.895771 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6b5fc-f1dd-487d-bbe5-08e9b36ad5ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:45.896457 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6b5fc-f1dd-487d-bbe5-08e9b36ad5ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:45.898385 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6b5fc-f1dd-487d-bbe5-08e9b36ad5ae admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:45.922490 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1210/2421] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:37:45 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:45.926457 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010c0ce-1ae8-4201-9daa-23472b1d7c6a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:45.936812 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010c0ce-1ae8-4201-9daa-23472b1d7c6a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:45.990441 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3a3c9-7ddc-434e-9fd4-e6c24565fc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:45.991100 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3a3c9-7ddc-434e-9fd4-e6c24565fc80 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:45.991379 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3a3c9-7ddc-434e-9fd4-e6c24565fc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:45.991652 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3a3c9-7ddc-434e-9fd4-e6c24565fc80 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:45.992342 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3a3c9-7ddc-434e-9fd4-e6c24565fc80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:45.994306 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3a3c9-7ddc-434e-9fd4-e6c24565fc80 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:46.015307 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1212/2422] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:37:45 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:46.019296 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6b5fc-f1dd-487d-bbe5-08e9b36ad5ae admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:46.029449 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6b5fc-f1dd-487d-bbe5-08e9b36ad5ae admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:46.034048 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6fd25-d0e0-4605-8aeb-414c9f18cf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:46.034683 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6fd25-d0e0-4605-8aeb-414c9f18cf10 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:46.034956 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6fd25-d0e0-4605-8aeb-414c9f18cf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:46.035263 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6fd25-d0e0-4605-8aeb-414c9f18cf10 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:46.035936 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6fd25-d0e0-4605-8aeb-414c9f18cf10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:46.037777 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6fd25-d0e0-4605-8aeb-414c9f18cf10 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:46.048638 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1211/2423] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:46.052564 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3a3c9-7ddc-434e-9fd4-e6c24565fc80 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:46.062833 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3a3c9-7ddc-434e-9fd4-e6c24565fc80 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:46.067542 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee5ced-5f52-4a36-a9cb-f5d21bca3308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:46.068185 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee5ced-5f52-4a36-a9cb-f5d21bca3308 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:46.068466 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee5ced-5f52-4a36-a9cb-f5d21bca3308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:46.068740 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee5ced-5f52-4a36-a9cb-f5d21bca3308 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:46.069498 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee5ced-5f52-4a36-a9cb-f5d21bca3308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:46.071101 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee5ced-5f52-4a36-a9cb-f5d21bca3308 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:46.081867 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1213/2424] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:46.085623 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6fd25-d0e0-4605-8aeb-414c9f18cf10 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:46.095454 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6fd25-d0e0-4605-8aeb-414c9f18cf10 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:46.100110 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c18f7-0fec-45ae-8986-5b32249d777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:46.100980 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c18f7-0fec-45ae-8986-5b32249d777a admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:46.101277 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c18f7-0fec-45ae-8986-5b32249d777a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:46.101563 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c18f7-0fec-45ae-8986-5b32249d777a admin admin] PATH_INFO: `/v3/projects/0a7ac09d5d704203bd7bbf38f1d84dbc/users/e8c6ea88cdc140c38a8b71ccb4646d93/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:46.115345 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c18f7-0fec-45ae-8986-5b32249d777a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a7ac09d5d704203bd7bbf38f1d84dbc, user_id=e8c6ea88cdc140c38a8b71ccb4646d93, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:46.118128 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c18f7-0fec-45ae-8986-5b32249d777a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:46.130952 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1212/2425] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:46 2022] PUT /identity/v3/projects/0a7ac09d5d704203bd7bbf38f1d84dbc/users/e8c6ea88cdc140c38a8b71ccb4646d93/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:46.141955 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c32b60-5b58-42e4-bebb-fbffee61d8bf None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:46.142239 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c32b60-5b58-42e4-bebb-fbffee61d8bf None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:46.142507 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c32b60-5b58-42e4-bebb-fbffee61d8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:46.168387 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-48c32b60-5b58-42e4-bebb-fbffee61d8bf None None] MFA Rules not processed for user `e8c6ea88cdc140c38a8b71ccb4646d93`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:46.169610 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-48c32b60-5b58-42e4-bebb-fbffee61d8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:46.229496 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1214/2426] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:46.240544 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c18f7-0fec-45ae-8986-5b32249d777a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:46.242280 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6b4c18f7-0fec-45ae-8986-5b32249d777a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:46.298194 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c18f7-0fec-45ae-8986-5b32249d777a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:46.301818 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163857a-0ac9-4db9-90ba-169d58b21882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:46.302447 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163857a-0ac9-4db9-90ba-169d58b21882 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:46.302749 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163857a-0ac9-4db9-90ba-169d58b21882 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:46.303017 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163857a-0ac9-4db9-90ba-169d58b21882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:46.311123 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163857a-0ac9-4db9-90ba-169d58b21882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:46.313126 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163857a-0ac9-4db9-90ba-169d58b21882 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:46.321508 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1213/2427] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:37:53.289077 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c32b60-5b58-42e4-bebb-fbffee61d8bf None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:53.290491 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-48c32b60-5b58-42e4-bebb-fbffee61d8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:53.352818 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c32b60-5b58-42e4-bebb-fbffee61d8bf None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:53.357405 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f688cfa-d3b1-4f1a-b358-21e4db50c380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:53.358827 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f688cfa-d3b1-4f1a-b358-21e4db50c380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:53.359106 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f688cfa-d3b1-4f1a-b358-21e4db50c380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:53.359378 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f688cfa-d3b1-4f1a-b358-21e4db50c380 admin admin] PATH_INFO: `/v3/users/d1a9df71e915461d8fc8774d5657205f` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:53.360555 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f688cfa-d3b1-4f1a-b358-21e4db50c380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1a9df71e915461d8fc8774d5657205f)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:53.362498 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f688cfa-d3b1-4f1a-b358-21e4db50c380 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:53.405126 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0f688cfa-d3b1-4f1a-b358-21e4db50c380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1a9df71e915461d8fc8774d5657205f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:53.411604 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0f688cfa-d3b1-4f1a-b358-21e4db50c380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1a9df71e915461d8fc8774d5657205f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:53.423355 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0f688cfa-d3b1-4f1a-b358-21e4db50c380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1a9df71e915461d8fc8774d5657205f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:53.424030 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0f688cfa-d3b1-4f1a-b358-21e4db50c380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1a9df71e915461d8fc8774d5657205f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:53.424635 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-0f688cfa-d3b1-4f1a-b358-21e4db50c380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1a9df71e915461d8fc8774d5657205f'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:53.436729 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1215/2428] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:37:53 2022] DELETE /identity/v3/users/d1a9df71e915461d8fc8774d5657205f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:53.441302 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca4c2f-bdd8-4a8b-ab58-4ba0cd55adaa None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:53.442327 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca4c2f-bdd8-4a8b-ab58-4ba0cd55adaa None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:53.445161 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca4c2f-bdd8-4a8b-ab58-4ba0cd55adaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:53.462351 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c4ca4c2f-bdd8-4a8b-ab58-4ba0cd55adaa None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:53.463699 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c4ca4c2f-bdd8-4a8b-ab58-4ba0cd55adaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:53.520207 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1214/2429] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:53.530127 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f688cfa-d3b1-4f1a-b358-21e4db50c380 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:53.531491 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0f688cfa-d3b1-4f1a-b358-21e4db50c380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:53.585492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f688cfa-d3b1-4f1a-b358-21e4db50c380 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:53.589012 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33cd77-2902-4c40-9afc-d9d86f457a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:53.589669 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33cd77-2902-4c40-9afc-d9d86f457a71 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:53.589947 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33cd77-2902-4c40-9afc-d9d86f457a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:53.590219 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33cd77-2902-4c40-9afc-d9d86f457a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:53.599375 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33cd77-2902-4c40-9afc-d9d86f457a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:53.600787 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33cd77-2902-4c40-9afc-d9d86f457a71 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:53.610438 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1216/2430] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:37:53.865789 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca4c2f-bdd8-4a8b-ab58-4ba0cd55adaa None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:53.867228 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c4ca4c2f-bdd8-4a8b-ab58-4ba0cd55adaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:53.883104 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca4c2f-bdd8-4a8b-ab58-4ba0cd55adaa None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:53.887768 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc485c3-06b8-47f7-8fc5-c9b09edf99ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:53.888644 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc485c3-06b8-47f7-8fc5-c9b09edf99ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:53.889498 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc485c3-06b8-47f7-8fc5-c9b09edf99ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:53.889799 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc485c3-06b8-47f7-8fc5-c9b09edf99ed admin admin] PATH_INFO: `/v3/projects/3d38d320a60c4b5bbb8bb8d9fdd5b42c` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:53.891085 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc485c3-06b8-47f7-8fc5-c9b09edf99ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d38d320a60c4b5bbb8bb8d9fdd5b42c)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:53.892974 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc485c3-06b8-47f7-8fc5-c9b09edf99ed admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:53.938076 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-abc485c3-06b8-47f7-8fc5-c9b09edf99ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d38d320a60c4b5bbb8bb8d9fdd5b42c', 'request_id': 'req-abc485c3-06b8-47f7-8fc5-c9b09edf99ed'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:53.945709 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-abc485c3-06b8-47f7-8fc5-c9b09edf99ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d38d320a60c4b5bbb8bb8d9fdd5b42c', 'request_id': 'req-abc485c3-06b8-47f7-8fc5-c9b09edf99ed'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:53.950996 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-abc485c3-06b8-47f7-8fc5-c9b09edf99ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d38d320a60c4b5bbb8bb8d9fdd5b42c', 'request_id': 'req-abc485c3-06b8-47f7-8fc5-c9b09edf99ed'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:53.961940 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-abc485c3-06b8-47f7-8fc5-c9b09edf99ed admin admin] The token cache is being invalidate because project 3d38d320a60c4b5bbb8bb8d9fdd5b42c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:37:53.962219 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-abc485c3-06b8-47f7-8fc5-c9b09edf99ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:53.962838 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-abc485c3-06b8-47f7-8fc5-c9b09edf99ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:53.964379 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1215/2431] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:37:53 2022] DELETE /identity/v3/projects/3d38d320a60c4b5bbb8bb8d9fdd5b42c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:53.969069 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33cd77-2902-4c40-9afc-d9d86f457a71 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:53.978662 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33cd77-2902-4c40-9afc-d9d86f457a71 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:54.038691 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b73633-d377-46b5-9fe0-69e4c92e4b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:54.039595 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b73633-d377-46b5-9fe0-69e4c92e4b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:54.039878 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b73633-d377-46b5-9fe0-69e4c92e4b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:54.040148 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b73633-d377-46b5-9fe0-69e4c92e4b20 admin admin] PATH_INFO: `/v3/users/eef770fcc37843fc8a5ec921d806e598` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:54.041348 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b73633-d377-46b5-9fe0-69e4c92e4b20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef770fcc37843fc8a5ec921d806e598)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:54.043582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b73633-d377-46b5-9fe0-69e4c92e4b20 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:54.087608 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b9b73633-d377-46b5-9fe0-69e4c92e4b20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef770fcc37843fc8a5ec921d806e598'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:54.094828 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b9b73633-d377-46b5-9fe0-69e4c92e4b20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef770fcc37843fc8a5ec921d806e598'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:54.106482 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b9b73633-d377-46b5-9fe0-69e4c92e4b20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef770fcc37843fc8a5ec921d806e598'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:54.107406 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b9b73633-d377-46b5-9fe0-69e4c92e4b20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef770fcc37843fc8a5ec921d806e598'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:54.108731 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-b9b73633-d377-46b5-9fe0-69e4c92e4b20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef770fcc37843fc8a5ec921d806e598'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:54.123101 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1217/2432] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:37:53 2022] DELETE /identity/v3/users/eef770fcc37843fc8a5ec921d806e598 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:54.441381 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc485c3-06b8-47f7-8fc5-c9b09edf99ed admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:54.443372 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-abc485c3-06b8-47f7-8fc5-c9b09edf99ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:54.458499 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc485c3-06b8-47f7-8fc5-c9b09edf99ed admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:54.514627 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d6d27-55bf-40b0-99ad-c431cafb1e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:54.515469 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d6d27-55bf-40b0-99ad-c431cafb1e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:54.515744 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d6d27-55bf-40b0-99ad-c431cafb1e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:54.516011 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d6d27-55bf-40b0-99ad-c431cafb1e9d admin admin] PATH_INFO: `/v3/projects/2ed2a1f18b6e448cb760512da8ed3026` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:54.517198 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d6d27-55bf-40b0-99ad-c431cafb1e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed2a1f18b6e448cb760512da8ed3026)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:54.519186 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d6d27-55bf-40b0-99ad-c431cafb1e9d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:54.563420 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3d7d6d27-55bf-40b0-99ad-c431cafb1e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed2a1f18b6e448cb760512da8ed3026', 'request_id': 'req-3d7d6d27-55bf-40b0-99ad-c431cafb1e9d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:54.569796 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3d7d6d27-55bf-40b0-99ad-c431cafb1e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed2a1f18b6e448cb760512da8ed3026', 'request_id': 'req-3d7d6d27-55bf-40b0-99ad-c431cafb1e9d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:54.575213 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3d7d6d27-55bf-40b0-99ad-c431cafb1e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed2a1f18b6e448cb760512da8ed3026', 'request_id': 'req-3d7d6d27-55bf-40b0-99ad-c431cafb1e9d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:54.586334 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3d7d6d27-55bf-40b0-99ad-c431cafb1e9d admin admin] The token cache is being invalidate because project 2ed2a1f18b6e448cb760512da8ed3026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:37:54.586610 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3d7d6d27-55bf-40b0-99ad-c431cafb1e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:54.587218 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-3d7d6d27-55bf-40b0-99ad-c431cafb1e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:54.588735 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1216/2433] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:37:54 2022] DELETE /identity/v3/projects/2ed2a1f18b6e448cb760512da8ed3026 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:54.594206 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcff45d-e014-4405-a8fc-c741f7bc9be7 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:54.594719 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcff45d-e014-4405-a8fc-c741f7bc9be7 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:54.594818 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcff45d-e014-4405-a8fc-c741f7bc9be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:54.612139 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2dcff45d-e014-4405-a8fc-c741f7bc9be7 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:54.613363 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2dcff45d-e014-4405-a8fc-c741f7bc9be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:54.670569 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1218/2434] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:54.679382 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde5023-71e2-415f-9c68-b08c38aca7d1 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:54.679654 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde5023-71e2-415f-9c68-b08c38aca7d1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:54.679930 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde5023-71e2-415f-9c68-b08c38aca7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:54.697731 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-dcde5023-71e2-415f-9c68-b08c38aca7d1 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:54.698979 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-dcde5023-71e2-415f-9c68-b08c38aca7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:54.707695 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1217/2435] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:54.712170 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcff45d-e014-4405-a8fc-c741f7bc9be7 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:54.722354 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcff45d-e014-4405-a8fc-c741f7bc9be7 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:54.727204 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496db75-8e72-4f0f-a6f3-eae1c8be4080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:54.727885 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496db75-8e72-4f0f-a6f3-eae1c8be4080 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:54.728170 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496db75-8e72-4f0f-a6f3-eae1c8be4080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:54.728446 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496db75-8e72-4f0f-a6f3-eae1c8be4080 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:54.729175 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496db75-8e72-4f0f-a6f3-eae1c8be4080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:37:54.729524 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496db75-8e72-4f0f-a6f3-eae1c8be4080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:54.731148 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496db75-8e72-4f0f-a6f3-eae1c8be4080 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:54.742548 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1219/2436] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:37:54.746761 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde5023-71e2-415f-9c68-b08c38aca7d1 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:54.760599 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde5023-71e2-415f-9c68-b08c38aca7d1 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:54.766045 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f261d-9e6b-4773-ad34-59cd90c4a7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:54.766688 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f261d-9e6b-4773-ad34-59cd90c4a7c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:54.766970 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f261d-9e6b-4773-ad34-59cd90c4a7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:54.767248 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f261d-9e6b-4773-ad34-59cd90c4a7c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:54.767941 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f261d-9e6b-4773-ad34-59cd90c4a7c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:54.769920 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f261d-9e6b-4773-ad34-59cd90c4a7c0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:54.794697 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1218/2437] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:37:54 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:37:54.798702 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496db75-8e72-4f0f-a6f3-eae1c8be4080 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:54.808352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496db75-8e72-4f0f-a6f3-eae1c8be4080 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:54.862119 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e1bc2-8ccb-432a-b40f-cbf79e040414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:54.862685 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e1bc2-8ccb-432a-b40f-cbf79e040414 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:54.862966 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e1bc2-8ccb-432a-b40f-cbf79e040414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:54.863238 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e1bc2-8ccb-432a-b40f-cbf79e040414 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:54.863924 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e1bc2-8ccb-432a-b40f-cbf79e040414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:54.865896 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e1bc2-8ccb-432a-b40f-cbf79e040414 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:54.884615 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1220/2438] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:37:54 2022] POST /identity/v3/users => generated 285 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:37:54.888796 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f261d-9e6b-4773-ad34-59cd90c4a7c0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:54.899292 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f261d-9e6b-4773-ad34-59cd90c4a7c0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:54.903888 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0b1ce-e4cd-4628-bcdd-824e37699a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:54.904615 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0b1ce-e4cd-4628-bcdd-824e37699a1e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:54.904905 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0b1ce-e4cd-4628-bcdd-824e37699a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:54.905178 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0b1ce-e4cd-4628-bcdd-824e37699a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:54.905934 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0b1ce-e4cd-4628-bcdd-824e37699a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:54.907536 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0b1ce-e4cd-4628-bcdd-824e37699a1e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:54.917897 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1219/2439] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:54.921788 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e1bc2-8ccb-432a-b40f-cbf79e040414 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:54.931366 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e1bc2-8ccb-432a-b40f-cbf79e040414 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:54.936528 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beddf90-3b9d-4812-9c79-44fcf174701b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:54.937162 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beddf90-3b9d-4812-9c79-44fcf174701b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:54.937469 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beddf90-3b9d-4812-9c79-44fcf174701b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:54.937740 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beddf90-3b9d-4812-9c79-44fcf174701b admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:54.938450 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beddf90-3b9d-4812-9c79-44fcf174701b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:54.940034 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beddf90-3b9d-4812-9c79-44fcf174701b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:54.949577 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1221/2440] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:54.954087 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0b1ce-e4cd-4628-bcdd-824e37699a1e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:54.963776 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0b1ce-e4cd-4628-bcdd-824e37699a1e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:54.968436 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88d093-84e6-4cb3-b5a8-ebca1a4b60f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:54.969337 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88d093-84e6-4cb3-b5a8-ebca1a4b60f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:54.969608 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88d093-84e6-4cb3-b5a8-ebca1a4b60f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:54.969883 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88d093-84e6-4cb3-b5a8-ebca1a4b60f1 admin admin] PATH_INFO: `/v3/projects/ffcd71f4b56e46a59ea396c77fcc9580/users/bcfa2505e1d34fdb933d88cf68c56879/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:54.983863 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88d093-84e6-4cb3-b5a8-ebca1a4b60f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffcd71f4b56e46a59ea396c77fcc9580, user_id=bcfa2505e1d34fdb933d88cf68c56879, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:54.986599 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88d093-84e6-4cb3-b5a8-ebca1a4b60f1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:54.999885 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1220/2441] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:54 2022] PUT /identity/v3/projects/ffcd71f4b56e46a59ea396c77fcc9580/users/bcfa2505e1d34fdb933d88cf68c56879/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:37:55.010104 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f376b7d-dbbb-44c9-a1e4-e90f45fa1316 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:55.010391 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f376b7d-dbbb-44c9-a1e4-e90f45fa1316 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:55.010663 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f376b7d-dbbb-44c9-a1e4-e90f45fa1316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:55.036562 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-2f376b7d-dbbb-44c9-a1e4-e90f45fa1316 None None] MFA Rules not processed for user `bcfa2505e1d34fdb933d88cf68c56879`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:55.037785 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-2f376b7d-dbbb-44c9-a1e4-e90f45fa1316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:55.100187 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1222/2442] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:55.104641 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88d093-84e6-4cb3-b5a8-ebca1a4b60f1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:55.163189 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88d093-84e6-4cb3-b5a8-ebca1a4b60f1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:55.168042 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec8fce-5211-4a5f-8d92-f1b488e3892b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:55.168690 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec8fce-5211-4a5f-8d92-f1b488e3892b admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:55.168972 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec8fce-5211-4a5f-8d92-f1b488e3892b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:55.169247 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec8fce-5211-4a5f-8d92-f1b488e3892b admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:55.169959 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec8fce-5211-4a5f-8d92-f1b488e3892b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:55.171912 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec8fce-5211-4a5f-8d92-f1b488e3892b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:55.195663 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1221/2443] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:37:55 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:55.199730 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f376b7d-dbbb-44c9-a1e4-e90f45fa1316 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:55.210807 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f376b7d-dbbb-44c9-a1e4-e90f45fa1316 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:55.264096 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb389d-f1bc-4c44-8239-5cbaf308a624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:55.264747 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb389d-f1bc-4c44-8239-5cbaf308a624 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:55.265026 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb389d-f1bc-4c44-8239-5cbaf308a624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:55.265326 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb389d-f1bc-4c44-8239-5cbaf308a624 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:55.266001 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb389d-f1bc-4c44-8239-5cbaf308a624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:55.267894 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb389d-f1bc-4c44-8239-5cbaf308a624 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:55.288350 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1223/2444] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:37:55 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:37:55.291998 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec8fce-5211-4a5f-8d92-f1b488e3892b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:55.304341 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec8fce-5211-4a5f-8d92-f1b488e3892b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:55.312130 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89fba2-90c3-439b-8caa-4b01789dda55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:55.312846 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89fba2-90c3-439b-8caa-4b01789dda55 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:55.313130 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89fba2-90c3-439b-8caa-4b01789dda55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:55.314128 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89fba2-90c3-439b-8caa-4b01789dda55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:55.314866 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89fba2-90c3-439b-8caa-4b01789dda55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:55.316533 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89fba2-90c3-439b-8caa-4b01789dda55 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:55.328418 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1222/2445] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:55.332375 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb389d-f1bc-4c44-8239-5cbaf308a624 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:55.343537 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb389d-f1bc-4c44-8239-5cbaf308a624 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:55.348723 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c07605-a75e-4ff4-94b3-86e3aba10021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:55.349749 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c07605-a75e-4ff4-94b3-86e3aba10021 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:55.350105 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c07605-a75e-4ff4-94b3-86e3aba10021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:55.350384 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c07605-a75e-4ff4-94b3-86e3aba10021 admin admin] PATH_INFO: `/v3/projects/5a14e66a2e984801bdae709f464680c5/users/8671c9774fb6497d9b05578ea3edd1d9/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:55.367448 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c07605-a75e-4ff4-94b3-86e3aba10021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a14e66a2e984801bdae709f464680c5, user_id=8671c9774fb6497d9b05578ea3edd1d9, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:55.370455 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c07605-a75e-4ff4-94b3-86e3aba10021 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:55.387667 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1224/2446] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:55 2022] PUT /identity/v3/projects/5a14e66a2e984801bdae709f464680c5/users/8671c9774fb6497d9b05578ea3edd1d9/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:37:55.390056 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89fba2-90c3-439b-8caa-4b01789dda55 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:55.408116 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89fba2-90c3-439b-8caa-4b01789dda55 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:55.473109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de9548-69ee-491d-b165-5e50168e4310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:55.473813 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de9548-69ee-491d-b165-5e50168e4310 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:55.474087 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de9548-69ee-491d-b165-5e50168e4310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:55.474351 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de9548-69ee-491d-b165-5e50168e4310 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:55.475064 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de9548-69ee-491d-b165-5e50168e4310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:55.476642 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de9548-69ee-491d-b165-5e50168e4310 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:55.486162 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1223/2447] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:55.490272 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c07605-a75e-4ff4-94b3-86e3aba10021 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:55.500450 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c07605-a75e-4ff4-94b3-86e3aba10021 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:55.505092 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6b357-49bd-4997-bcb4-d1ccc142d7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:55.505983 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6b357-49bd-4997-bcb4-d1ccc142d7b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:55.506263 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6b357-49bd-4997-bcb4-d1ccc142d7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:55.506531 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6b357-49bd-4997-bcb4-d1ccc142d7b3 admin admin] PATH_INFO: `/v3/projects/5a14e66a2e984801bdae709f464680c5/users/8671c9774fb6497d9b05578ea3edd1d9/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:55.508470 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6b357-49bd-4997-bcb4-d1ccc142d7b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a14e66a2e984801bdae709f464680c5, user_id=8671c9774fb6497d9b05578ea3edd1d9, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:55.511154 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6b357-49bd-4997-bcb4-d1ccc142d7b3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:55.521492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1225/2448] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:55 2022] PUT /identity/v3/projects/5a14e66a2e984801bdae709f464680c5/users/8671c9774fb6497d9b05578ea3edd1d9/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:37:55.533003 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c081c-e2c7-41f9-aca2-93f2ec5620a6 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:55.533429 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c081c-e2c7-41f9-aca2-93f2ec5620a6 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:55.533711 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c081c-e2c7-41f9-aca2-93f2ec5620a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:55.560334 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-786c081c-e2c7-41f9-aca2-93f2ec5620a6 None None] MFA Rules not processed for user `8671c9774fb6497d9b05578ea3edd1d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:55.562101 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-786c081c-e2c7-41f9-aca2-93f2ec5620a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:55.625830 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1224/2449] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:55 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:55.635651 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6b357-49bd-4997-bcb4-d1ccc142d7b3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:55.637502 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7fc6b357-49bd-4997-bcb4-d1ccc142d7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:55.693639 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6b357-49bd-4997-bcb4-d1ccc142d7b3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:55.697301 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d54262-a477-4af0-ba18-110f355cb2c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:55.697940 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d54262-a477-4af0-ba18-110f355cb2c8 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:55.698221 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d54262-a477-4af0-ba18-110f355cb2c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:55.698495 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d54262-a477-4af0-ba18-110f355cb2c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:55.707983 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d54262-a477-4af0-ba18-110f355cb2c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:55.709583 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d54262-a477-4af0-ba18-110f355cb2c8 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:55.719805 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1226/2450] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:55 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:37:56.057128 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c081c-e2c7-41f9-aca2-93f2ec5620a6 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:56.116607 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c081c-e2c7-41f9-aca2-93f2ec5620a6 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:56.121646 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e3c9c-ccdc-460f-9a79-d97a40526f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:56.122506 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e3c9c-ccdc-460f-9a79-d97a40526f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:56.122782 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e3c9c-ccdc-460f-9a79-d97a40526f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:56.123051 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e3c9c-ccdc-460f-9a79-d97a40526f4c admin admin] PATH_INFO: `/v3/users/bcfa2505e1d34fdb933d88cf68c56879` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:56.124785 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e3c9c-ccdc-460f-9a79-d97a40526f4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcfa2505e1d34fdb933d88cf68c56879)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:56.126742 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e3c9c-ccdc-460f-9a79-d97a40526f4c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:56.169514 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-976e3c9c-ccdc-460f-9a79-d97a40526f4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcfa2505e1d34fdb933d88cf68c56879'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:56.181355 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-976e3c9c-ccdc-460f-9a79-d97a40526f4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcfa2505e1d34fdb933d88cf68c56879'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:56.181963 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-976e3c9c-ccdc-460f-9a79-d97a40526f4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcfa2505e1d34fdb933d88cf68c56879'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:56.182611 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-976e3c9c-ccdc-460f-9a79-d97a40526f4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcfa2505e1d34fdb933d88cf68c56879'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:56.190580 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-976e3c9c-ccdc-460f-9a79-d97a40526f4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcfa2505e1d34fdb933d88cf68c56879'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:56.207804 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1225/2451] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:37:56 2022] DELETE /identity/v3/users/bcfa2505e1d34fdb933d88cf68c56879 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:56.213236 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10647e52-9536-4259-8f16-e54925261435 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:56.213722 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10647e52-9536-4259-8f16-e54925261435 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:56.214129 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10647e52-9536-4259-8f16-e54925261435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:56.233430 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-10647e52-9536-4259-8f16-e54925261435 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:56.234764 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-10647e52-9536-4259-8f16-e54925261435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:56.294111 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1227/2452] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:37:56.304288 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e3c9c-ccdc-460f-9a79-d97a40526f4c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:56.305837 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-976e3c9c-ccdc-460f-9a79-d97a40526f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:56.362264 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e3c9c-ccdc-460f-9a79-d97a40526f4c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:56.365915 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43c995-5964-435e-bf2f-ac59b740aee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:56.366594 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43c995-5964-435e-bf2f-ac59b740aee4 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:56.366876 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43c995-5964-435e-bf2f-ac59b740aee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:56.367170 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43c995-5964-435e-bf2f-ac59b740aee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:56.376158 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43c995-5964-435e-bf2f-ac59b740aee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:56.377654 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43c995-5964-435e-bf2f-ac59b740aee4 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:56.387012 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1226/2453] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:37:56.736963 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10647e52-9536-4259-8f16-e54925261435 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:56.739290 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-10647e52-9536-4259-8f16-e54925261435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:56.756261 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10647e52-9536-4259-8f16-e54925261435 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:56.762344 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7c541-3dde-4e0a-8810-03ed615190f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:56.763416 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7c541-3dde-4e0a-8810-03ed615190f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:56.763767 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7c541-3dde-4e0a-8810-03ed615190f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:56.764973 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7c541-3dde-4e0a-8810-03ed615190f9 admin admin] PATH_INFO: `/v3/projects/ffcd71f4b56e46a59ea396c77fcc9580` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:56.767260 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7c541-3dde-4e0a-8810-03ed615190f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffcd71f4b56e46a59ea396c77fcc9580)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:56.770068 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7c541-3dde-4e0a-8810-03ed615190f9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:56.821086 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-19c7c541-3dde-4e0a-8810-03ed615190f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffcd71f4b56e46a59ea396c77fcc9580', 'request_id': 'req-19c7c541-3dde-4e0a-8810-03ed615190f9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:56.828919 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-19c7c541-3dde-4e0a-8810-03ed615190f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffcd71f4b56e46a59ea396c77fcc9580', 'request_id': 'req-19c7c541-3dde-4e0a-8810-03ed615190f9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:56.834882 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-19c7c541-3dde-4e0a-8810-03ed615190f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffcd71f4b56e46a59ea396c77fcc9580', 'request_id': 'req-19c7c541-3dde-4e0a-8810-03ed615190f9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:56.846389 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-19c7c541-3dde-4e0a-8810-03ed615190f9 admin admin] The token cache is being invalidate because project ffcd71f4b56e46a59ea396c77fcc9580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:37:56.846682 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-19c7c541-3dde-4e0a-8810-03ed615190f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:56.847320 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-19c7c541-3dde-4e0a-8810-03ed615190f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:56.848892 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1228/2454] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:37:56 2022] DELETE /identity/v3/projects/ffcd71f4b56e46a59ea396c77fcc9580 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:56.853041 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43c995-5964-435e-bf2f-ac59b740aee4 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:56.863683 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43c995-5964-435e-bf2f-ac59b740aee4 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:56.921846 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab28e32-054c-43ad-a995-127caf88a11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:56.922714 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab28e32-054c-43ad-a995-127caf88a11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:56.922991 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab28e32-054c-43ad-a995-127caf88a11e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:56.923261 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab28e32-054c-43ad-a995-127caf88a11e admin admin] PATH_INFO: `/v3/users/8671c9774fb6497d9b05578ea3edd1d9` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:56.924440 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab28e32-054c-43ad-a995-127caf88a11e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8671c9774fb6497d9b05578ea3edd1d9)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:56.926417 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab28e32-054c-43ad-a995-127caf88a11e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:56.971121 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2ab28e32-054c-43ad-a995-127caf88a11e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8671c9774fb6497d9b05578ea3edd1d9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:56.982110 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2ab28e32-054c-43ad-a995-127caf88a11e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8671c9774fb6497d9b05578ea3edd1d9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:56.982798 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2ab28e32-054c-43ad-a995-127caf88a11e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8671c9774fb6497d9b05578ea3edd1d9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:56.983404 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2ab28e32-054c-43ad-a995-127caf88a11e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8671c9774fb6497d9b05578ea3edd1d9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:56.990604 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2ab28e32-054c-43ad-a995-127caf88a11e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8671c9774fb6497d9b05578ea3edd1d9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:57.002759 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1227/2455] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:37:56 2022] DELETE /identity/v3/users/8671c9774fb6497d9b05578ea3edd1d9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:57.282793 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7c541-3dde-4e0a-8810-03ed615190f9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:57.284408 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-19c7c541-3dde-4e0a-8810-03ed615190f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:57.313058 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7c541-3dde-4e0a-8810-03ed615190f9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:57.376556 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3c460-6cfe-4306-8260-cb8bd22b1711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:57.377439 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3c460-6cfe-4306-8260-cb8bd22b1711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:57.377719 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3c460-6cfe-4306-8260-cb8bd22b1711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:57.377986 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3c460-6cfe-4306-8260-cb8bd22b1711 admin admin] PATH_INFO: `/v3/projects/5a14e66a2e984801bdae709f464680c5` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:57.379168 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3c460-6cfe-4306-8260-cb8bd22b1711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a14e66a2e984801bdae709f464680c5)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:57.381334 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3c460-6cfe-4306-8260-cb8bd22b1711 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:57.430389 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2eb3c460-6cfe-4306-8260-cb8bd22b1711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a14e66a2e984801bdae709f464680c5', 'request_id': 'req-2eb3c460-6cfe-4306-8260-cb8bd22b1711'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:57.441566 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2eb3c460-6cfe-4306-8260-cb8bd22b1711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a14e66a2e984801bdae709f464680c5', 'request_id': 'req-2eb3c460-6cfe-4306-8260-cb8bd22b1711'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:57.447431 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2eb3c460-6cfe-4306-8260-cb8bd22b1711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a14e66a2e984801bdae709f464680c5', 'request_id': 'req-2eb3c460-6cfe-4306-8260-cb8bd22b1711'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:57.459282 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2eb3c460-6cfe-4306-8260-cb8bd22b1711 admin admin] The token cache is being invalidate because project 5a14e66a2e984801bdae709f464680c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:37:57.459570 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2eb3c460-6cfe-4306-8260-cb8bd22b1711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:57.460218 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-2eb3c460-6cfe-4306-8260-cb8bd22b1711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:37:57.461964 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1229/2456] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:37:57 2022] DELETE /identity/v3/projects/5a14e66a2e984801bdae709f464680c5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:37:57.467902 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cf3fe-5f3a-4e0b-83ea-1bec944a78ef None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:57.468258 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cf3fe-5f3a-4e0b-83ea-1bec944a78ef None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:57.468629 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cf3fe-5f3a-4e0b-83ea-1bec944a78ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:57.487007 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-338cf3fe-5f3a-4e0b-83ea-1bec944a78ef None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:57.488243 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-338cf3fe-5f3a-4e0b-83ea-1bec944a78ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:57.546338 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1228/2457] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:57.554249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a186e-bf11-4593-9adb-5f89eb10c957 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:57.554538 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a186e-bf11-4593-9adb-5f89eb10c957 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:57.554817 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a186e-bf11-4593-9adb-5f89eb10c957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:57.574698 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-509a186e-bf11-4593-9adb-5f89eb10c957 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:57.575918 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-509a186e-bf11-4593-9adb-5f89eb10c957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:57.584000 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1230/2458] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:57.588442 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cf3fe-5f3a-4e0b-83ea-1bec944a78ef None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:57.598071 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cf3fe-5f3a-4e0b-83ea-1bec944a78ef None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:57.602859 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f10f03-f3d0-451a-8059-c0bdd4ca904d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:57.603519 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f10f03-f3d0-451a-8059-c0bdd4ca904d admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:57.603803 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f10f03-f3d0-451a-8059-c0bdd4ca904d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:57.604075 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f10f03-f3d0-451a-8059-c0bdd4ca904d admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:57.604800 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f10f03-f3d0-451a-8059-c0bdd4ca904d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:37:57.605669 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f10f03-f3d0-451a-8059-c0bdd4ca904d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:57.606762 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f10f03-f3d0-451a-8059-c0bdd4ca904d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:57.619401 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1229/2459] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:37:57.624300 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a186e-bf11-4593-9adb-5f89eb10c957 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:57.633584 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a186e-bf11-4593-9adb-5f89eb10c957 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:57.638511 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836abc28-9485-402a-95e6-6e8de99ca996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:57.639194 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836abc28-9485-402a-95e6-6e8de99ca996 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:57.639473 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836abc28-9485-402a-95e6-6e8de99ca996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:57.639746 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836abc28-9485-402a-95e6-6e8de99ca996 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:57.640442 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836abc28-9485-402a-95e6-6e8de99ca996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:57.642419 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836abc28-9485-402a-95e6-6e8de99ca996 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:57.674649 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1231/2460] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:37:57 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:57.682663 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f10f03-f3d0-451a-8059-c0bdd4ca904d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:57.696901 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f10f03-f3d0-451a-8059-c0bdd4ca904d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:57.760667 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed32a5d-b9b8-4aff-bbdf-1fcd6abcb44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:57.761543 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed32a5d-b9b8-4aff-bbdf-1fcd6abcb44d admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:57.762030 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed32a5d-b9b8-4aff-bbdf-1fcd6abcb44d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:57.762306 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed32a5d-b9b8-4aff-bbdf-1fcd6abcb44d admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:57.763064 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed32a5d-b9b8-4aff-bbdf-1fcd6abcb44d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:57.765745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed32a5d-b9b8-4aff-bbdf-1fcd6abcb44d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:57.786866 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1230/2461] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:37:57 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:57.791135 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836abc28-9485-402a-95e6-6e8de99ca996 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:57.801811 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836abc28-9485-402a-95e6-6e8de99ca996 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:57.813061 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9e265-de61-4633-b2bc-aeb0de805249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:57.813895 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9e265-de61-4633-b2bc-aeb0de805249 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:57.814281 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9e265-de61-4633-b2bc-aeb0de805249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:57.814659 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9e265-de61-4633-b2bc-aeb0de805249 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:57.815584 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9e265-de61-4633-b2bc-aeb0de805249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:57.817455 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9e265-de61-4633-b2bc-aeb0de805249 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:57.830350 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1232/2462] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:57.833946 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed32a5d-b9b8-4aff-bbdf-1fcd6abcb44d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:57.844128 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed32a5d-b9b8-4aff-bbdf-1fcd6abcb44d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:57.849172 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b745492-6da8-4604-a1d4-f2dd808d595f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:57.849864 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b745492-6da8-4604-a1d4-f2dd808d595f admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:57.850148 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b745492-6da8-4604-a1d4-f2dd808d595f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:57.850420 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b745492-6da8-4604-a1d4-f2dd808d595f admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:57.851147 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b745492-6da8-4604-a1d4-f2dd808d595f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:57.853002 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b745492-6da8-4604-a1d4-f2dd808d595f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:57.866202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1231/2463] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:37:57.869981 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9e265-de61-4633-b2bc-aeb0de805249 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:57.880767 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9e265-de61-4633-b2bc-aeb0de805249 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:57.885540 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf2807-711b-4e17-afd7-98abe80c2820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:57.886421 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf2807-711b-4e17-afd7-98abe80c2820 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:57.886705 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf2807-711b-4e17-afd7-98abe80c2820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:57.886987 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf2807-711b-4e17-afd7-98abe80c2820 admin admin] PATH_INFO: `/v3/projects/8d6d8968d99a480eb013e2c62af2644d/users/734ce284c9b24baf8283b92cfe5686be/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:57.901874 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf2807-711b-4e17-afd7-98abe80c2820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6d8968d99a480eb013e2c62af2644d, user_id=734ce284c9b24baf8283b92cfe5686be, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:57.904548 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf2807-711b-4e17-afd7-98abe80c2820 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:57.917645 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1233/2464] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:57 2022] PUT /identity/v3/projects/8d6d8968d99a480eb013e2c62af2644d/users/734ce284c9b24baf8283b92cfe5686be/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:57.928667 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92782891-cc23-4cfd-b39f-4f6a578fd871 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:57.928956 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92782891-cc23-4cfd-b39f-4f6a578fd871 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:57.929227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92782891-cc23-4cfd-b39f-4f6a578fd871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:57.957321 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-92782891-cc23-4cfd-b39f-4f6a578fd871 None None] MFA Rules not processed for user `734ce284c9b24baf8283b92cfe5686be`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:57.958677 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-92782891-cc23-4cfd-b39f-4f6a578fd871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:58.026849 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1232/2465] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:58.031555 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf2807-711b-4e17-afd7-98abe80c2820 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:58.095938 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf2807-711b-4e17-afd7-98abe80c2820 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:58.101307 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf6c7b-9408-4f99-936a-794d9a56abdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:58.101960 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf6c7b-9408-4f99-936a-794d9a56abdc admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:58.102241 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf6c7b-9408-4f99-936a-794d9a56abdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:58.102512 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf6c7b-9408-4f99-936a-794d9a56abdc admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:58.103302 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf6c7b-9408-4f99-936a-794d9a56abdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:58.105203 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf6c7b-9408-4f99-936a-794d9a56abdc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:58.133317 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1234/2466] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:37:58 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:58.135008 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92782891-cc23-4cfd-b39f-4f6a578fd871 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:58.146864 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92782891-cc23-4cfd-b39f-4f6a578fd871 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:58.204001 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68eca6-3972-438b-8164-39ea02a35878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:58.204669 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68eca6-3972-438b-8164-39ea02a35878 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:58.204982 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68eca6-3972-438b-8164-39ea02a35878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:58.205279 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68eca6-3972-438b-8164-39ea02a35878 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:58.205980 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68eca6-3972-438b-8164-39ea02a35878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:58.207936 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd68eca6-3972-438b-8164-39ea02a35878 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:58.228039 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1233/2467] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:37:58 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:37:58.231958 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf6c7b-9408-4f99-936a-794d9a56abdc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:58.243423 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf6c7b-9408-4f99-936a-794d9a56abdc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:58.250115 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d94d0-c7da-4ae6-bca2-df9df6d3189b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:58.250849 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d94d0-c7da-4ae6-bca2-df9df6d3189b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:58.251132 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d94d0-c7da-4ae6-bca2-df9df6d3189b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:58.251406 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d94d0-c7da-4ae6-bca2-df9df6d3189b admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:58.252161 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d94d0-c7da-4ae6-bca2-df9df6d3189b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:58.253794 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d94d0-c7da-4ae6-bca2-df9df6d3189b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:58.267463 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1235/2468] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:58.268676 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68eca6-3972-438b-8164-39ea02a35878 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:58.279813 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68eca6-3972-438b-8164-39ea02a35878 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:58.284517 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d702488-8917-4f02-9d48-9cc5c3afb5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:58.285169 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d702488-8917-4f02-9d48-9cc5c3afb5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:58.285489 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d702488-8917-4f02-9d48-9cc5c3afb5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:58.285768 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d702488-8917-4f02-9d48-9cc5c3afb5a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:58.286495 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d702488-8917-4f02-9d48-9cc5c3afb5a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:58.288102 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d702488-8917-4f02-9d48-9cc5c3afb5a5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:58.298621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1234/2469] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:58.302736 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d94d0-c7da-4ae6-bca2-df9df6d3189b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:58.313324 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d94d0-c7da-4ae6-bca2-df9df6d3189b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:58.317924 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2fa07-a36a-4df2-94cf-48b106bfe7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:58.318788 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2fa07-a36a-4df2-94cf-48b106bfe7c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:58.319071 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2fa07-a36a-4df2-94cf-48b106bfe7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:58.319347 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2fa07-a36a-4df2-94cf-48b106bfe7c9 admin admin] PATH_INFO: `/v3/projects/d6d04d5880f342ad86a11825d9ea2591/users/d781ce573dcd4e15b7d5948e9a86710e/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:58.334322 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2fa07-a36a-4df2-94cf-48b106bfe7c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6d04d5880f342ad86a11825d9ea2591, user_id=d781ce573dcd4e15b7d5948e9a86710e, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:58.336975 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2fa07-a36a-4df2-94cf-48b106bfe7c9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:58.349640 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1236/2470] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:58 2022] PUT /identity/v3/projects/d6d04d5880f342ad86a11825d9ea2591/users/d781ce573dcd4e15b7d5948e9a86710e/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:58.361309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294e5a1-66fd-430f-8b55-1a6d6cb17049 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:58.361602 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294e5a1-66fd-430f-8b55-1a6d6cb17049 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:58.361877 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e294e5a1-66fd-430f-8b55-1a6d6cb17049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:58.387908 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-e294e5a1-66fd-430f-8b55-1a6d6cb17049 None None] MFA Rules not processed for user `d781ce573dcd4e15b7d5948e9a86710e`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:58.389174 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e294e5a1-66fd-430f-8b55-1a6d6cb17049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:58.457467 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1235/2471] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:58.462111 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2fa07-a36a-4df2-94cf-48b106bfe7c9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:58.520722 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2fa07-a36a-4df2-94cf-48b106bfe7c9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:58.525502 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca9473-5b92-409a-a77a-86313b8d58f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:58.526148 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca9473-5b92-409a-a77a-86313b8d58f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:58.526424 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca9473-5b92-409a-a77a-86313b8d58f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:58.526692 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca9473-5b92-409a-a77a-86313b8d58f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:58.527377 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca9473-5b92-409a-a77a-86313b8d58f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:58.529279 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca9473-5b92-409a-a77a-86313b8d58f2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:58.553984 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1237/2472] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:37:58 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:37:58.558170 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294e5a1-66fd-430f-8b55-1a6d6cb17049 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:58.568876 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e294e5a1-66fd-430f-8b55-1a6d6cb17049 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:58.625156 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb0950-ac46-4d1f-b0a8-100d8f6ecc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:58.625850 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb0950-ac46-4d1f-b0a8-100d8f6ecc00 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:58.626133 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb0950-ac46-4d1f-b0a8-100d8f6ecc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:58.626409 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb0950-ac46-4d1f-b0a8-100d8f6ecc00 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:58.627093 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb0950-ac46-4d1f-b0a8-100d8f6ecc00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:58.629027 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2eb0950-ac46-4d1f-b0a8-100d8f6ecc00 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:58.652739 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1236/2473] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:37:58 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:37:58.654015 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca9473-5b92-409a-a77a-86313b8d58f2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:58.664037 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca9473-5b92-409a-a77a-86313b8d58f2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:58.669537 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c19e4-56db-4682-8e0b-81b910b9c741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:58.670192 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c19e4-56db-4682-8e0b-81b910b9c741 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:58.670472 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c19e4-56db-4682-8e0b-81b910b9c741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:58.670745 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c19e4-56db-4682-8e0b-81b910b9c741 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:58.671465 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c19e4-56db-4682-8e0b-81b910b9c741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:58.673080 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c19e4-56db-4682-8e0b-81b910b9c741 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:58.683416 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1238/2474] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:58.688325 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb0950-ac46-4d1f-b0a8-100d8f6ecc00 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:58.698197 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb0950-ac46-4d1f-b0a8-100d8f6ecc00 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:58.703443 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee20eb2-2889-4d19-bc64-113f9558c55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:58.704304 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee20eb2-2889-4d19-bc64-113f9558c55b admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:58.704587 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee20eb2-2889-4d19-bc64-113f9558c55b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:58.704864 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee20eb2-2889-4d19-bc64-113f9558c55b admin admin] PATH_INFO: `/v3/projects/32525869ba17464a98b431c3cc0813b7/users/a7c4e754266d4b7bacf6061721ec87b0/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:58.720718 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee20eb2-2889-4d19-bc64-113f9558c55b admin admin] RBAC: Authorizing `identity:create_grant(project_id=32525869ba17464a98b431c3cc0813b7, user_id=a7c4e754266d4b7bacf6061721ec87b0, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:58.723438 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee20eb2-2889-4d19-bc64-113f9558c55b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:58.735928 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1237/2475] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:58 2022] PUT /identity/v3/projects/32525869ba17464a98b431c3cc0813b7/users/a7c4e754266d4b7bacf6061721ec87b0/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:58.739923 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c19e4-56db-4682-8e0b-81b910b9c741 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:58.750248 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c19e4-56db-4682-8e0b-81b910b9c741 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:58.806110 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca503abd-f124-43e6-b9b0-cc16002557d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:58.806774 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca503abd-f124-43e6-b9b0-cc16002557d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:58.807014 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca503abd-f124-43e6-b9b0-cc16002557d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:58.807285 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca503abd-f124-43e6-b9b0-cc16002557d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:58.808001 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca503abd-f124-43e6-b9b0-cc16002557d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:58.809633 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca503abd-f124-43e6-b9b0-cc16002557d9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:58.819533 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1239/2476] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:37:58.823694 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee20eb2-2889-4d19-bc64-113f9558c55b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:58.834837 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee20eb2-2889-4d19-bc64-113f9558c55b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:58.840077 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a45f51-a084-4f89-82e9-ef3a89561ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:58.840830 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a45f51-a084-4f89-82e9-ef3a89561ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:58.841108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a45f51-a084-4f89-82e9-ef3a89561ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:58.841418 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a45f51-a084-4f89-82e9-ef3a89561ecb admin admin] PATH_INFO: `/v3/projects/32525869ba17464a98b431c3cc0813b7/users/a7c4e754266d4b7bacf6061721ec87b0/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:58.844037 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a45f51-a084-4f89-82e9-ef3a89561ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=32525869ba17464a98b431c3cc0813b7, user_id=a7c4e754266d4b7bacf6061721ec87b0, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:58.847042 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a45f51-a084-4f89-82e9-ef3a89561ecb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:58.857405 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1238/2477] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:37:58 2022] PUT /identity/v3/projects/32525869ba17464a98b431c3cc0813b7/users/a7c4e754266d4b7bacf6061721ec87b0/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:37:58.868260 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e84aa-fa98-40a7-9065-a5fc70d30269 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:58.868548 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e84aa-fa98-40a7-9065-a5fc70d30269 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:58.868825 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e84aa-fa98-40a7-9065-a5fc70d30269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:58.894805 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-110e84aa-fa98-40a7-9065-a5fc70d30269 None None] MFA Rules not processed for user `a7c4e754266d4b7bacf6061721ec87b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:37:58.896009 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-110e84aa-fa98-40a7-9065-a5fc70d30269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:58.961623 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1240/2478] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:37:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:37:58.972327 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a45f51-a084-4f89-82e9-ef3a89561ecb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:58.974170 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-31a45f51-a084-4f89-82e9-ef3a89561ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:37:59.031037 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a45f51-a084-4f89-82e9-ef3a89561ecb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:59.035313 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832be828-f086-400a-be2c-e0beae4833a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:59.036047 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832be828-f086-400a-be2c-e0beae4833a6 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:59.036280 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832be828-f086-400a-be2c-e0beae4833a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:59.036584 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832be828-f086-400a-be2c-e0beae4833a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:59.047105 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832be828-f086-400a-be2c-e0beae4833a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:59.048563 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832be828-f086-400a-be2c-e0beae4833a6 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:59.068452 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1239/2479] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:37:59.100559 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e84aa-fa98-40a7-9065-a5fc70d30269 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:37:59.112224 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e84aa-fa98-40a7-9065-a5fc70d30269 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:37:59.117287 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a788d-7178-4b17-9fd6-955859b00fba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:37:59.117943 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a788d-7178-4b17-9fd6-955859b00fba service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:37:59.118221 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a788d-7178-4b17-9fd6-955859b00fba service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:37:59.118498 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a788d-7178-4b17-9fd6-955859b00fba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:37:59.175444 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a788d-7178-4b17-9fd6-955859b00fba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:37:59.176891 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a788d-7178-4b17-9fd6-955859b00fba service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:37:59.185627 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1241/2480] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:37:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:38:03.019393 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832be828-f086-400a-be2c-e0beae4833a6 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:03.081037 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832be828-f086-400a-be2c-e0beae4833a6 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:03.085660 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cdc1c-51ca-4628-bdfd-8c73c4da0f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:03.086508 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cdc1c-51ca-4628-bdfd-8c73c4da0f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:03.086785 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cdc1c-51ca-4628-bdfd-8c73c4da0f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:03.087053 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cdc1c-51ca-4628-bdfd-8c73c4da0f7f admin admin] PATH_INFO: `/v3/users/734ce284c9b24baf8283b92cfe5686be` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:03.088237 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cdc1c-51ca-4628-bdfd-8c73c4da0f7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=734ce284c9b24baf8283b92cfe5686be)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:03.090214 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06cdc1c-51ca-4628-bdfd-8c73c4da0f7f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:03.135934 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-a06cdc1c-51ca-4628-bdfd-8c73c4da0f7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '734ce284c9b24baf8283b92cfe5686be'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:03.147234 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-a06cdc1c-51ca-4628-bdfd-8c73c4da0f7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '734ce284c9b24baf8283b92cfe5686be'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:03.147892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-a06cdc1c-51ca-4628-bdfd-8c73c4da0f7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '734ce284c9b24baf8283b92cfe5686be'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:03.148497 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-a06cdc1c-51ca-4628-bdfd-8c73c4da0f7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '734ce284c9b24baf8283b92cfe5686be'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:03.156188 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-a06cdc1c-51ca-4628-bdfd-8c73c4da0f7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '734ce284c9b24baf8283b92cfe5686be'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:03.168132 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1240/2481] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:38:03 2022] DELETE /identity/v3/users/734ce284c9b24baf8283b92cfe5686be => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:38:03.173214 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e81e1-5cfd-4497-a988-d9b373d38c61 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:03.173698 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e81e1-5cfd-4497-a988-d9b373d38c61 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:03.173805 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e81e1-5cfd-4497-a988-d9b373d38c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:03.190120 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0c1e81e1-5cfd-4497-a988-d9b373d38c61 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:38:03.191299 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0c1e81e1-5cfd-4497-a988-d9b373d38c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:03.246311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1242/2482] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:38:03.255755 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cdc1c-51ca-4628-bdfd-8c73c4da0f7f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:03.257134 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a06cdc1c-51ca-4628-bdfd-8c73c4da0f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:03.310827 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cdc1c-51ca-4628-bdfd-8c73c4da0f7f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:03.314442 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de85dfd-6c9c-44ed-a2a7-9111e3fa5141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:03.315071 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de85dfd-6c9c-44ed-a2a7-9111e3fa5141 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:03.315346 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de85dfd-6c9c-44ed-a2a7-9111e3fa5141 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:03.315615 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de85dfd-6c9c-44ed-a2a7-9111e3fa5141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:03.324233 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de85dfd-6c9c-44ed-a2a7-9111e3fa5141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:03.325696 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de85dfd-6c9c-44ed-a2a7-9111e3fa5141 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:03.334968 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1241/2483] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:38:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:38:03.589972 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e81e1-5cfd-4497-a988-d9b373d38c61 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:03.591400 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0c1e81e1-5cfd-4497-a988-d9b373d38c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:03.605400 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e81e1-5cfd-4497-a988-d9b373d38c61 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:03.610675 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bf8a3-4c7f-426d-b6e1-a723ce23c19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:03.611526 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bf8a3-4c7f-426d-b6e1-a723ce23c19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:03.611807 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bf8a3-4c7f-426d-b6e1-a723ce23c19e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:03.612080 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bf8a3-4c7f-426d-b6e1-a723ce23c19e admin admin] PATH_INFO: `/v3/projects/8d6d8968d99a480eb013e2c62af2644d` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:03.613329 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bf8a3-4c7f-426d-b6e1-a723ce23c19e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d6d8968d99a480eb013e2c62af2644d)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:03.615252 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08bf8a3-4c7f-426d-b6e1-a723ce23c19e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:03.661939 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c08bf8a3-4c7f-426d-b6e1-a723ce23c19e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d6d8968d99a480eb013e2c62af2644d', 'request_id': 'req-c08bf8a3-4c7f-426d-b6e1-a723ce23c19e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:03.669283 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c08bf8a3-4c7f-426d-b6e1-a723ce23c19e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d6d8968d99a480eb013e2c62af2644d', 'request_id': 'req-c08bf8a3-4c7f-426d-b6e1-a723ce23c19e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:03.675324 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c08bf8a3-4c7f-426d-b6e1-a723ce23c19e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d6d8968d99a480eb013e2c62af2644d', 'request_id': 'req-c08bf8a3-4c7f-426d-b6e1-a723ce23c19e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:03.686630 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c08bf8a3-4c7f-426d-b6e1-a723ce23c19e admin admin] The token cache is being invalidate because project 8d6d8968d99a480eb013e2c62af2644d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:38:03.686914 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c08bf8a3-4c7f-426d-b6e1-a723ce23c19e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:03.687537 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c08bf8a3-4c7f-426d-b6e1-a723ce23c19e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:03.689059 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1243/2484] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:38:03 2022] DELETE /identity/v3/projects/8d6d8968d99a480eb013e2c62af2644d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:38:03.693100 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de85dfd-6c9c-44ed-a2a7-9111e3fa5141 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:03.702927 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de85dfd-6c9c-44ed-a2a7-9111e3fa5141 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:03.756238 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918fdd2-16a3-4428-86b1-be6166a65829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:03.757017 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918fdd2-16a3-4428-86b1-be6166a65829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:03.757325 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918fdd2-16a3-4428-86b1-be6166a65829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:03.757604 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918fdd2-16a3-4428-86b1-be6166a65829 admin admin] PATH_INFO: `/v3/users/d781ce573dcd4e15b7d5948e9a86710e` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:03.758863 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918fdd2-16a3-4428-86b1-be6166a65829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d781ce573dcd4e15b7d5948e9a86710e)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:03.760936 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918fdd2-16a3-4428-86b1-be6166a65829 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:03.804323 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e918fdd2-16a3-4428-86b1-be6166a65829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd781ce573dcd4e15b7d5948e9a86710e'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:03.816597 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e918fdd2-16a3-4428-86b1-be6166a65829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd781ce573dcd4e15b7d5948e9a86710e'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:03.817938 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e918fdd2-16a3-4428-86b1-be6166a65829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd781ce573dcd4e15b7d5948e9a86710e'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:03.817938 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e918fdd2-16a3-4428-86b1-be6166a65829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd781ce573dcd4e15b7d5948e9a86710e'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:03.826930 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e918fdd2-16a3-4428-86b1-be6166a65829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd781ce573dcd4e15b7d5948e9a86710e'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:03.838896 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1242/2485] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:38:03 2022] DELETE /identity/v3/users/d781ce573dcd4e15b7d5948e9a86710e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:38:04.091892 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bf8a3-4c7f-426d-b6e1-a723ce23c19e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:04.093340 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c08bf8a3-4c7f-426d-b6e1-a723ce23c19e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:04.106101 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08bf8a3-4c7f-426d-b6e1-a723ce23c19e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:04.165271 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d063f-3035-4ee1-991c-75bbbee7a3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:04.166160 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d063f-3035-4ee1-991c-75bbbee7a3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:04.166425 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d063f-3035-4ee1-991c-75bbbee7a3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:04.166695 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d063f-3035-4ee1-991c-75bbbee7a3dc admin admin] PATH_INFO: `/v3/projects/d6d04d5880f342ad86a11825d9ea2591` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:04.168130 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d063f-3035-4ee1-991c-75bbbee7a3dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6d04d5880f342ad86a11825d9ea2591)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:04.170088 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d063f-3035-4ee1-991c-75bbbee7a3dc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:04.217042 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-609d063f-3035-4ee1-991c-75bbbee7a3dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6d04d5880f342ad86a11825d9ea2591', 'request_id': 'req-609d063f-3035-4ee1-991c-75bbbee7a3dc'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:04.223148 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-609d063f-3035-4ee1-991c-75bbbee7a3dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6d04d5880f342ad86a11825d9ea2591', 'request_id': 'req-609d063f-3035-4ee1-991c-75bbbee7a3dc'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:04.228307 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-609d063f-3035-4ee1-991c-75bbbee7a3dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6d04d5880f342ad86a11825d9ea2591', 'request_id': 'req-609d063f-3035-4ee1-991c-75bbbee7a3dc'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:04.239350 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-609d063f-3035-4ee1-991c-75bbbee7a3dc admin admin] The token cache is being invalidate because project d6d04d5880f342ad86a11825d9ea2591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:38:04.239635 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-609d063f-3035-4ee1-991c-75bbbee7a3dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:04.240251 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-609d063f-3035-4ee1-991c-75bbbee7a3dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:04.241813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1244/2486] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:38:04 2022] DELETE /identity/v3/projects/d6d04d5880f342ad86a11825d9ea2591 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:38:04.245797 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918fdd2-16a3-4428-86b1-be6166a65829 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:04.247232 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e918fdd2-16a3-4428-86b1-be6166a65829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:04.260316 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918fdd2-16a3-4428-86b1-be6166a65829 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:04.314406 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7aae5-6a28-477e-b6c9-4270e9e825b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:04.315267 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7aae5-6a28-477e-b6c9-4270e9e825b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:04.315551 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7aae5-6a28-477e-b6c9-4270e9e825b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:04.315823 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7aae5-6a28-477e-b6c9-4270e9e825b7 admin admin] PATH_INFO: `/v3/users/a7c4e754266d4b7bacf6061721ec87b0` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:04.317002 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7aae5-6a28-477e-b6c9-4270e9e825b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7c4e754266d4b7bacf6061721ec87b0)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:04.318972 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7aae5-6a28-477e-b6c9-4270e9e825b7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:04.363102 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-cec7aae5-6a28-477e-b6c9-4270e9e825b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7c4e754266d4b7bacf6061721ec87b0'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:04.375282 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-cec7aae5-6a28-477e-b6c9-4270e9e825b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7c4e754266d4b7bacf6061721ec87b0'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:04.375928 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-cec7aae5-6a28-477e-b6c9-4270e9e825b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7c4e754266d4b7bacf6061721ec87b0'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:04.376518 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-cec7aae5-6a28-477e-b6c9-4270e9e825b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7c4e754266d4b7bacf6061721ec87b0'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:04.384609 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-cec7aae5-6a28-477e-b6c9-4270e9e825b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7c4e754266d4b7bacf6061721ec87b0'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:04.396377 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1243/2487] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:38:04 2022] DELETE /identity/v3/users/a7c4e754266d4b7bacf6061721ec87b0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:38:04.664364 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d063f-3035-4ee1-991c-75bbbee7a3dc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:04.666346 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-609d063f-3035-4ee1-991c-75bbbee7a3dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:04.681118 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d063f-3035-4ee1-991c-75bbbee7a3dc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:04.738729 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ddf5f-70a5-449b-8d97-42d44d888d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:04.739585 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ddf5f-70a5-449b-8d97-42d44d888d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:04.739861 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ddf5f-70a5-449b-8d97-42d44d888d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:04.740130 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ddf5f-70a5-449b-8d97-42d44d888d21 admin admin] PATH_INFO: `/v3/projects/32525869ba17464a98b431c3cc0813b7` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:04.741328 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ddf5f-70a5-449b-8d97-42d44d888d21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32525869ba17464a98b431c3cc0813b7)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:04.743319 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ddf5f-70a5-449b-8d97-42d44d888d21 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:04.790639 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7b0ddf5f-70a5-449b-8d97-42d44d888d21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32525869ba17464a98b431c3cc0813b7', 'request_id': 'req-7b0ddf5f-70a5-449b-8d97-42d44d888d21'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:04.798289 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7b0ddf5f-70a5-449b-8d97-42d44d888d21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32525869ba17464a98b431c3cc0813b7', 'request_id': 'req-7b0ddf5f-70a5-449b-8d97-42d44d888d21'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:04.803762 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7b0ddf5f-70a5-449b-8d97-42d44d888d21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32525869ba17464a98b431c3cc0813b7', 'request_id': 'req-7b0ddf5f-70a5-449b-8d97-42d44d888d21'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:04.814263 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7b0ddf5f-70a5-449b-8d97-42d44d888d21 admin admin] The token cache is being invalidate because project 32525869ba17464a98b431c3cc0813b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:38:04.814546 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7b0ddf5f-70a5-449b-8d97-42d44d888d21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:04.815171 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7b0ddf5f-70a5-449b-8d97-42d44d888d21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:04.816694 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1245/2488] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:38:04 2022] DELETE /identity/v3/projects/32525869ba17464a98b431c3cc0813b7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:38:04.822621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303cf63-e4f8-4dec-a46a-7d684a0ff5ba None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:04.822831 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303cf63-e4f8-4dec-a46a-7d684a0ff5ba None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:04.823106 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303cf63-e4f8-4dec-a46a-7d684a0ff5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:04.840246 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-a303cf63-e4f8-4dec-a46a-7d684a0ff5ba None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:38:04.841468 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a303cf63-e4f8-4dec-a46a-7d684a0ff5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:04.901906 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1244/2489] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:38:04.910804 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72482b0-05e3-4ec4-998e-705174543ec0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:04.911085 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72482b0-05e3-4ec4-998e-705174543ec0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:04.911359 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72482b0-05e3-4ec4-998e-705174543ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:04.929874 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-a72482b0-05e3-4ec4-998e-705174543ec0 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:38:04.931058 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a72482b0-05e3-4ec4-998e-705174543ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:04.938814 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1246/2490] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:38:04.942955 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303cf63-e4f8-4dec-a46a-7d684a0ff5ba None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:04.952918 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303cf63-e4f8-4dec-a46a-7d684a0ff5ba None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:04.957550 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf775b-8359-4909-80fb-01f5d09072b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:04.958187 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf775b-8359-4909-80fb-01f5d09072b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:04.958466 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf775b-8359-4909-80fb-01f5d09072b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:04.958739 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf775b-8359-4909-80fb-01f5d09072b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:04.959465 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf775b-8359-4909-80fb-01f5d09072b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:38:04.959772 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf775b-8359-4909-80fb-01f5d09072b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:04.961406 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf775b-8359-4909-80fb-01f5d09072b6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:04.973038 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1245/2491] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:38:04.977177 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72482b0-05e3-4ec4-998e-705174543ec0 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:04.986245 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72482b0-05e3-4ec4-998e-705174543ec0 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:04.990884 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d24bbb-daed-46a0-9a44-54e6835542db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:04.991520 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d24bbb-daed-46a0-9a44-54e6835542db admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:04.991798 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d24bbb-daed-46a0-9a44-54e6835542db admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:04.992068 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d24bbb-daed-46a0-9a44-54e6835542db admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:04.992753 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d24bbb-daed-46a0-9a44-54e6835542db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:04.994654 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d24bbb-daed-46a0-9a44-54e6835542db admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:05.019022 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1247/2492] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:38:04 2022] POST /identity/v3/projects => generated 367 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:38:05.022925 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf775b-8359-4909-80fb-01f5d09072b6 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:05.033177 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf775b-8359-4909-80fb-01f5d09072b6 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:05.087040 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173ccb7-3e3d-4cb3-bc38-425edc7c976d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:05.087614 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173ccb7-3e3d-4cb3-bc38-425edc7c976d admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:05.087892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173ccb7-3e3d-4cb3-bc38-425edc7c976d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:05.088163 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173ccb7-3e3d-4cb3-bc38-425edc7c976d admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:05.088843 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173ccb7-3e3d-4cb3-bc38-425edc7c976d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:05.090786 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173ccb7-3e3d-4cb3-bc38-425edc7c976d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:05.109826 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1246/2493] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:38:05 2022] POST /identity/v3/users => generated 284 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:38:05.114016 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d24bbb-daed-46a0-9a44-54e6835542db admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:05.124691 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d24bbb-daed-46a0-9a44-54e6835542db admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:05.129232 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fd237-e2fd-4654-a8cc-544b8c4cd967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:05.129904 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fd237-e2fd-4654-a8cc-544b8c4cd967 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:05.130186 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fd237-e2fd-4654-a8cc-544b8c4cd967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:05.130461 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fd237-e2fd-4654-a8cc-544b8c4cd967 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:05.131176 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0fd237-e2fd-4654-a8cc-544b8c4cd967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:05.132757 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0fd237-e2fd-4654-a8cc-544b8c4cd967 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:05.143004 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1248/2494] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:38:05.147026 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173ccb7-3e3d-4cb3-bc38-425edc7c976d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:05.156908 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173ccb7-3e3d-4cb3-bc38-425edc7c976d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:05.161507 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275862d-9256-47a3-a112-772150164fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:05.162142 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275862d-9256-47a3-a112-772150164fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:05.162423 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275862d-9256-47a3-a112-772150164fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:05.162697 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275862d-9256-47a3-a112-772150164fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:05.163415 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275862d-9256-47a3-a112-772150164fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:05.165004 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275862d-9256-47a3-a112-772150164fe8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:05.175316 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1247/2495] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:38:05.179274 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fd237-e2fd-4654-a8cc-544b8c4cd967 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:05.189576 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fd237-e2fd-4654-a8cc-544b8c4cd967 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:05.194323 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804df17-b34b-4e2f-911e-5ef6a109f989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:05.195183 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804df17-b34b-4e2f-911e-5ef6a109f989 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:05.195464 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804df17-b34b-4e2f-911e-5ef6a109f989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:05.195740 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804df17-b34b-4e2f-911e-5ef6a109f989 admin admin] PATH_INFO: `/v3/projects/fa5c84e8578f4988aeeab76bca4c82e9/users/75bf867c4e1d4953b1a9133f0c472109/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:05.209907 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804df17-b34b-4e2f-911e-5ef6a109f989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa5c84e8578f4988aeeab76bca4c82e9, user_id=75bf867c4e1d4953b1a9133f0c472109, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:05.212554 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804df17-b34b-4e2f-911e-5ef6a109f989 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:05.225599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1249/2496] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:38:05 2022] PUT /identity/v3/projects/fa5c84e8578f4988aeeab76bca4c82e9/users/75bf867c4e1d4953b1a9133f0c472109/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:38:05.238193 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd387cb1-c902-441c-86cd-3e783053e662 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:05.238482 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd387cb1-c902-441c-86cd-3e783053e662 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:05.238761 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd387cb1-c902-441c-86cd-3e783053e662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:05.265810 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-fd387cb1-c902-441c-86cd-3e783053e662 None None] MFA Rules not processed for user `75bf867c4e1d4953b1a9133f0c472109`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:38:05.267008 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fd387cb1-c902-441c-86cd-3e783053e662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:05.328351 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1248/2497] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:38:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:38:05.332860 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804df17-b34b-4e2f-911e-5ef6a109f989 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:05.391465 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804df17-b34b-4e2f-911e-5ef6a109f989 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:05.396096 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545f7d4-9956-42cb-89e3-94c1d353e8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:05.396737 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545f7d4-9956-42cb-89e3-94c1d353e8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:05.397017 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545f7d4-9956-42cb-89e3-94c1d353e8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:05.397315 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545f7d4-9956-42cb-89e3-94c1d353e8a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:05.398024 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545f7d4-9956-42cb-89e3-94c1d353e8a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:05.399925 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545f7d4-9956-42cb-89e3-94c1d353e8a0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:05.425586 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1250/2498] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:38:05 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:38:05.429623 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd387cb1-c902-441c-86cd-3e783053e662 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:05.440028 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd387cb1-c902-441c-86cd-3e783053e662 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:05.497466 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb7c14-a130-4919-a4d5-63c3a39f73c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:05.498095 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb7c14-a130-4919-a4d5-63c3a39f73c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:05.498454 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb7c14-a130-4919-a4d5-63c3a39f73c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:05.498732 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb7c14-a130-4919-a4d5-63c3a39f73c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:05.499550 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb7c14-a130-4919-a4d5-63c3a39f73c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:05.501530 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb7c14-a130-4919-a4d5-63c3a39f73c2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:05.521448 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1249/2499] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:38:05 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:38:05.525478 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545f7d4-9956-42cb-89e3-94c1d353e8a0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:05.536296 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545f7d4-9956-42cb-89e3-94c1d353e8a0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:05.545832 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c4efe-ea62-4fcd-adfc-f7abb58b2386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:05.546576 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c4efe-ea62-4fcd-adfc-f7abb58b2386 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:05.546859 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c4efe-ea62-4fcd-adfc-f7abb58b2386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:05.547137 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c4efe-ea62-4fcd-adfc-f7abb58b2386 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:05.547849 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c4efe-ea62-4fcd-adfc-f7abb58b2386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:05.549471 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c4efe-ea62-4fcd-adfc-f7abb58b2386 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:05.561151 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1251/2500] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:38:05.565277 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb7c14-a130-4919-a4d5-63c3a39f73c2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:05.575148 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb7c14-a130-4919-a4d5-63c3a39f73c2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:05.580898 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5cc3a-dcd0-4f5b-8ec2-8ae04b866ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:05.581906 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5cc3a-dcd0-4f5b-8ec2-8ae04b866ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:05.582190 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5cc3a-dcd0-4f5b-8ec2-8ae04b866ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:05.582463 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5cc3a-dcd0-4f5b-8ec2-8ae04b866ebb admin admin] PATH_INFO: `/v3/projects/cabf2b7f296c473683541ff744ecf032/users/4c31ba4c97424683982562045999b0b8/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:05.599991 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5cc3a-dcd0-4f5b-8ec2-8ae04b866ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cabf2b7f296c473683541ff744ecf032, user_id=4c31ba4c97424683982562045999b0b8, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:05.602846 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5cc3a-dcd0-4f5b-8ec2-8ae04b866ebb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:05.623986 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1250/2501] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:38:05 2022] PUT /identity/v3/projects/cabf2b7f296c473683541ff744ecf032/users/4c31ba4c97424683982562045999b0b8/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:38:05.625396 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c4efe-ea62-4fcd-adfc-f7abb58b2386 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:05.636214 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c4efe-ea62-4fcd-adfc-f7abb58b2386 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:05.693861 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff1ccc2-e3a8-4f06-9bbb-331e9bddb4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:05.694575 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1ccc2-e3a8-4f06-9bbb-331e9bddb4db admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:05.694793 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1ccc2-e3a8-4f06-9bbb-331e9bddb4db admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:05.695061 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff1ccc2-e3a8-4f06-9bbb-331e9bddb4db admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:05.695772 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1ccc2-e3a8-4f06-9bbb-331e9bddb4db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:05.697386 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff1ccc2-e3a8-4f06-9bbb-331e9bddb4db admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:05.709203 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1252/2502] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:38:05.714107 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5cc3a-dcd0-4f5b-8ec2-8ae04b866ebb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:05.726343 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5cc3a-dcd0-4f5b-8ec2-8ae04b866ebb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:05.731346 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b15291-5b67-48f2-bc3b-f9599389f16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:05.732899 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b15291-5b67-48f2-bc3b-f9599389f16a admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:05.733444 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b15291-5b67-48f2-bc3b-f9599389f16a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:05.733726 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b15291-5b67-48f2-bc3b-f9599389f16a admin admin] PATH_INFO: `/v3/projects/cabf2b7f296c473683541ff744ecf032/users/4c31ba4c97424683982562045999b0b8/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:05.736105 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b15291-5b67-48f2-bc3b-f9599389f16a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cabf2b7f296c473683541ff744ecf032, user_id=4c31ba4c97424683982562045999b0b8, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:05.739417 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b15291-5b67-48f2-bc3b-f9599389f16a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:05.751207 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1251/2503] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:38:05 2022] PUT /identity/v3/projects/cabf2b7f296c473683541ff744ecf032/users/4c31ba4c97424683982562045999b0b8/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:38:05.762019 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f71466-01e8-450c-83b2-5353d89f3f8a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:05.762440 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f71466-01e8-450c-83b2-5353d89f3f8a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:05.762593 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f71466-01e8-450c-83b2-5353d89f3f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:05.802615 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-88f71466-01e8-450c-83b2-5353d89f3f8a None None] MFA Rules not processed for user `4c31ba4c97424683982562045999b0b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:38:05.803784 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-88f71466-01e8-450c-83b2-5353d89f3f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:05.872420 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1253/2504] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:38:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:38:05.883818 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b15291-5b67-48f2-bc3b-f9599389f16a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:05.885529 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f6b15291-5b67-48f2-bc3b-f9599389f16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:05.940615 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b15291-5b67-48f2-bc3b-f9599389f16a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:05.944158 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829272e7-6c40-4322-b46f-db351f1d284e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:05.944791 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829272e7-6c40-4322-b46f-db351f1d284e service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:05.945071 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829272e7-6c40-4322-b46f-db351f1d284e service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:05.945381 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829272e7-6c40-4322-b46f-db351f1d284e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:05.954327 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829272e7-6c40-4322-b46f-db351f1d284e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:05.955774 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829272e7-6c40-4322-b46f-db351f1d284e service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:05.965096 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1252/2505] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:38:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:38:06.041021 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f71466-01e8-450c-83b2-5353d89f3f8a None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:06.051211 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f71466-01e8-450c-83b2-5353d89f3f8a None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:06.054852 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c76a3-eb23-4316-88e3-12c0cb13a6ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:06.055478 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c76a3-eb23-4316-88e3-12c0cb13a6ab service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:06.055759 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c76a3-eb23-4316-88e3-12c0cb13a6ab service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:06.056032 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c76a3-eb23-4316-88e3-12c0cb13a6ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:06.114585 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c76a3-eb23-4316-88e3-12c0cb13a6ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:06.116030 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c76a3-eb23-4316-88e3-12c0cb13a6ab service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:06.124886 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1254/2506] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:38:06 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:38:09.142794 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829272e7-6c40-4322-b46f-db351f1d284e service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:09.144755 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-829272e7-6c40-4322-b46f-db351f1d284e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:09.209779 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829272e7-6c40-4322-b46f-db351f1d284e service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:09.215907 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11f925-7551-49a1-b966-7e5dd53a842d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:09.218044 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11f925-7551-49a1-b966-7e5dd53a842d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:09.218647 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11f925-7551-49a1-b966-7e5dd53a842d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:09.219224 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11f925-7551-49a1-b966-7e5dd53a842d admin admin] PATH_INFO: `/v3/users/e8c6ea88cdc140c38a8b71ccb4646d93` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:09.221151 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11f925-7551-49a1-b966-7e5dd53a842d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8c6ea88cdc140c38a8b71ccb4646d93)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:09.224641 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11f925-7551-49a1-b966-7e5dd53a842d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:09.276732 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4d11f925-7551-49a1-b966-7e5dd53a842d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8c6ea88cdc140c38a8b71ccb4646d93'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:09.290049 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4d11f925-7551-49a1-b966-7e5dd53a842d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8c6ea88cdc140c38a8b71ccb4646d93'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:09.290785 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4d11f925-7551-49a1-b966-7e5dd53a842d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8c6ea88cdc140c38a8b71ccb4646d93'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:09.291403 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4d11f925-7551-49a1-b966-7e5dd53a842d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8c6ea88cdc140c38a8b71ccb4646d93'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:09.299471 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4d11f925-7551-49a1-b966-7e5dd53a842d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8c6ea88cdc140c38a8b71ccb4646d93'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:09.315411 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1253/2507] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:38:09 2022] DELETE /identity/v3/users/e8c6ea88cdc140c38a8b71ccb4646d93 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:38:09.320216 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e010a-d125-4b2c-b130-08d4c3ca32d4 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:09.330367 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e010a-d125-4b2c-b130-08d4c3ca32d4 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:09.330367 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e010a-d125-4b2c-b130-08d4c3ca32d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:09.339982 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-500e010a-d125-4b2c-b130-08d4c3ca32d4 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:38:09.341287 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-500e010a-d125-4b2c-b130-08d4c3ca32d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:09.410599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1255/2508] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:38:09.421840 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11f925-7551-49a1-b966-7e5dd53a842d admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:09.423654 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4d11f925-7551-49a1-b966-7e5dd53a842d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:09.494054 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11f925-7551-49a1-b966-7e5dd53a842d admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:09.499167 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2fa34-c5f6-4380-9e68-b6ef6f5b67a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:09.499861 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2fa34-c5f6-4380-9e68-b6ef6f5b67a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:09.500148 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2fa34-c5f6-4380-9e68-b6ef6f5b67a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:09.500467 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2fa34-c5f6-4380-9e68-b6ef6f5b67a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:09.509908 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2fa34-c5f6-4380-9e68-b6ef6f5b67a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:09.511417 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2fa34-c5f6-4380-9e68-b6ef6f5b67a1 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:09.522030 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1254/2509] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:38:09.787779 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e010a-d125-4b2c-b130-08d4c3ca32d4 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:09.789201 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-500e010a-d125-4b2c-b130-08d4c3ca32d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:09.802184 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e010a-d125-4b2c-b130-08d4c3ca32d4 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:09.806912 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3cfb8-b491-4669-b801-e179cf42b10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:09.807762 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3cfb8-b491-4669-b801-e179cf42b10d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:09.808035 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3cfb8-b491-4669-b801-e179cf42b10d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:09.808303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3cfb8-b491-4669-b801-e179cf42b10d admin admin] PATH_INFO: `/v3/projects/0a7ac09d5d704203bd7bbf38f1d84dbc` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:09.809782 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3cfb8-b491-4669-b801-e179cf42b10d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a7ac09d5d704203bd7bbf38f1d84dbc)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:09.812777 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3cfb8-b491-4669-b801-e179cf42b10d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:09.858573 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-33d3cfb8-b491-4669-b801-e179cf42b10d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a7ac09d5d704203bd7bbf38f1d84dbc', 'request_id': 'req-33d3cfb8-b491-4669-b801-e179cf42b10d'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:09.865590 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-33d3cfb8-b491-4669-b801-e179cf42b10d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a7ac09d5d704203bd7bbf38f1d84dbc', 'request_id': 'req-33d3cfb8-b491-4669-b801-e179cf42b10d'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:09.870861 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-33d3cfb8-b491-4669-b801-e179cf42b10d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a7ac09d5d704203bd7bbf38f1d84dbc', 'request_id': 'req-33d3cfb8-b491-4669-b801-e179cf42b10d'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:09.882002 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-33d3cfb8-b491-4669-b801-e179cf42b10d admin admin] The token cache is being invalidate because project 0a7ac09d5d704203bd7bbf38f1d84dbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:38:09.882282 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-33d3cfb8-b491-4669-b801-e179cf42b10d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:09.882891 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-33d3cfb8-b491-4669-b801-e179cf42b10d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:09.884478 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1256/2510] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:38:09 2022] DELETE /identity/v3/projects/0a7ac09d5d704203bd7bbf38f1d84dbc => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:38:13.901021 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2fa34-c5f6-4380-9e68-b6ef6f5b67a1 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:13.911110 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f5e2fa34-c5f6-4380-9e68-b6ef6f5b67a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:13.915489 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2fa34-c5f6-4380-9e68-b6ef6f5b67a1 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:13.971636 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b47581-57c5-4900-85fb-bc16311e5a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:13.972496 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b47581-57c5-4900-85fb-bc16311e5a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:13.972771 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b47581-57c5-4900-85fb-bc16311e5a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:13.973042 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b47581-57c5-4900-85fb-bc16311e5a24 admin admin] PATH_INFO: `/v3/users/75bf867c4e1d4953b1a9133f0c472109` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:13.974237 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b47581-57c5-4900-85fb-bc16311e5a24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75bf867c4e1d4953b1a9133f0c472109)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:13.976162 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b47581-57c5-4900-85fb-bc16311e5a24 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:14.019773 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e6b47581-57c5-4900-85fb-bc16311e5a24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75bf867c4e1d4953b1a9133f0c472109'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:14.031568 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e6b47581-57c5-4900-85fb-bc16311e5a24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75bf867c4e1d4953b1a9133f0c472109'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:14.032293 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e6b47581-57c5-4900-85fb-bc16311e5a24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75bf867c4e1d4953b1a9133f0c472109'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:14.032887 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e6b47581-57c5-4900-85fb-bc16311e5a24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75bf867c4e1d4953b1a9133f0c472109'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:14.040469 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e6b47581-57c5-4900-85fb-bc16311e5a24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75bf867c4e1d4953b1a9133f0c472109'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:14.053436 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1255/2511] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:38:13 2022] DELETE /identity/v3/users/75bf867c4e1d4953b1a9133f0c472109 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:38:14.057912 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572c168-cb98-40cb-9f5c-06ce7d67e153 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:14.058370 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572c168-cb98-40cb-9f5c-06ce7d67e153 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:14.058463 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572c168-cb98-40cb-9f5c-06ce7d67e153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:14.076664 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-3572c168-cb98-40cb-9f5c-06ce7d67e153 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:38:14.077894 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3572c168-cb98-40cb-9f5c-06ce7d67e153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:14.138707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1257/2512] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:38:14.145040 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b47581-57c5-4900-85fb-bc16311e5a24 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:14.146457 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e6b47581-57c5-4900-85fb-bc16311e5a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:14.203727 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b47581-57c5-4900-85fb-bc16311e5a24 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:14.207376 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd17d98-8fa4-4e5c-a892-58beb75a304c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:14.208014 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd17d98-8fa4-4e5c-a892-58beb75a304c service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:14.208297 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd17d98-8fa4-4e5c-a892-58beb75a304c service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:14.208573 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd17d98-8fa4-4e5c-a892-58beb75a304c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:14.217391 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd17d98-8fa4-4e5c-a892-58beb75a304c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:14.218828 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd17d98-8fa4-4e5c-a892-58beb75a304c service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:14.228020 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1256/2513] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:38:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:38:14.482735 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572c168-cb98-40cb-9f5c-06ce7d67e153 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:14.484233 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3572c168-cb98-40cb-9f5c-06ce7d67e153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:14.497380 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572c168-cb98-40cb-9f5c-06ce7d67e153 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:14.502630 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a7eab-b2cc-41cb-8c2c-8f18b780afde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:14.503776 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a7eab-b2cc-41cb-8c2c-8f18b780afde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:14.504044 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a7eab-b2cc-41cb-8c2c-8f18b780afde admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:14.504323 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a7eab-b2cc-41cb-8c2c-8f18b780afde admin admin] PATH_INFO: `/v3/projects/fa5c84e8578f4988aeeab76bca4c82e9` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:14.505536 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a7eab-b2cc-41cb-8c2c-8f18b780afde admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa5c84e8578f4988aeeab76bca4c82e9)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:14.507445 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a7eab-b2cc-41cb-8c2c-8f18b780afde admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:14.552166 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8c9a7eab-b2cc-41cb-8c2c-8f18b780afde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa5c84e8578f4988aeeab76bca4c82e9', 'request_id': 'req-8c9a7eab-b2cc-41cb-8c2c-8f18b780afde'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:14.559527 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8c9a7eab-b2cc-41cb-8c2c-8f18b780afde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa5c84e8578f4988aeeab76bca4c82e9', 'request_id': 'req-8c9a7eab-b2cc-41cb-8c2c-8f18b780afde'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:14.565314 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8c9a7eab-b2cc-41cb-8c2c-8f18b780afde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa5c84e8578f4988aeeab76bca4c82e9', 'request_id': 'req-8c9a7eab-b2cc-41cb-8c2c-8f18b780afde'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:14.576283 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8c9a7eab-b2cc-41cb-8c2c-8f18b780afde admin admin] The token cache is being invalidate because project fa5c84e8578f4988aeeab76bca4c82e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:38:14.576487 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8c9a7eab-b2cc-41cb-8c2c-8f18b780afde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:14.577120 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8c9a7eab-b2cc-41cb-8c2c-8f18b780afde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:14.578658 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1258/2514] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:38:14 2022] DELETE /identity/v3/projects/fa5c84e8578f4988aeeab76bca4c82e9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:38:14.582775 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd17d98-8fa4-4e5c-a892-58beb75a304c service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:14.593049 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd17d98-8fa4-4e5c-a892-58beb75a304c service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:14.645818 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86d5dc-0566-4acc-85cc-2a117e38b023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:14.646672 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86d5dc-0566-4acc-85cc-2a117e38b023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:14.646949 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86d5dc-0566-4acc-85cc-2a117e38b023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:14.647220 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86d5dc-0566-4acc-85cc-2a117e38b023 admin admin] PATH_INFO: `/v3/users/4c31ba4c97424683982562045999b0b8` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:14.648397 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86d5dc-0566-4acc-85cc-2a117e38b023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c31ba4c97424683982562045999b0b8)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:14.650403 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86d5dc-0566-4acc-85cc-2a117e38b023 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:14.695318 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9a86d5dc-0566-4acc-85cc-2a117e38b023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c31ba4c97424683982562045999b0b8'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:14.706979 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9a86d5dc-0566-4acc-85cc-2a117e38b023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c31ba4c97424683982562045999b0b8'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:14.707627 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9a86d5dc-0566-4acc-85cc-2a117e38b023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c31ba4c97424683982562045999b0b8'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:14.708224 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9a86d5dc-0566-4acc-85cc-2a117e38b023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c31ba4c97424683982562045999b0b8'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:14.715773 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9a86d5dc-0566-4acc-85cc-2a117e38b023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c31ba4c97424683982562045999b0b8'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:14.728514 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1257/2515] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:38:14 2022] DELETE /identity/v3/users/4c31ba4c97424683982562045999b0b8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:38:14.994345 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a7eab-b2cc-41cb-8c2c-8f18b780afde admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:15.000639 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86d5dc-0566-4acc-85cc-2a117e38b023 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:15.002596 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9a86d5dc-0566-4acc-85cc-2a117e38b023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:15.005577 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8c9a7eab-b2cc-41cb-8c2c-8f18b780afde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:15.022744 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a7eab-b2cc-41cb-8c2c-8f18b780afde admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:15.081414 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86d5dc-0566-4acc-85cc-2a117e38b023 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:15.085029 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9d78c-dc38-48b6-99c6-f1e788f87a3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:15.085713 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9d78c-dc38-48b6-99c6-f1e788f87a3f service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:15.085997 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9d78c-dc38-48b6-99c6-f1e788f87a3f service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:15.086330 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9d78c-dc38-48b6-99c6-f1e788f87a3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:15.086717 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82583ac4-4ba9-47e7-9fef-8236cb3b9d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:15.087609 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82583ac4-4ba9-47e7-9fef-8236cb3b9d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:15.088062 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82583ac4-4ba9-47e7-9fef-8236cb3b9d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:15.088307 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82583ac4-4ba9-47e7-9fef-8236cb3b9d96 admin admin] PATH_INFO: `/v3/projects/cabf2b7f296c473683541ff744ecf032` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:15.088735 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0bc9d78c-dc38-48b6-99c6-f1e788f87a3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:15.089862 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82583ac4-4ba9-47e7-9fef-8236cb3b9d96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cabf2b7f296c473683541ff744ecf032)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:15.092665 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82583ac4-4ba9-47e7-9fef-8236cb3b9d96 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:15.139897 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-82583ac4-4ba9-47e7-9fef-8236cb3b9d96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cabf2b7f296c473683541ff744ecf032', 'request_id': 'req-82583ac4-4ba9-47e7-9fef-8236cb3b9d96'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:15.147142 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-82583ac4-4ba9-47e7-9fef-8236cb3b9d96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cabf2b7f296c473683541ff744ecf032', 'request_id': 'req-82583ac4-4ba9-47e7-9fef-8236cb3b9d96'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:15.152417 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9d78c-dc38-48b6-99c6-f1e788f87a3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:15.152616 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-82583ac4-4ba9-47e7-9fef-8236cb3b9d96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cabf2b7f296c473683541ff744ecf032', 'request_id': 'req-82583ac4-4ba9-47e7-9fef-8236cb3b9d96'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:15.154484 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9d78c-dc38-48b6-99c6-f1e788f87a3f service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:15.163555 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1258/2516] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:38:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:38:15.164136 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-82583ac4-4ba9-47e7-9fef-8236cb3b9d96 admin admin] The token cache is being invalidate because project cabf2b7f296c473683541ff744ecf032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:38:15.164452 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-82583ac4-4ba9-47e7-9fef-8236cb3b9d96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:15.165139 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-82583ac4-4ba9-47e7-9fef-8236cb3b9d96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:15.167136 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1259/2517] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:38:14 2022] DELETE /identity/v3/projects/cabf2b7f296c473683541ff744ecf032 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:38:15.173011 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5b930-8d02-4223-b65e-b2b79e2161d1 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:15.173328 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5b930-8d02-4223-b65e-b2b79e2161d1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:15.173613 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec5b930-8d02-4223-b65e-b2b79e2161d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:15.190672 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-1ec5b930-8d02-4223-b65e-b2b79e2161d1 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:38:15.191917 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-1ec5b930-8d02-4223-b65e-b2b79e2161d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:15.250483 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1259/2518] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:38:15.258989 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199df1c-ba00-4a5b-aa1c-73c4b80c6004 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:15.259275 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199df1c-ba00-4a5b-aa1c-73c4b80c6004 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:15.259545 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199df1c-ba00-4a5b-aa1c-73c4b80c6004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:15.279927 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-8199df1c-ba00-4a5b-aa1c-73c4b80c6004 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:38:15.281356 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8199df1c-ba00-4a5b-aa1c-73c4b80c6004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:15.289710 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1260/2519] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:38:15.294195 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5b930-8d02-4223-b65e-b2b79e2161d1 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:15.307383 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec5b930-8d02-4223-b65e-b2b79e2161d1 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:15.312688 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96547342-01a1-4d9b-9fd6-73aa9c48f8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:15.313456 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96547342-01a1-4d9b-9fd6-73aa9c48f8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:15.313833 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96547342-01a1-4d9b-9fd6-73aa9c48f8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:15.314108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96547342-01a1-4d9b-9fd6-73aa9c48f8e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:15.314951 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96547342-01a1-4d9b-9fd6-73aa9c48f8e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:38:15.315377 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96547342-01a1-4d9b-9fd6-73aa9c48f8e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:15.317123 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96547342-01a1-4d9b-9fd6-73aa9c48f8e6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:15.330086 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1260/2520] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:38:15.334898 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199df1c-ba00-4a5b-aa1c-73c4b80c6004 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:15.344813 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199df1c-ba00-4a5b-aa1c-73c4b80c6004 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:15.350348 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c6349-a6f4-412b-bcee-3c08fb38a588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:15.350988 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c6349-a6f4-412b-bcee-3c08fb38a588 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:15.351265 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c6349-a6f4-412b-bcee-3c08fb38a588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:15.351541 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c6349-a6f4-412b-bcee-3c08fb38a588 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:15.352322 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c6349-a6f4-412b-bcee-3c08fb38a588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:15.354367 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c6349-a6f4-412b-bcee-3c08fb38a588 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:15.383366 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1261/2521] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:38:15 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:38:15.392603 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96547342-01a1-4d9b-9fd6-73aa9c48f8e6 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:15.404588 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96547342-01a1-4d9b-9fd6-73aa9c48f8e6 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:15.478602 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c6349-a6f4-412b-bcee-3c08fb38a588 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:15.480349 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4e9c6349-a6f4-412b-bcee-3c08fb38a588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:15.540616 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c6349-a6f4-412b-bcee-3c08fb38a588 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:15.544710 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a336dca-f25b-46fb-90b2-c6d2aabbfea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:15.545391 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a336dca-f25b-46fb-90b2-c6d2aabbfea1 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:15.545676 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a336dca-f25b-46fb-90b2-c6d2aabbfea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:15.545951 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a336dca-f25b-46fb-90b2-c6d2aabbfea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:15.547872 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1a336dca-f25b-46fb-90b2-c6d2aabbfea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:15.600758 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1cee6-4695-4b70-b390-8e7942cf1f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:15.601448 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1cee6-4695-4b70-b390-8e7942cf1f79 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:15.601707 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1cee6-4695-4b70-b390-8e7942cf1f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:15.602045 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1cee6-4695-4b70-b390-8e7942cf1f79 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:15.602659 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1cee6-4695-4b70-b390-8e7942cf1f79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:15.604673 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1cee6-4695-4b70-b390-8e7942cf1f79 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:15.616530 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a336dca-f25b-46fb-90b2-c6d2aabbfea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:15.618063 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a336dca-f25b-46fb-90b2-c6d2aabbfea1 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:15.624393 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1261/2522] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:38:15 2022] POST /identity/v3/users => generated 290 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:38:15.628324 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1cee6-4695-4b70-b390-8e7942cf1f79 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:15.629303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1262/2523] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:38:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:38:15.637697 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1cee6-4695-4b70-b390-8e7942cf1f79 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:15.642939 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa768b-2aa6-4084-b8df-8293c53f92d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:15.643532 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa768b-2aa6-4084-b8df-8293c53f92d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:15.643812 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa768b-2aa6-4084-b8df-8293c53f92d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:15.644085 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa768b-2aa6-4084-b8df-8293c53f92d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:15.644812 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa768b-2aa6-4084-b8df-8293c53f92d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:15.646445 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa768b-2aa6-4084-b8df-8293c53f92d0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:15.656905 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1262/2524] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:38:15.660819 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a336dca-f25b-46fb-90b2-c6d2aabbfea1 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:15.672945 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a336dca-f25b-46fb-90b2-c6d2aabbfea1 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:15.677479 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ae46c-a4e5-49c1-a814-89611b9e225e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:15.678147 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ae46c-a4e5-49c1-a814-89611b9e225e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:15.678431 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ae46c-a4e5-49c1-a814-89611b9e225e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:15.678707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ae46c-a4e5-49c1-a814-89611b9e225e admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:15.679433 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ae46c-a4e5-49c1-a814-89611b9e225e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:15.681028 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ae46c-a4e5-49c1-a814-89611b9e225e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:15.692007 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1263/2525] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:38:15.697957 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa768b-2aa6-4084-b8df-8293c53f92d0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:15.708191 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa768b-2aa6-4084-b8df-8293c53f92d0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:15.718202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c4f01-bf4d-4eb0-8760-42a8067f2908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:15.719378 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c4f01-bf4d-4eb0-8760-42a8067f2908 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:15.719754 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c4f01-bf4d-4eb0-8760-42a8067f2908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:15.720123 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041c4f01-bf4d-4eb0-8760-42a8067f2908 admin admin] PATH_INFO: `/v3/projects/6f9bea7a44f54ac7880e0dc4735373ff/users/da36718364c3434aaeb9ec43243a4610/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:15.737912 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c4f01-bf4d-4eb0-8760-42a8067f2908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f9bea7a44f54ac7880e0dc4735373ff, user_id=da36718364c3434aaeb9ec43243a4610, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:15.740840 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041c4f01-bf4d-4eb0-8760-42a8067f2908 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:15.757518 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1263/2526] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:38:15 2022] PUT /identity/v3/projects/6f9bea7a44f54ac7880e0dc4735373ff/users/da36718364c3434aaeb9ec43243a4610/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:38:15.767647 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece2c58-9a96-4dc4-a734-10dcde29c9f4 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:15.767943 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece2c58-9a96-4dc4-a734-10dcde29c9f4 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:15.768222 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece2c58-9a96-4dc4-a734-10dcde29c9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:15.795628 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-dece2c58-9a96-4dc4-a734-10dcde29c9f4 None None] MFA Rules not processed for user `da36718364c3434aaeb9ec43243a4610`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:38:15.796836 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-dece2c58-9a96-4dc4-a734-10dcde29c9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:15.860723 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1264/2527] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:38:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:38:15.865201 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c4f01-bf4d-4eb0-8760-42a8067f2908 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:15.924756 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041c4f01-bf4d-4eb0-8760-42a8067f2908 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:15.929380 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95cff7-6a56-4f0a-a972-59dc27582d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:15.930024 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95cff7-6a56-4f0a-a972-59dc27582d63 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:15.930301 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95cff7-6a56-4f0a-a972-59dc27582d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:15.930568 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95cff7-6a56-4f0a-a972-59dc27582d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:15.931244 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95cff7-6a56-4f0a-a972-59dc27582d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:15.933133 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95cff7-6a56-4f0a-a972-59dc27582d63 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:15.958785 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1264/2528] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:38:15 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:38:15.962935 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece2c58-9a96-4dc4-a734-10dcde29c9f4 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:15.975819 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece2c58-9a96-4dc4-a734-10dcde29c9f4 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:16.035701 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573102a2-64b2-430c-87e7-2f22b9c418aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:16.036400 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573102a2-64b2-430c-87e7-2f22b9c418aa admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:16.036665 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573102a2-64b2-430c-87e7-2f22b9c418aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:16.036937 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573102a2-64b2-430c-87e7-2f22b9c418aa admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:16.037667 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573102a2-64b2-430c-87e7-2f22b9c418aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:16.039582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573102a2-64b2-430c-87e7-2f22b9c418aa admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:16.061173 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1265/2529] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:38:15 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:38:16.065167 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95cff7-6a56-4f0a-a972-59dc27582d63 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:16.076929 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95cff7-6a56-4f0a-a972-59dc27582d63 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:16.081523 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26896f-9270-4349-9f32-542c9a0a5c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:16.082171 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26896f-9270-4349-9f32-542c9a0a5c25 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:16.082442 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26896f-9270-4349-9f32-542c9a0a5c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:16.082823 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26896f-9270-4349-9f32-542c9a0a5c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:16.083432 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26896f-9270-4349-9f32-542c9a0a5c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:16.085012 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26896f-9270-4349-9f32-542c9a0a5c25 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:16.095320 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1265/2530] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:38:16.099525 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573102a2-64b2-430c-87e7-2f22b9c418aa admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:16.109459 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573102a2-64b2-430c-87e7-2f22b9c418aa admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:16.114081 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab82fa-492a-4154-a723-c255d6583b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:16.114948 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab82fa-492a-4154-a723-c255d6583b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:16.115230 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab82fa-492a-4154-a723-c255d6583b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:16.115496 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab82fa-492a-4154-a723-c255d6583b58 admin admin] PATH_INFO: `/v3/projects/6ab01a899c4e44e3961569dd6594dee3/users/1a2253f6bf4d4b2fa38bd70cad47112d/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:16.132037 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab82fa-492a-4154-a723-c255d6583b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ab01a899c4e44e3961569dd6594dee3, user_id=1a2253f6bf4d4b2fa38bd70cad47112d, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:16.134997 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab82fa-492a-4154-a723-c255d6583b58 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:16.150376 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1266/2531] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:38:16 2022] PUT /identity/v3/projects/6ab01a899c4e44e3961569dd6594dee3/users/1a2253f6bf4d4b2fa38bd70cad47112d/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:38:16.154289 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26896f-9270-4349-9f32-542c9a0a5c25 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:16.168912 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26896f-9270-4349-9f32-542c9a0a5c25 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:16.227975 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32396b21-5950-40c0-a01a-3f69fa36a4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:16.228639 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32396b21-5950-40c0-a01a-3f69fa36a4fe admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:16.228919 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32396b21-5950-40c0-a01a-3f69fa36a4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:16.229453 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32396b21-5950-40c0-a01a-3f69fa36a4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:16.230079 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32396b21-5950-40c0-a01a-3f69fa36a4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:16.231672 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32396b21-5950-40c0-a01a-3f69fa36a4fe admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:16.242494 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1266/2532] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:38:16.246592 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab82fa-492a-4154-a723-c255d6583b58 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:16.257128 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab82fa-492a-4154-a723-c255d6583b58 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:16.261750 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5818e8-80cf-4195-8470-743a7fc7394f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:16.262611 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5818e8-80cf-4195-8470-743a7fc7394f admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:16.262887 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5818e8-80cf-4195-8470-743a7fc7394f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:16.263181 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5818e8-80cf-4195-8470-743a7fc7394f admin admin] PATH_INFO: `/v3/projects/6ab01a899c4e44e3961569dd6594dee3/users/1a2253f6bf4d4b2fa38bd70cad47112d/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:16.265135 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5818e8-80cf-4195-8470-743a7fc7394f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ab01a899c4e44e3961569dd6594dee3, user_id=1a2253f6bf4d4b2fa38bd70cad47112d, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:16.267806 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5818e8-80cf-4195-8470-743a7fc7394f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:16.278163 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1267/2533] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:38:16 2022] PUT /identity/v3/projects/6ab01a899c4e44e3961569dd6594dee3/users/1a2253f6bf4d4b2fa38bd70cad47112d/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:38:16.288248 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1c3db-09cf-49c4-a142-85fba1e8ebc0 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:16.288541 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1c3db-09cf-49c4-a142-85fba1e8ebc0 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:16.288819 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1c3db-09cf-49c4-a142-85fba1e8ebc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:16.315608 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-4bf1c3db-09cf-49c4-a142-85fba1e8ebc0 None None] MFA Rules not processed for user `1a2253f6bf4d4b2fa38bd70cad47112d`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:38:16.316865 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4bf1c3db-09cf-49c4-a142-85fba1e8ebc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:16.381549 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1267/2534] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:38:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:38:16.391725 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5818e8-80cf-4195-8470-743a7fc7394f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:16.393561 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6d5818e8-80cf-4195-8470-743a7fc7394f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:16.455294 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5818e8-80cf-4195-8470-743a7fc7394f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:16.459395 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d749bbd-912d-4a14-a177-3072d24d7b13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:16.460031 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d749bbd-912d-4a14-a177-3072d24d7b13 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:16.460312 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d749bbd-912d-4a14-a177-3072d24d7b13 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:16.460586 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d749bbd-912d-4a14-a177-3072d24d7b13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:16.469477 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d749bbd-912d-4a14-a177-3072d24d7b13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:16.470933 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d749bbd-912d-4a14-a177-3072d24d7b13 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:16.481352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1268/2535] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:38:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:38:16.976227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1c3db-09cf-49c4-a142-85fba1e8ebc0 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:17.037106 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1c3db-09cf-49c4-a142-85fba1e8ebc0 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:17.041920 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b5e65-7764-44ee-8d01-af50878b34b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:17.042778 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b5e65-7764-44ee-8d01-af50878b34b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:17.043064 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b5e65-7764-44ee-8d01-af50878b34b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:17.043339 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b5e65-7764-44ee-8d01-af50878b34b0 admin admin] PATH_INFO: `/v3/users/da36718364c3434aaeb9ec43243a4610` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:17.045055 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b5e65-7764-44ee-8d01-af50878b34b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da36718364c3434aaeb9ec43243a4610)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:17.047022 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086b5e65-7764-44ee-8d01-af50878b34b0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:17.092682 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-086b5e65-7764-44ee-8d01-af50878b34b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da36718364c3434aaeb9ec43243a4610'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:17.104368 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-086b5e65-7764-44ee-8d01-af50878b34b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da36718364c3434aaeb9ec43243a4610'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:17.105055 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-086b5e65-7764-44ee-8d01-af50878b34b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da36718364c3434aaeb9ec43243a4610'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:17.105679 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-086b5e65-7764-44ee-8d01-af50878b34b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da36718364c3434aaeb9ec43243a4610'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:17.114122 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-086b5e65-7764-44ee-8d01-af50878b34b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da36718364c3434aaeb9ec43243a4610'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:17.126578 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1268/2536] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:38:16 2022] DELETE /identity/v3/users/da36718364c3434aaeb9ec43243a4610 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:38:17.131039 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf621c-111b-438d-8798-ec0704dea326 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:17.131513 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf621c-111b-438d-8798-ec0704dea326 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:17.131619 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf621c-111b-438d-8798-ec0704dea326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:17.154265 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-1bdf621c-111b-438d-8798-ec0704dea326 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:38:17.154265 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1bdf621c-111b-438d-8798-ec0704dea326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:17.207761 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1269/2537] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:38:17.217318 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b5e65-7764-44ee-8d01-af50878b34b0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:17.218824 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-086b5e65-7764-44ee-8d01-af50878b34b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:17.284212 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b5e65-7764-44ee-8d01-af50878b34b0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:17.289753 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c8d56-68e6-44eb-8d6a-026cebfbd862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:17.290457 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c8d56-68e6-44eb-8d6a-026cebfbd862 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:17.290648 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c8d56-68e6-44eb-8d6a-026cebfbd862 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:17.290924 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c8d56-68e6-44eb-8d6a-026cebfbd862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:17.301596 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c8d56-68e6-44eb-8d6a-026cebfbd862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:17.303077 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c8d56-68e6-44eb-8d6a-026cebfbd862 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:17.313896 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1269/2538] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:38:17.331543 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf621c-111b-438d-8798-ec0704dea326 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:17.333040 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1bdf621c-111b-438d-8798-ec0704dea326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:17.349523 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf621c-111b-438d-8798-ec0704dea326 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:17.354944 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76199ffd-e12f-495e-bf48-0e1726fc1603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:17.355694 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76199ffd-e12f-495e-bf48-0e1726fc1603 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:17.355981 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76199ffd-e12f-495e-bf48-0e1726fc1603 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:17.357504 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76199ffd-e12f-495e-bf48-0e1726fc1603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:17.359782 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-76199ffd-e12f-495e-bf48-0e1726fc1603 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:17.440856 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76199ffd-e12f-495e-bf48-0e1726fc1603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:17.442352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76199ffd-e12f-495e-bf48-0e1726fc1603 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:17.454537 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1270/2539] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:38:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:38:17.653897 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c8d56-68e6-44eb-8d6a-026cebfbd862 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:17.655323 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d01c8d56-68e6-44eb-8d6a-026cebfbd862 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:17.669425 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c8d56-68e6-44eb-8d6a-026cebfbd862 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:17.675867 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49384f-44b9-4879-89c1-c3eff925d7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:17.676809 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49384f-44b9-4879-89c1-c3eff925d7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:17.677285 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49384f-44b9-4879-89c1-c3eff925d7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:17.677717 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49384f-44b9-4879-89c1-c3eff925d7e5 admin admin] PATH_INFO: `/v3/projects/6f9bea7a44f54ac7880e0dc4735373ff` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:17.679099 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49384f-44b9-4879-89c1-c3eff925d7e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f9bea7a44f54ac7880e0dc4735373ff)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:17.681094 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d49384f-44b9-4879-89c1-c3eff925d7e5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:17.730068 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7d49384f-44b9-4879-89c1-c3eff925d7e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f9bea7a44f54ac7880e0dc4735373ff', 'request_id': 'req-7d49384f-44b9-4879-89c1-c3eff925d7e5'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:17.737670 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7d49384f-44b9-4879-89c1-c3eff925d7e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f9bea7a44f54ac7880e0dc4735373ff', 'request_id': 'req-7d49384f-44b9-4879-89c1-c3eff925d7e5'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:17.743147 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7d49384f-44b9-4879-89c1-c3eff925d7e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f9bea7a44f54ac7880e0dc4735373ff', 'request_id': 'req-7d49384f-44b9-4879-89c1-c3eff925d7e5'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:17.754463 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7d49384f-44b9-4879-89c1-c3eff925d7e5 admin admin] The token cache is being invalidate because project 6f9bea7a44f54ac7880e0dc4735373ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:38:17.754753 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7d49384f-44b9-4879-89c1-c3eff925d7e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:17.755412 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7d49384f-44b9-4879-89c1-c3eff925d7e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:17.756996 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1270/2540] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:38:17 2022] DELETE /identity/v3/projects/6f9bea7a44f54ac7880e0dc4735373ff => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:38:17.760870 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76199ffd-e12f-495e-bf48-0e1726fc1603 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:17.770971 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76199ffd-e12f-495e-bf48-0e1726fc1603 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:17.835502 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383db879-c0e8-404d-b21d-135dba9fe2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:17.836911 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383db879-c0e8-404d-b21d-135dba9fe2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:17.837194 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383db879-c0e8-404d-b21d-135dba9fe2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:17.837570 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383db879-c0e8-404d-b21d-135dba9fe2f1 admin admin] PATH_INFO: `/v3/users/1a2253f6bf4d4b2fa38bd70cad47112d` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:17.838777 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383db879-c0e8-404d-b21d-135dba9fe2f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a2253f6bf4d4b2fa38bd70cad47112d)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:17.840709 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383db879-c0e8-404d-b21d-135dba9fe2f1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:17.891501 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-383db879-c0e8-404d-b21d-135dba9fe2f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a2253f6bf4d4b2fa38bd70cad47112d'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:17.898417 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-383db879-c0e8-404d-b21d-135dba9fe2f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a2253f6bf4d4b2fa38bd70cad47112d'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:17.909725 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-383db879-c0e8-404d-b21d-135dba9fe2f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a2253f6bf4d4b2fa38bd70cad47112d'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:17.910436 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-383db879-c0e8-404d-b21d-135dba9fe2f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a2253f6bf4d4b2fa38bd70cad47112d'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:17.911036 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-383db879-c0e8-404d-b21d-135dba9fe2f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a2253f6bf4d4b2fa38bd70cad47112d'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:17.926698 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1271/2541] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:38:17 2022] DELETE /identity/v3/users/1a2253f6bf4d4b2fa38bd70cad47112d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:38:18.208751 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49384f-44b9-4879-89c1-c3eff925d7e5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:18.210320 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7d49384f-44b9-4879-89c1-c3eff925d7e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:18.224278 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49384f-44b9-4879-89c1-c3eff925d7e5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:18.281810 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c2b10-3a5b-4a18-a098-08b01e895f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:18.282647 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c2b10-3a5b-4a18-a098-08b01e895f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:18.282928 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c2b10-3a5b-4a18-a098-08b01e895f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:18.283200 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c2b10-3a5b-4a18-a098-08b01e895f2d admin admin] PATH_INFO: `/v3/projects/6ab01a899c4e44e3961569dd6594dee3` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:18.284376 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c2b10-3a5b-4a18-a098-08b01e895f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ab01a899c4e44e3961569dd6594dee3)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:18.286333 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c2b10-3a5b-4a18-a098-08b01e895f2d admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:18.330683 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d40c2b10-3a5b-4a18-a098-08b01e895f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ab01a899c4e44e3961569dd6594dee3', 'request_id': 'req-d40c2b10-3a5b-4a18-a098-08b01e895f2d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:18.337732 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d40c2b10-3a5b-4a18-a098-08b01e895f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ab01a899c4e44e3961569dd6594dee3', 'request_id': 'req-d40c2b10-3a5b-4a18-a098-08b01e895f2d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:18.343685 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d40c2b10-3a5b-4a18-a098-08b01e895f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ab01a899c4e44e3961569dd6594dee3', 'request_id': 'req-d40c2b10-3a5b-4a18-a098-08b01e895f2d'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:18.354451 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d40c2b10-3a5b-4a18-a098-08b01e895f2d admin admin] The token cache is being invalidate because project 6ab01a899c4e44e3961569dd6594dee3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:38:18.354735 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d40c2b10-3a5b-4a18-a098-08b01e895f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:18.355377 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d40c2b10-3a5b-4a18-a098-08b01e895f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:18.357807 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1271/2542] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:38:18 2022] DELETE /identity/v3/projects/6ab01a899c4e44e3961569dd6594dee3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:38:18.362735 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853f332-4a7f-4d10-a042-c72f3bdca025 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:18.363238 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853f332-4a7f-4d10-a042-c72f3bdca025 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:18.363334 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853f332-4a7f-4d10-a042-c72f3bdca025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:18.382486 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4853f332-4a7f-4d10-a042-c72f3bdca025 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:38:18.383886 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4853f332-4a7f-4d10-a042-c72f3bdca025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:18.457864 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1272/2543] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:38:18.467796 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1959a9-311a-426a-a691-755f333fede8 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:18.468086 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1959a9-311a-426a-a691-755f333fede8 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:18.468365 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1959a9-311a-426a-a691-755f333fede8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:18.495891 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-7b1959a9-311a-426a-a691-755f333fede8 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:38:18.497108 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-7b1959a9-311a-426a-a691-755f333fede8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:18.509519 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1272/2544] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:38:18.512488 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853f332-4a7f-4d10-a042-c72f3bdca025 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:18.522952 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853f332-4a7f-4d10-a042-c72f3bdca025 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:18.527746 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803911fd-71dc-4e5b-9304-aebdedb58658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:18.528416 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803911fd-71dc-4e5b-9304-aebdedb58658 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:18.528726 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803911fd-71dc-4e5b-9304-aebdedb58658 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:18.529598 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803911fd-71dc-4e5b-9304-aebdedb58658 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:18.530338 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803911fd-71dc-4e5b-9304-aebdedb58658 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:38:18.530644 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803911fd-71dc-4e5b-9304-aebdedb58658 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:18.532273 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803911fd-71dc-4e5b-9304-aebdedb58658 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:18.545185 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1273/2545] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:38:18.549725 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1959a9-311a-426a-a691-755f333fede8 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:18.559313 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1959a9-311a-426a-a691-755f333fede8 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:18.564164 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cfef4-f5f8-4801-ac1f-5fc4e0852b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:18.564827 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cfef4-f5f8-4801-ac1f-5fc4e0852b59 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:18.565105 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cfef4-f5f8-4801-ac1f-5fc4e0852b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:18.565412 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cfef4-f5f8-4801-ac1f-5fc4e0852b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:18.566110 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cfef4-f5f8-4801-ac1f-5fc4e0852b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:18.568093 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cfef4-f5f8-4801-ac1f-5fc4e0852b59 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:18.598023 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1273/2546] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:38:18 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:38:18.599433 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803911fd-71dc-4e5b-9304-aebdedb58658 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:18.609352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803911fd-71dc-4e5b-9304-aebdedb58658 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:18.672106 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a42e2c-a60f-47b9-9821-25f9d251c654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:18.672816 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a42e2c-a60f-47b9-9821-25f9d251c654 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:18.673065 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a42e2c-a60f-47b9-9821-25f9d251c654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:18.673374 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a42e2c-a60f-47b9-9821-25f9d251c654 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:18.674076 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a42e2c-a60f-47b9-9821-25f9d251c654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:18.676098 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a42e2c-a60f-47b9-9821-25f9d251c654 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:18.700301 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1274/2547] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:38:18 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:38:18.705141 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cfef4-f5f8-4801-ac1f-5fc4e0852b59 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:18.728559 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cfef4-f5f8-4801-ac1f-5fc4e0852b59 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:18.734410 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d37bd-322d-456b-8085-af4a6b27eaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:18.735385 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d37bd-322d-456b-8085-af4a6b27eaee admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:18.735884 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d37bd-322d-456b-8085-af4a6b27eaee admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:18.736375 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d37bd-322d-456b-8085-af4a6b27eaee admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:18.737409 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d37bd-322d-456b-8085-af4a6b27eaee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:18.739259 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d37bd-322d-456b-8085-af4a6b27eaee admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:18.752867 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1274/2548] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:38:18.757156 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a42e2c-a60f-47b9-9821-25f9d251c654 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:18.770311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a42e2c-a60f-47b9-9821-25f9d251c654 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:18.775402 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea4bcc-1284-4cf2-8012-8717a9573cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:18.776088 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea4bcc-1284-4cf2-8012-8717a9573cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:18.776374 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea4bcc-1284-4cf2-8012-8717a9573cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:18.776647 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea4bcc-1284-4cf2-8012-8717a9573cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:18.777408 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea4bcc-1284-4cf2-8012-8717a9573cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:18.779829 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea4bcc-1284-4cf2-8012-8717a9573cf1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:18.793297 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1275/2549] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:38:18.796349 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d37bd-322d-456b-8085-af4a6b27eaee admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:18.807466 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d37bd-322d-456b-8085-af4a6b27eaee admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:18.814015 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e32eda-5085-49c6-bb83-6db210e08c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:18.814907 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e32eda-5085-49c6-bb83-6db210e08c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:18.815189 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e32eda-5085-49c6-bb83-6db210e08c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:18.815461 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e32eda-5085-49c6-bb83-6db210e08c50 admin admin] PATH_INFO: `/v3/projects/7e5222e96e134b27b8a588f1309a0097/users/87279464d1b74c0d88c95f4dec9871ae/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:18.835660 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e32eda-5085-49c6-bb83-6db210e08c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e5222e96e134b27b8a588f1309a0097, user_id=87279464d1b74c0d88c95f4dec9871ae, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:18.838399 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e32eda-5085-49c6-bb83-6db210e08c50 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:18.860699 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1275/2550] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:38:18 2022] PUT /identity/v3/projects/7e5222e96e134b27b8a588f1309a0097/users/87279464d1b74c0d88c95f4dec9871ae/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:38:18.860829 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4743e20-91b9-4e05-aee8-1c28f98c6b70 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:18.860829 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4743e20-91b9-4e05-aee8-1c28f98c6b70 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:18.860829 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4743e20-91b9-4e05-aee8-1c28f98c6b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:18.879996 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-e4743e20-91b9-4e05-aee8-1c28f98c6b70 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:38:18.881240 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e4743e20-91b9-4e05-aee8-1c28f98c6b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:18.941200 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1276/2551] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:38:18.951307 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e32eda-5085-49c6-bb83-6db210e08c50 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:18.953224 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-32e32eda-5085-49c6-bb83-6db210e08c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:19.015770 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e32eda-5085-49c6-bb83-6db210e08c50 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:19.019741 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddfeb4-b413-4be4-a77a-a1393784634d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:19.020375 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddfeb4-b413-4be4-a77a-a1393784634d service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:19.020656 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddfeb4-b413-4be4-a77a-a1393784634d service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:19.020929 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddfeb4-b413-4be4-a77a-a1393784634d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:19.030305 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ddfeb4-b413-4be4-a77a-a1393784634d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:19.031779 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ddfeb4-b413-4be4-a77a-a1393784634d service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:19.041428 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1276/2552] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:38:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:38:24.491000 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4743e20-91b9-4e05-aee8-1c28f98c6b70 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:24.492477 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e4743e20-91b9-4e05-aee8-1c28f98c6b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:24.515874 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4743e20-91b9-4e05-aee8-1c28f98c6b70 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:24.527609 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b0ddd-4acb-45c7-a570-6c2cdcdde18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:24.530052 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b0ddd-4acb-45c7-a570-6c2cdcdde18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:24.530550 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b0ddd-4acb-45c7-a570-6c2cdcdde18c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:24.532295 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b0ddd-4acb-45c7-a570-6c2cdcdde18c admin admin] PATH_INFO: `/v3/users/ae34f18423784b6d9e9bd45f2fa796e2` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:24.535084 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b0ddd-4acb-45c7-a570-6c2cdcdde18c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae34f18423784b6d9e9bd45f2fa796e2)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:24.539074 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b0ddd-4acb-45c7-a570-6c2cdcdde18c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:24.642112 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-9d6b0ddd-4acb-45c7-a570-6c2cdcdde18c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae34f18423784b6d9e9bd45f2fa796e2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:24.649761 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-9d6b0ddd-4acb-45c7-a570-6c2cdcdde18c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae34f18423784b6d9e9bd45f2fa796e2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:24.676235 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-9d6b0ddd-4acb-45c7-a570-6c2cdcdde18c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae34f18423784b6d9e9bd45f2fa796e2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:24.677225 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-9d6b0ddd-4acb-45c7-a570-6c2cdcdde18c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae34f18423784b6d9e9bd45f2fa796e2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:24.678062 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-9d6b0ddd-4acb-45c7-a570-6c2cdcdde18c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae34f18423784b6d9e9bd45f2fa796e2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:24.699639 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1277/2553] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:38:24 2022] DELETE /identity/v3/users/ae34f18423784b6d9e9bd45f2fa796e2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:38:24.949004 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b244a-b030-4a05-85d6-2f08f72addf3 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:24.949982 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b244a-b030-4a05-85d6-2f08f72addf3 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:24.950249 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b244a-b030-4a05-85d6-2f08f72addf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:24.972117 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-2e8b244a-b030-4a05-85d6-2f08f72addf3 None None] MFA Rules not processed for user `737d115302cb48bb90f8c4771d6ad7f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:38:24.973397 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2e8b244a-b030-4a05-85d6-2f08f72addf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:25.049891 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1277/2554] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:38:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:38:25.159454 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b0ddd-4acb-45c7-a570-6c2cdcdde18c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:25.160895 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9d6b0ddd-4acb-45c7-a570-6c2cdcdde18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:25.288204 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b0ddd-4acb-45c7-a570-6c2cdcdde18c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:25.296311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee1422-42cf-4f98-8d8c-c157ea0da366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:25.297492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee1422-42cf-4f98-8d8c-c157ea0da366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:25.297985 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee1422-42cf-4f98-8d8c-c157ea0da366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:25.298507 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee1422-42cf-4f98-8d8c-c157ea0da366 admin admin] PATH_INFO: `/v3/projects/a642dcc1cb8a4c1bbd3b1450e060c74c` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:25.300381 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee1422-42cf-4f98-8d8c-c157ea0da366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a642dcc1cb8a4c1bbd3b1450e060c74c)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:25.302527 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee1422-42cf-4f98-8d8c-c157ea0da366 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:25.391328 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-55ee1422-42cf-4f98-8d8c-c157ea0da366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'request_id': 'req-55ee1422-42cf-4f98-8d8c-c157ea0da366'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:25.413742 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-55ee1422-42cf-4f98-8d8c-c157ea0da366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'request_id': 'req-55ee1422-42cf-4f98-8d8c-c157ea0da366'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:25.425838 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-55ee1422-42cf-4f98-8d8c-c157ea0da366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a642dcc1cb8a4c1bbd3b1450e060c74c', 'request_id': 'req-55ee1422-42cf-4f98-8d8c-c157ea0da366'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:25.448797 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-55ee1422-42cf-4f98-8d8c-c157ea0da366 admin admin] The token cache is being invalidate because project a642dcc1cb8a4c1bbd3b1450e060c74c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:38:25.449133 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-55ee1422-42cf-4f98-8d8c-c157ea0da366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:25.451952 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-55ee1422-42cf-4f98-8d8c-c157ea0da366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:38:25.473303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1278/2555] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:38:25 2022] DELETE /identity/v3/projects/a642dcc1cb8a4c1bbd3b1450e060c74c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:38:25.739843 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b244a-b030-4a05-85d6-2f08f72addf3 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:25.741675 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2e8b244a-b030-4a05-85d6-2f08f72addf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:25.821583 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b244a-b030-4a05-85d6-2f08f72addf3 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:25.943035 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4598a9-4528-4446-8f86-8bd06eacae38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:25.943878 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4598a9-4528-4446-8f86-8bd06eacae38 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:25.944487 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4598a9-4528-4446-8f86-8bd06eacae38 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:25.944615 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4598a9-4528-4446-8f86-8bd06eacae38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:25.946886 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3a4598a9-4528-4446-8f86-8bd06eacae38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:25.960523 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4598a9-4528-4446-8f86-8bd06eacae38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:25.963514 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4598a9-4528-4446-8f86-8bd06eacae38 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:25.973882 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1278/2556] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:38:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:38:26.224562 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4eabb-b2a0-47e5-a6f3-c8111a3b554d None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:26.225047 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4eabb-b2a0-47e5-a6f3-c8111a3b554d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:26.225135 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4eabb-b2a0-47e5-a6f3-c8111a3b554d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:26.247929 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-7af4eabb-b2a0-47e5-a6f3-c8111a3b554d None None] MFA Rules not processed for user `9d3207da0fb24b3f8f329b6837fd9376`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:38:26.249200 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7af4eabb-b2a0-47e5-a6f3-c8111a3b554d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:26.316100 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1279/2557] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:38:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:38:26.328131 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4598a9-4528-4446-8f86-8bd06eacae38 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:26.329907 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3a4598a9-4528-4446-8f86-8bd06eacae38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:26.417964 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4598a9-4528-4446-8f86-8bd06eacae38 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:26.425468 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb2dfe-1aab-498f-a7ca-c5c5c543a533 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:26.426191 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb2dfe-1aab-498f-a7ca-c5c5c543a533 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:26.426549 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb2dfe-1aab-498f-a7ca-c5c5c543a533 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:26.426895 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb2dfe-1aab-498f-a7ca-c5c5c543a533 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:26.429165 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-accb2dfe-1aab-498f-a7ca-c5c5c543a533 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:26.446418 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb2dfe-1aab-498f-a7ca-c5c5c543a533 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:26.448370 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb2dfe-1aab-498f-a7ca-c5c5c543a533 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:26.464745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1279/2558] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:38:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:38:26.573046 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4eabb-b2a0-47e5-a6f3-c8111a3b554d None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:26.579189 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7af4eabb-b2a0-47e5-a6f3-c8111a3b554d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:26.684423 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4eabb-b2a0-47e5-a6f3-c8111a3b554d None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:26.689784 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b0a51-a66f-4465-b552-3da00a62a429 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc233f62146a49099216c6236fb2ee2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:26.690867 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b0a51-a66f-4465-b552-3da00a62a429 service placement] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:26.691683 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b0a51-a66f-4465-b552-3da00a62a429 service placement] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:26.692096 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b0a51-a66f-4465-b552-3da00a62a429 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:26.694183 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f45b0a51-a66f-4465-b552-3da00a62a429 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:26.707104 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b0a51-a66f-4465-b552-3da00a62a429 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:26.708715 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b0a51-a66f-4465-b552-3da00a62a429 service placement] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:26.721122 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1280/2559] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:38:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:38:26.761682 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd482e-6abf-44f7-8c70-139f534e5fcf None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:26.761969 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd482e-6abf-44f7-8c70-139f534e5fcf None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:26.762245 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd482e-6abf-44f7-8c70-139f534e5fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:26.822270 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-6cbd482e-6abf-44f7-8c70-139f534e5fcf None None] MFA Rules not processed for user `87279464d1b74c0d88c95f4dec9871ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:38:26.824610 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6cbd482e-6abf-44f7-8c70-139f534e5fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:26.891311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b0a51-a66f-4465-b552-3da00a62a429 service placement] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:26.893172 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f45b0a51-a66f-4465-b552-3da00a62a429 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:26.905970 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b0a51-a66f-4465-b552-3da00a62a429 service placement] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:26.909919 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44ad1a-01e8-4374-8c17-8b43c0ae0e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:26.910551 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1280/2560] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:38:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:38:26.910707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44ad1a-01e8-4374-8c17-8b43c0ae0e03 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:26.910903 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44ad1a-01e8-4374-8c17-8b43c0ae0e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:26.911261 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f44ad1a-01e8-4374-8c17-8b43c0ae0e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:26.913189 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-6f44ad1a-01e8-4374-8c17-8b43c0ae0e03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:26.915208 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd482e-6abf-44f7-8c70-139f534e5fcf None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:26.917162 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6cbd482e-6abf-44f7-8c70-139f534e5fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:26.924263 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44ad1a-01e8-4374-8c17-8b43c0ae0e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:26.926002 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f44ad1a-01e8-4374-8c17-8b43c0ae0e03 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:26.936976 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1281/2561] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:38:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:38:26.987547 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd482e-6abf-44f7-8c70-139f534e5fcf None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:26.992337 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e5f76-2e03-4b83-bdc8-f142cfd03feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:26.993065 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e5f76-2e03-4b83-bdc8-f142cfd03feb admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:26.993436 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e5f76-2e03-4b83-bdc8-f142cfd03feb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:26.993780 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e5f76-2e03-4b83-bdc8-f142cfd03feb admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:26.994596 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e5f76-2e03-4b83-bdc8-f142cfd03feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:26.996588 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e5f76-2e03-4b83-bdc8-f142cfd03feb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:27.035832 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1281/2562] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:38:26 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:38:27.037002 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44ad1a-01e8-4374-8c17-8b43c0ae0e03 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:27.050221 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f44ad1a-01e8-4374-8c17-8b43c0ae0e03 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:27.115120 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fe9a4-3822-449d-aa4e-07b9d011de6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:27.115841 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fe9a4-3822-449d-aa4e-07b9d011de6d admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:27.116165 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fe9a4-3822-449d-aa4e-07b9d011de6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:27.116445 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fe9a4-3822-449d-aa4e-07b9d011de6d admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:27.117137 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fe9a4-3822-449d-aa4e-07b9d011de6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:27.119140 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fe9a4-3822-449d-aa4e-07b9d011de6d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:27.141240 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1282/2563] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:38:27 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:38:27.145516 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e5f76-2e03-4b83-bdc8-f142cfd03feb admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:27.156932 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e5f76-2e03-4b83-bdc8-f142cfd03feb admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:27.170804 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4ccf8-3aae-4ab9-bcb7-2e092037de1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:27.171530 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4ccf8-3aae-4ab9-bcb7-2e092037de1a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:27.171812 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4ccf8-3aae-4ab9-bcb7-2e092037de1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:27.172090 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4ccf8-3aae-4ab9-bcb7-2e092037de1a admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:27.173000 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4ccf8-3aae-4ab9-bcb7-2e092037de1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:27.175030 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4ccf8-3aae-4ab9-bcb7-2e092037de1a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:27.188341 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1282/2564] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:38:27.192446 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fe9a4-3822-449d-aa4e-07b9d011de6d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:27.203477 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fe9a4-3822-449d-aa4e-07b9d011de6d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:27.208537 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1bf67-c7e8-4340-a1dd-8f1882d711c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:27.209842 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1bf67-c7e8-4340-a1dd-8f1882d711c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:27.210198 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1bf67-c7e8-4340-a1dd-8f1882d711c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:27.210474 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1bf67-c7e8-4340-a1dd-8f1882d711c3 admin admin] PATH_INFO: `/v3/projects/ce46f124ede2450ba8a7d3c4c8c78566/users/a45793cbaf304d7f97a3a501d9822392/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:27.228591 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1bf67-c7e8-4340-a1dd-8f1882d711c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce46f124ede2450ba8a7d3c4c8c78566, user_id=a45793cbaf304d7f97a3a501d9822392, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:27.231351 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1bf67-c7e8-4340-a1dd-8f1882d711c3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:27.245148 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1283/2565] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:38:27 2022] PUT /identity/v3/projects/ce46f124ede2450ba8a7d3c4c8c78566/users/a45793cbaf304d7f97a3a501d9822392/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:38:27.249676 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4ccf8-3aae-4ab9-bcb7-2e092037de1a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:27.272838 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4ccf8-3aae-4ab9-bcb7-2e092037de1a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:27.359275 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663ece1-9068-42ad-b30d-3b9b7d04dfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:27.359955 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663ece1-9068-42ad-b30d-3b9b7d04dfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:27.360238 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663ece1-9068-42ad-b30d-3b9b7d04dfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:27.360624 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663ece1-9068-42ad-b30d-3b9b7d04dfe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:27.361543 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663ece1-9068-42ad-b30d-3b9b7d04dfe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:27.363175 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663ece1-9068-42ad-b30d-3b9b7d04dfe7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:27.378535 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1283/2566] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:38:27.383130 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1bf67-c7e8-4340-a1dd-8f1882d711c3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:27.397355 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1bf67-c7e8-4340-a1dd-8f1882d711c3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:27.404462 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd08f5-953e-462e-aae0-f0590fd17328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:27.405631 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd08f5-953e-462e-aae0-f0590fd17328 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:27.406094 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd08f5-953e-462e-aae0-f0590fd17328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:27.406371 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd08f5-953e-462e-aae0-f0590fd17328 admin admin] PATH_INFO: `/v3/projects/ce46f124ede2450ba8a7d3c4c8c78566/users/a45793cbaf304d7f97a3a501d9822392/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:27.408776 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd08f5-953e-462e-aae0-f0590fd17328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce46f124ede2450ba8a7d3c4c8c78566, user_id=a45793cbaf304d7f97a3a501d9822392, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:27.411433 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd08f5-953e-462e-aae0-f0590fd17328 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:27.422471 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1284/2567] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:38:27 2022] PUT /identity/v3/projects/ce46f124ede2450ba8a7d3c4c8c78566/users/a45793cbaf304d7f97a3a501d9822392/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:38:28.991398 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663ece1-9068-42ad-b30d-3b9b7d04dfe7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:29.129606 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663ece1-9068-42ad-b30d-3b9b7d04dfe7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:29.260419 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418de73f-bc2a-4482-b669-0244739d5453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:29.261289 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418de73f-bc2a-4482-b669-0244739d5453 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:29.261670 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418de73f-bc2a-4482-b669-0244739d5453 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:29.262187 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418de73f-bc2a-4482-b669-0244739d5453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:29.267495 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-418de73f-bc2a-4482-b669-0244739d5453 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:29.290990 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418de73f-bc2a-4482-b669-0244739d5453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:29.308513 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418de73f-bc2a-4482-b669-0244739d5453 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:29.352478 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1284/2568] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:38:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:38:32.748560 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd08f5-953e-462e-aae0-f0590fd17328 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:32.863472 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd08f5-953e-462e-aae0-f0590fd17328 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:32.875295 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd31c06-97b0-435b-825c-68ad66142978 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:32.875971 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd31c06-97b0-435b-825c-68ad66142978 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:32.876438 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd31c06-97b0-435b-825c-68ad66142978 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:32.876720 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd31c06-97b0-435b-825c-68ad66142978 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:32.879674 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-acd31c06-97b0-435b-825c-68ad66142978 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:32.897234 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd31c06-97b0-435b-825c-68ad66142978 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:32.899022 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd31c06-97b0-435b-825c-68ad66142978 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:32.915807 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1285/2569] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:38:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:38:35.234386 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e2cea-74d7-416b-853a-6394b91aea01 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:35.234940 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e2cea-74d7-416b-853a-6394b91aea01 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:35.234940 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e2cea-74d7-416b-853a-6394b91aea01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:35.262148 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-ef1e2cea-74d7-416b-853a-6394b91aea01 None None] MFA Rules not processed for user `a45793cbaf304d7f97a3a501d9822392`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:38:35.263926 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ef1e2cea-74d7-416b-853a-6394b91aea01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:35.334841 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1285/2570] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:38:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:38:35.347234 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd31c06-97b0-435b-825c-68ad66142978 service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:35.359994 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd31c06-97b0-435b-825c-68ad66142978 service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:35.366402 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a01fa-0ae3-4b70-8724-06be60e536b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:35.366984 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a01fa-0ae3-4b70-8724-06be60e536b6 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:35.367264 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a01fa-0ae3-4b70-8724-06be60e536b6 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:35.367533 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a01fa-0ae3-4b70-8724-06be60e536b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:35.424816 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a01fa-0ae3-4b70-8724-06be60e536b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:35.426589 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a01fa-0ae3-4b70-8724-06be60e536b6 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:35.437500 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1286/2571] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:38:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:38:39.457755 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e2cea-74d7-416b-853a-6394b91aea01 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:39.479249 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e2cea-74d7-416b-853a-6394b91aea01 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:39.491631 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd774f3b-7cf1-4a65-b03e-fc6f5e6e76ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:39.492290 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd774f3b-7cf1-4a65-b03e-fc6f5e6e76ac service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:39.492564 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd774f3b-7cf1-4a65-b03e-fc6f5e6e76ac service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:39.492835 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd774f3b-7cf1-4a65-b03e-fc6f5e6e76ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:39.497588 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fd774f3b-7cf1-4a65-b03e-fc6f5e6e76ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:39.510927 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd774f3b-7cf1-4a65-b03e-fc6f5e6e76ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:39.513458 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd774f3b-7cf1-4a65-b03e-fc6f5e6e76ac service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:39.530039 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1286/2572] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:38:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:38:40.399324 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a01fa-0ae3-4b70-8724-06be60e536b6 service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:38:40.400989 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3a3a01fa-0ae3-4b70-8724-06be60e536b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:40.420803 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a01fa-0ae3-4b70-8724-06be60e536b6 service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:38:40.427441 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da8cf0-afcf-4126-93a4-6e3ccf9fdaad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:38:40.428472 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da8cf0-afcf-4126-93a4-6e3ccf9fdaad service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:40.429122 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da8cf0-afcf-4126-93a4-6e3ccf9fdaad service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:40.429681 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da8cf0-afcf-4126-93a4-6e3ccf9fdaad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:40.431859 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f1da8cf0-afcf-4126-93a4-6e3ccf9fdaad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:40.446286 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da8cf0-afcf-4126-93a4-6e3ccf9fdaad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:38:40.448756 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da8cf0-afcf-4126-93a4-6e3ccf9fdaad service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:38:40.471427 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1287/2573] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:38:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:38:53.224007 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b372058-1300-47ba-9d7b-597796a99736 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:38:53.224471 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b372058-1300-47ba-9d7b-597796a99736 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:38:53.224563 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b372058-1300-47ba-9d7b-597796a99736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:38:53.242624 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-8b372058-1300-47ba-9d7b-597796a99736 None None] MFA Rules not processed for user `87279464d1b74c0d88c95f4dec9871ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:38:53.243802 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8b372058-1300-47ba-9d7b-597796a99736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:38:53.251199 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1287/2574] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:38:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:39:11.975863 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da8cf0-afcf-4126-93a4-6e3ccf9fdaad service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:11.977292 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f1da8cf0-afcf-4126-93a4-6e3ccf9fdaad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:11.988197 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da8cf0-afcf-4126-93a4-6e3ccf9fdaad service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:11.991713 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e48bc-8595-4998-ac26-5705978ebc39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:11.992335 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e48bc-8595-4998-ac26-5705978ebc39 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:11.992610 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e48bc-8595-4998-ac26-5705978ebc39 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:11.992878 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e48bc-8595-4998-ac26-5705978ebc39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:12.001985 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e48bc-8595-4998-ac26-5705978ebc39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:12.003390 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e48bc-8595-4998-ac26-5705978ebc39 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:12.012366 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1288/2575] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:39:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:39:33.870971 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b372058-1300-47ba-9d7b-597796a99736 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:33.880887 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b372058-1300-47ba-9d7b-597796a99736 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:33.884388 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f58eb-7a27-4869-93e1-42c0233f3a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:33.885010 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f58eb-7a27-4869-93e1-42c0233f3a6a service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:33.885313 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f58eb-7a27-4869-93e1-42c0233f3a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:33.885591 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f58eb-7a27-4869-93e1-42c0233f3a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:33.887349 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8e8f58eb-7a27-4869-93e1-42c0233f3a6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:33.947003 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f58eb-7a27-4869-93e1-42c0233f3a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:33.948360 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f58eb-7a27-4869-93e1-42c0233f3a6a service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:33.958340 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1288/2576] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:39:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:39:34.517574 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423be34-9a1c-4cdf-8609-497276b34237 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:34.518199 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423be34-9a1c-4cdf-8609-497276b34237 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:34.518199 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423be34-9a1c-4cdf-8609-497276b34237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:34.537064 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-c423be34-9a1c-4cdf-8609-497276b34237 None None] MFA Rules not processed for user `4d22345d2e2646cc99c74a2f9692b648`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:39:34.538332 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c423be34-9a1c-4cdf-8609-497276b34237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:34.595942 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1289/2577] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Feb 16 05:39:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:39:34.643643 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f58eb-7a27-4869-93e1-42c0233f3a6a service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:34.645069 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8e8f58eb-7a27-4869-93e1-42c0233f3a6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:34.712003 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f58eb-7a27-4869-93e1-42c0233f3a6a service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:34.718887 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905922a9-0b0a-4141-8540-5802c078ea35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eb49cac0c94e73a70361831dd789b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:34.719926 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905922a9-0b0a-4141-8540-5802c078ea35 service swift] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:34.720161 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905922a9-0b0a-4141-8540-5802c078ea35 service swift] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:34.720464 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905922a9-0b0a-4141-8540-5802c078ea35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:34.729527 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905922a9-0b0a-4141-8540-5802c078ea35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:34.731123 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905922a9-0b0a-4141-8540-5802c078ea35 service swift] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:34.739554 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1289/2578] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Feb 16 05:39:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:39:38.026940 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423be34-9a1c-4cdf-8609-497276b34237 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:38.030537 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c423be34-9a1c-4cdf-8609-497276b34237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:38.047305 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423be34-9a1c-4cdf-8609-497276b34237 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:38.062209 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81c9c3-caa7-4ab5-8b7f-47a26d194f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:38.063953 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81c9c3-caa7-4ab5-8b7f-47a26d194f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:38.064856 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81c9c3-caa7-4ab5-8b7f-47a26d194f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:38.065530 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81c9c3-caa7-4ab5-8b7f-47a26d194f71 admin admin] PATH_INFO: `/v3/users/737d115302cb48bb90f8c4771d6ad7f1` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:38.067236 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81c9c3-caa7-4ab5-8b7f-47a26d194f71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=737d115302cb48bb90f8c4771d6ad7f1)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:38.069538 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81c9c3-caa7-4ab5-8b7f-47a26d194f71 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:38.157132 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3d81c9c3-caa7-4ab5-8b7f-47a26d194f71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '737d115302cb48bb90f8c4771d6ad7f1'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:38.165965 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3d81c9c3-caa7-4ab5-8b7f-47a26d194f71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '737d115302cb48bb90f8c4771d6ad7f1'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:38.185562 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3d81c9c3-caa7-4ab5-8b7f-47a26d194f71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '737d115302cb48bb90f8c4771d6ad7f1'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:38.186619 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3d81c9c3-caa7-4ab5-8b7f-47a26d194f71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '737d115302cb48bb90f8c4771d6ad7f1'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:38.188051 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-3d81c9c3-caa7-4ab5-8b7f-47a26d194f71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '737d115302cb48bb90f8c4771d6ad7f1'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:38.210467 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1290/2579] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:39:38 2022] DELETE /identity/v3/users/737d115302cb48bb90f8c4771d6ad7f1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:39:38.439761 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905922a9-0b0a-4141-8540-5802c078ea35 service swift] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:38.454581 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905922a9-0b0a-4141-8540-5802c078ea35 service swift] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:38.544280 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaed6bc-c18a-4656-b5c5-f214510096dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:38.545953 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaed6bc-c18a-4656-b5c5-f214510096dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:38.546229 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaed6bc-c18a-4656-b5c5-f214510096dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:38.546498 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaed6bc-c18a-4656-b5c5-f214510096dd admin admin] PATH_INFO: `/v3/projects/59d95f84bb5c4548a82ead0d4d2cb38c` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:38.547687 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaed6bc-c18a-4656-b5c5-f214510096dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=59d95f84bb5c4548a82ead0d4d2cb38c)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:38.549654 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaed6bc-c18a-4656-b5c5-f214510096dd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:38.604878 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-faaed6bc-c18a-4656-b5c5-f214510096dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59d95f84bb5c4548a82ead0d4d2cb38c', 'request_id': 'req-faaed6bc-c18a-4656-b5c5-f214510096dd'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:38.614579 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-faaed6bc-c18a-4656-b5c5-f214510096dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59d95f84bb5c4548a82ead0d4d2cb38c', 'request_id': 'req-faaed6bc-c18a-4656-b5c5-f214510096dd'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:38.620853 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-faaed6bc-c18a-4656-b5c5-f214510096dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59d95f84bb5c4548a82ead0d4d2cb38c', 'request_id': 'req-faaed6bc-c18a-4656-b5c5-f214510096dd'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:38.634077 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-faaed6bc-c18a-4656-b5c5-f214510096dd admin admin] The token cache is being invalidate because project 59d95f84bb5c4548a82ead0d4d2cb38c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:39:38.634370 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-faaed6bc-c18a-4656-b5c5-f214510096dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:38.635035 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-faaed6bc-c18a-4656-b5c5-f214510096dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:38.636828 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1290/2580] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:39:38 2022] DELETE /identity/v3/projects/59d95f84bb5c4548a82ead0d4d2cb38c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:39:38.642302 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214eaa3-9981-4dd2-81d0-103561392cbc None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:38.642840 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214eaa3-9981-4dd2-81d0-103561392cbc None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:38.643353 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214eaa3-9981-4dd2-81d0-103561392cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:38.664086 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0214eaa3-9981-4dd2-81d0-103561392cbc None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:39:38.672695 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0214eaa3-9981-4dd2-81d0-103561392cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:38.743791 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1291/2581] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:39:38.754568 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dea19f-f171-4a0c-82e5-643de27cdbb2 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:38.754993 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dea19f-f171-4a0c-82e5-643de27cdbb2 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:38.755409 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dea19f-f171-4a0c-82e5-643de27cdbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:38.791287 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c1dea19f-f171-4a0c-82e5-643de27cdbb2 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:39:38.792795 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c1dea19f-f171-4a0c-82e5-643de27cdbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:38.805158 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1291/2582] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:39:38.809743 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214eaa3-9981-4dd2-81d0-103561392cbc None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:38.821833 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214eaa3-9981-4dd2-81d0-103561392cbc None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:38.827890 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3108d7-2b38-4c9a-b11d-392fbe81ab1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:38.828627 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3108d7-2b38-4c9a-b11d-392fbe81ab1a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:38.828971 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3108d7-2b38-4c9a-b11d-392fbe81ab1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:38.829339 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3108d7-2b38-4c9a-b11d-392fbe81ab1a admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:38.830071 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3108d7-2b38-4c9a-b11d-392fbe81ab1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:39:38.830372 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3108d7-2b38-4c9a-b11d-392fbe81ab1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:38.831977 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3108d7-2b38-4c9a-b11d-392fbe81ab1a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:38.846351 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1292/2583] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 16 05:39:38.850892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dea19f-f171-4a0c-82e5-643de27cdbb2 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:38.861609 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dea19f-f171-4a0c-82e5-643de27cdbb2 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:38.867873 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676875e0-0e1d-41c0-bc0a-590256efccb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:38.868603 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676875e0-0e1d-41c0-bc0a-590256efccb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:38.868942 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676875e0-0e1d-41c0-bc0a-590256efccb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:38.869298 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676875e0-0e1d-41c0-bc0a-590256efccb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:38.870070 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676875e0-0e1d-41c0-bc0a-590256efccb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:38.872161 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676875e0-0e1d-41c0-bc0a-590256efccb8 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:38.910940 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1292/2584] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:39:38 2022] POST /identity/v3/projects => generated 357 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:39:38.915505 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3108d7-2b38-4c9a-b11d-392fbe81ab1a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:38.928249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3108d7-2b38-4c9a-b11d-392fbe81ab1a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:38.994214 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9c754-172e-4eeb-be30-e9113fafa4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:38.994890 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9c754-172e-4eeb-be30-e9113fafa4eb admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:38.995377 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9c754-172e-4eeb-be30-e9113fafa4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:38.995853 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9c754-172e-4eeb-be30-e9113fafa4eb admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:38.996631 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9c754-172e-4eeb-be30-e9113fafa4eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:38.999391 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9c754-172e-4eeb-be30-e9113fafa4eb admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:39.021671 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1293/2585] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:39:38 2022] POST /identity/v3/users => generated 279 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:39:39.025683 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676875e0-0e1d-41c0-bc0a-590256efccb8 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:39.038307 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676875e0-0e1d-41c0-bc0a-590256efccb8 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:39.047395 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17891c-6d09-4326-8aef-4590ed92fdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:39.047395 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17891c-6d09-4326-8aef-4590ed92fdbc admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:39.047395 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17891c-6d09-4326-8aef-4590ed92fdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:39.047395 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17891c-6d09-4326-8aef-4590ed92fdbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:39.047843 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17891c-6d09-4326-8aef-4590ed92fdbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:39.049006 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd17891c-6d09-4326-8aef-4590ed92fdbc admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:39.060247 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1293/2586] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:39:39.064283 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9c754-172e-4eeb-be30-e9113fafa4eb admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:39.074915 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9c754-172e-4eeb-be30-e9113fafa4eb admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:39.079831 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd4312-8f33-412c-9521-9e811ef218bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:39.080557 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd4312-8f33-412c-9521-9e811ef218bd admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:39.080901 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd4312-8f33-412c-9521-9e811ef218bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:39.081310 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd4312-8f33-412c-9521-9e811ef218bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:39.082090 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd4312-8f33-412c-9521-9e811ef218bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:39.083745 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd4312-8f33-412c-9521-9e811ef218bd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:39.097631 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1294/2587] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:39:39.100984 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17891c-6d09-4326-8aef-4590ed92fdbc admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:39.113087 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd17891c-6d09-4326-8aef-4590ed92fdbc admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:39.118014 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b9485-40e3-4f01-ab79-d267d8397558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:39.118892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b9485-40e3-4f01-ab79-d267d8397558 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:39.119169 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b9485-40e3-4f01-ab79-d267d8397558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:39.119433 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b9485-40e3-4f01-ab79-d267d8397558 admin admin] PATH_INFO: `/v3/projects/a4b6372a54e145509d0e41c97c96c939/users/34658bfff808417295bf1f452599619c/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:39.138217 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b9485-40e3-4f01-ab79-d267d8397558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b6372a54e145509d0e41c97c96c939, user_id=34658bfff808417295bf1f452599619c, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:39.141080 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b9485-40e3-4f01-ab79-d267d8397558 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:39.168278 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1294/2588] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:39:39 2022] PUT /identity/v3/projects/a4b6372a54e145509d0e41c97c96c939/users/34658bfff808417295bf1f452599619c/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:39:39.170462 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89e856-fef8-4095-b516-8ac42e263fa9 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:39.170751 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89e856-fef8-4095-b516-8ac42e263fa9 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:39.171076 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89e856-fef8-4095-b516-8ac42e263fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:39.336050 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-3d89e856-fef8-4095-b516-8ac42e263fa9 None None] MFA Rules not processed for user `34658bfff808417295bf1f452599619c`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:39:39.337464 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3d89e856-fef8-4095-b516-8ac42e263fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:39.428477 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1295/2589] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:39:39 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:39:39.432839 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b9485-40e3-4f01-ab79-d267d8397558 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:39.519284 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b9485-40e3-4f01-ab79-d267d8397558 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:39.524919 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044572da-f70d-42ce-aab0-a0b1b90c4d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:39.525822 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044572da-f70d-42ce-aab0-a0b1b90c4d01 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:39.526267 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044572da-f70d-42ce-aab0-a0b1b90c4d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:39.526684 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044572da-f70d-42ce-aab0-a0b1b90c4d01 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:39.527703 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044572da-f70d-42ce-aab0-a0b1b90c4d01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:39.530263 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044572da-f70d-42ce-aab0-a0b1b90c4d01 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:39.563255 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1295/2590] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:39:39 2022] POST /identity/v3/projects => generated 355 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:39:39.567253 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89e856-fef8-4095-b516-8ac42e263fa9 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:39.579501 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89e856-fef8-4095-b516-8ac42e263fa9 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:39.659410 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12ab79-a278-49cd-8e97-b5de7b02694f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:39.660077 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12ab79-a278-49cd-8e97-b5de7b02694f admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:39.660352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12ab79-a278-49cd-8e97-b5de7b02694f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:39.660622 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12ab79-a278-49cd-8e97-b5de7b02694f admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:39.661336 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12ab79-a278-49cd-8e97-b5de7b02694f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:39.663240 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12ab79-a278-49cd-8e97-b5de7b02694f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:39.700380 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1296/2591] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:39:39 2022] POST /identity/v3/users => generated 284 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:39:39.704738 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044572da-f70d-42ce-aab0-a0b1b90c4d01 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:39.718260 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044572da-f70d-42ce-aab0-a0b1b90c4d01 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:39.723270 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8cfb7-1e6d-47c5-95b3-0474aa430ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:39.724226 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8cfb7-1e6d-47c5-95b3-0474aa430ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:39.724635 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8cfb7-1e6d-47c5-95b3-0474aa430ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:39.725144 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8cfb7-1e6d-47c5-95b3-0474aa430ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:39.726776 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8cfb7-1e6d-47c5-95b3-0474aa430ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:39.729384 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8cfb7-1e6d-47c5-95b3-0474aa430ac7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:39.741155 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1296/2592] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:39:39.745404 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12ab79-a278-49cd-8e97-b5de7b02694f admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:39.756514 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12ab79-a278-49cd-8e97-b5de7b02694f admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:39.761491 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc579b6-70b6-48b3-9a07-24e3a69f896e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:39.762395 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc579b6-70b6-48b3-9a07-24e3a69f896e admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:39.762682 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc579b6-70b6-48b3-9a07-24e3a69f896e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:39.762953 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc579b6-70b6-48b3-9a07-24e3a69f896e admin admin] PATH_INFO: `/v3/projects/26608b3279604d2f8d271ca23dec76b9/users/2261501874d84e68833151d88c06a75a/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:39.779879 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc579b6-70b6-48b3-9a07-24e3a69f896e admin admin] RBAC: Authorizing `identity:create_grant(project_id=26608b3279604d2f8d271ca23dec76b9, user_id=2261501874d84e68833151d88c06a75a, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:39.782615 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc579b6-70b6-48b3-9a07-24e3a69f896e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:39.799228 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1297/2593] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:39:39 2022] PUT /identity/v3/projects/26608b3279604d2f8d271ca23dec76b9/users/2261501874d84e68833151d88c06a75a/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:39:39.802853 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8cfb7-1e6d-47c5-95b3-0474aa430ac7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:39.814646 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8cfb7-1e6d-47c5-95b3-0474aa430ac7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:39.882409 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aeafc3-b785-4d63-a8c0-3a1ff55ee85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:39.882988 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aeafc3-b785-4d63-a8c0-3a1ff55ee85e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:39.883268 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aeafc3-b785-4d63-a8c0-3a1ff55ee85e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:39.883543 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aeafc3-b785-4d63-a8c0-3a1ff55ee85e admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:39.884304 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aeafc3-b785-4d63-a8c0-3a1ff55ee85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:39.885968 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aeafc3-b785-4d63-a8c0-3a1ff55ee85e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:39.898055 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1297/2594] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:39:39.902378 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc579b6-70b6-48b3-9a07-24e3a69f896e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:39.913035 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc579b6-70b6-48b3-9a07-24e3a69f896e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:39.921775 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af92c29-b1c6-4384-bd0d-e29e769ead08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:39.922658 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af92c29-b1c6-4384-bd0d-e29e769ead08 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:39.922933 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af92c29-b1c6-4384-bd0d-e29e769ead08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:39.923197 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af92c29-b1c6-4384-bd0d-e29e769ead08 admin admin] PATH_INFO: `/v3/projects/26608b3279604d2f8d271ca23dec76b9/users/2261501874d84e68833151d88c06a75a/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:39.925215 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af92c29-b1c6-4384-bd0d-e29e769ead08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26608b3279604d2f8d271ca23dec76b9, user_id=2261501874d84e68833151d88c06a75a, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:39.927920 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af92c29-b1c6-4384-bd0d-e29e769ead08 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:39.941133 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1298/2595] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:39:39 2022] PUT /identity/v3/projects/26608b3279604d2f8d271ca23dec76b9/users/2261501874d84e68833151d88c06a75a/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:39:39.951811 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab925e0-7244-4f75-acfa-99d8d84c28d7 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:39.952251 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab925e0-7244-4f75-acfa-99d8d84c28d7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:39.952636 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab925e0-7244-4f75-acfa-99d8d84c28d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:39.982777 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-8ab925e0-7244-4f75-acfa-99d8d84c28d7 None None] MFA Rules not processed for user `2261501874d84e68833151d88c06a75a`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:39:39.984332 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8ab925e0-7244-4f75-acfa-99d8d84c28d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:40.072904 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1298/2596] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:39:39 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:39:40.084792 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af92c29-b1c6-4384-bd0d-e29e769ead08 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:40.086622 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0af92c29-b1c6-4384-bd0d-e29e769ead08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:40.151579 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af92c29-b1c6-4384-bd0d-e29e769ead08 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:40.155290 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbabf61-813e-4030-a03c-b149ce5a13e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:40.155987 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbabf61-813e-4030-a03c-b149ce5a13e3 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:40.156410 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbabf61-813e-4030-a03c-b149ce5a13e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:40.156691 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbabf61-813e-4030-a03c-b149ce5a13e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:40.166451 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbabf61-813e-4030-a03c-b149ce5a13e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:40.167920 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbabf61-813e-4030-a03c-b149ce5a13e3 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:40.179351 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1299/2597] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:39:40 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:39:40.262363 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab925e0-7244-4f75-acfa-99d8d84c28d7 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:40.272775 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab925e0-7244-4f75-acfa-99d8d84c28d7 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:40.278346 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3706611-3d56-45c9-a7ab-c5e15935205f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:40.279202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3706611-3d56-45c9-a7ab-c5e15935205f service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:40.279487 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3706611-3d56-45c9-a7ab-c5e15935205f service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:40.279759 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3706611-3d56-45c9-a7ab-c5e15935205f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:40.347573 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3706611-3d56-45c9-a7ab-c5e15935205f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:40.349074 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3706611-3d56-45c9-a7ab-c5e15935205f service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:40.359324 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1299/2598] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:39:40 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:39:48.762368 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a7482-d936-42c4-a650-05ede8a5c647 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:48.762916 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a7482-d936-42c4-a650-05ede8a5c647 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:48.763755 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a7482-d936-42c4-a650-05ede8a5c647 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:48.765699 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1300/2599] 10.222.0.75 () {54 vars in 921 bytes} [Wed Feb 16 05:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:39:48.772236 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75521884-4a55-4497-af3c-89ea9dc53139 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:48.772704 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75521884-4a55-4497-af3c-89ea9dc53139 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:48.772817 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75521884-4a55-4497-af3c-89ea9dc53139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:48.790819 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-75521884-4a55-4497-af3c-89ea9dc53139 None None] MFA Rules not processed for user `6522d231532a48ad8dbc9c9e79a021dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:39:48.792225 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-75521884-4a55-4497-af3c-89ea9dc53139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:48.858260 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1300/2600] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Feb 16 05:39:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:39:48.869537 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a7482-d936-42c4-a650-05ede8a5c647 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:48.871203 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a05a7482-d936-42c4-a650-05ede8a5c647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:48.934480 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a7482-d936-42c4-a650-05ede8a5c647 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:48.938575 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646f46b-6b91-4379-b5fb-c5a6fcf0ed8c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8e4a7763524f4190c5cd66e27b5910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:48.939214 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646f46b-6b91-4379-b5fb-c5a6fcf0ed8c service glance] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:48.939494 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646f46b-6b91-4379-b5fb-c5a6fcf0ed8c service glance] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:48.939766 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646f46b-6b91-4379-b5fb-c5a6fcf0ed8c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:48.949677 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646f46b-6b91-4379-b5fb-c5a6fcf0ed8c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:48.951708 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646f46b-6b91-4379-b5fb-c5a6fcf0ed8c service glance] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:48.962143 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1301/2601] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:39:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:39:49.026825 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa358f-e434-4eb5-9232-95847ca0feb4 None None] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:49.027140 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa358f-e434-4eb5-9232-95847ca0feb4 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:49.027420 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa358f-e434-4eb5-9232-95847ca0feb4 None None] PATH_INFO: `/` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:49.029219 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1301/2602] 10.222.0.75 () {54 vars in 921 bytes} [Wed Feb 16 05:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:39:49.033748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8d197-db45-4f10-8f88-ba870d0e0fd2 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:49.034035 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8d197-db45-4f10-8f88-ba870d0e0fd2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:49.034306 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8d197-db45-4f10-8f88-ba870d0e0fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:49.052461 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-b1a8d197-db45-4f10-8f88-ba870d0e0fd2 None None] MFA Rules not processed for user `fd4eac62484c47988657d2a730f2d056`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:39:49.053689 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b1a8d197-db45-4f10-8f88-ba870d0e0fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:49.102129 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1302/2603] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Feb 16 05:39:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:39:49.114187 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa358f-e434-4eb5-9232-95847ca0feb4 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:49.115836 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-67aa358f-e434-4eb5-9232-95847ca0feb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:49.129074 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa358f-e434-4eb5-9232-95847ca0feb4 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:49.132549 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210f65d-9459-4222-a2fa-f577c3b11308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:49.133156 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210f65d-9459-4222-a2fa-f577c3b11308 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:49.133484 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210f65d-9459-4222-a2fa-f577c3b11308 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:49.133753 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210f65d-9459-4222-a2fa-f577c3b11308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:49.140445 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210f65d-9459-4222-a2fa-f577c3b11308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:49.142257 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210f65d-9459-4222-a2fa-f577c3b11308 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:49.149621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1302/2604] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:39:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:39:49.234012 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3304408-f051-4026-aea4-a3b716410f94 None None] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:49.234239 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3304408-f051-4026-aea4-a3b716410f94 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:49.234509 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3304408-f051-4026-aea4-a3b716410f94 None None] PATH_INFO: `/` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:49.236336 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1303/2605] 10.222.0.75 () {54 vars in 921 bytes} [Wed Feb 16 05:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 16 05:39:49.241691 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bdc41-25d0-40e5-8dd9-238c431fe8af None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:49.241979 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bdc41-25d0-40e5-8dd9-238c431fe8af None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:49.242256 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bdc41-25d0-40e5-8dd9-238c431fe8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:49.264022 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-990bdc41-25d0-40e5-8dd9-238c431fe8af None None] MFA Rules not processed for user `6522d231532a48ad8dbc9c9e79a021dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:39:49.266011 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-990bdc41-25d0-40e5-8dd9-238c431fe8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:49.280983 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1303/2606] 10.222.0.75 () {58 vars in 1018 bytes} [Wed Feb 16 05:39:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:39:49.291675 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3304408-f051-4026-aea4-a3b716410f94 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:49.303547 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3304408-f051-4026-aea4-a3b716410f94 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:49.307288 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a3acb-5071-4ed6-aa88-186d54ff07c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:49.308010 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a3acb-5071-4ed6-aa88-186d54ff07c7 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:49.308360 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a3acb-5071-4ed6-aa88-186d54ff07c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:49.308702 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a3acb-5071-4ed6-aa88-186d54ff07c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:49.319817 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a3acb-5071-4ed6-aa88-186d54ff07c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:49.321359 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a3acb-5071-4ed6-aa88-186d54ff07c7 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:49.332121 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1304/2607] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:39:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:39:51.014957 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da5b76-cfb4-4695-81f4-1cc5a9b5e275 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:51.015418 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da5b76-cfb4-4695-81f4-1cc5a9b5e275 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:51.015514 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da5b76-cfb4-4695-81f4-1cc5a9b5e275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:51.033366 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c7da5b76-cfb4-4695-81f4-1cc5a9b5e275 None None] MFA Rules not processed for user `4d22345d2e2646cc99c74a2f9692b648`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:39:51.034566 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c7da5b76-cfb4-4695-81f4-1cc5a9b5e275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:51.093694 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1304/2608] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Feb 16 05:39:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:39:51.107669 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a3acb-5071-4ed6-aa88-186d54ff07c7 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:51.110599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-de4a3acb-5071-4ed6-aa88-186d54ff07c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:51.180738 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a3acb-5071-4ed6-aa88-186d54ff07c7 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:51.185804 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3138984-6a80-4828-9e34-5b110487f5be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eb49cac0c94e73a70361831dd789b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:51.186443 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3138984-6a80-4828-9e34-5b110487f5be service swift] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:51.186723 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3138984-6a80-4828-9e34-5b110487f5be service swift] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:51.186995 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3138984-6a80-4828-9e34-5b110487f5be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:51.195027 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3138984-6a80-4828-9e34-5b110487f5be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:51.196644 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3138984-6a80-4828-9e34-5b110487f5be service swift] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:51.205032 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1305/2609] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Feb 16 05:39:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:39:55.248837 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da5b76-cfb4-4695-81f4-1cc5a9b5e275 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:55.314674 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da5b76-cfb4-4695-81f4-1cc5a9b5e275 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:55.319326 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f63a1-1b28-48aa-81d9-c0251a271a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:55.320193 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f63a1-1b28-48aa-81d9-c0251a271a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:55.320471 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f63a1-1b28-48aa-81d9-c0251a271a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:55.320741 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f63a1-1b28-48aa-81d9-c0251a271a64 admin admin] PATH_INFO: `/v3/users/34658bfff808417295bf1f452599619c` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:55.321959 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f63a1-1b28-48aa-81d9-c0251a271a64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34658bfff808417295bf1f452599619c)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:55.323896 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f63a1-1b28-48aa-81d9-c0251a271a64 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:55.370739 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0e9f63a1-1b28-48aa-81d9-c0251a271a64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34658bfff808417295bf1f452599619c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:55.383962 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0e9f63a1-1b28-48aa-81d9-c0251a271a64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34658bfff808417295bf1f452599619c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:55.384699 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0e9f63a1-1b28-48aa-81d9-c0251a271a64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34658bfff808417295bf1f452599619c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:55.385330 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0e9f63a1-1b28-48aa-81d9-c0251a271a64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34658bfff808417295bf1f452599619c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:55.394186 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0e9f63a1-1b28-48aa-81d9-c0251a271a64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34658bfff808417295bf1f452599619c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:55.409085 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1305/2610] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:39:55 2022] DELETE /identity/v3/users/34658bfff808417295bf1f452599619c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:39:55.416281 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112549d-1fc5-4237-a220-f0e55707da80 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:55.417222 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112549d-1fc5-4237-a220-f0e55707da80 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:55.417701 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0112549d-1fc5-4237-a220-f0e55707da80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:55.443019 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0112549d-1fc5-4237-a220-f0e55707da80 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:39:55.444857 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0112549d-1fc5-4237-a220-f0e55707da80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:55.527653 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1306/2611] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:39:55.537403 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f63a1-1b28-48aa-81d9-c0251a271a64 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:55.538814 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0e9f63a1-1b28-48aa-81d9-c0251a271a64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:55.601342 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f63a1-1b28-48aa-81d9-c0251a271a64 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:55.605099 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e33611-e5ad-4d38-b557-f0d6b72128ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:55.605982 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e33611-e5ad-4d38-b557-f0d6b72128ec service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:55.606354 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e33611-e5ad-4d38-b557-f0d6b72128ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:55.607305 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e33611-e5ad-4d38-b557-f0d6b72128ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:55.617466 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e33611-e5ad-4d38-b557-f0d6b72128ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:55.619072 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e33611-e5ad-4d38-b557-f0d6b72128ec service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:55.628977 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1306/2612] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:39:55.933135 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112549d-1fc5-4237-a220-f0e55707da80 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:55.935438 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0112549d-1fc5-4237-a220-f0e55707da80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:55.952463 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0112549d-1fc5-4237-a220-f0e55707da80 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:55.959027 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4d453-8ef0-4349-9cb0-689e00aeec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:55.960322 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4d453-8ef0-4349-9cb0-689e00aeec29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:55.960701 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4d453-8ef0-4349-9cb0-689e00aeec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:55.961075 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4d453-8ef0-4349-9cb0-689e00aeec29 admin admin] PATH_INFO: `/v3/projects/a4b6372a54e145509d0e41c97c96c939` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:55.962462 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4d453-8ef0-4349-9cb0-689e00aeec29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b6372a54e145509d0e41c97c96c939)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:55.970712 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4d453-8ef0-4349-9cb0-689e00aeec29 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:56.054327 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5ef4d453-8ef0-4349-9cb0-689e00aeec29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b6372a54e145509d0e41c97c96c939', 'request_id': 'req-5ef4d453-8ef0-4349-9cb0-689e00aeec29'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:56.064872 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5ef4d453-8ef0-4349-9cb0-689e00aeec29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b6372a54e145509d0e41c97c96c939', 'request_id': 'req-5ef4d453-8ef0-4349-9cb0-689e00aeec29'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:56.075825 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5ef4d453-8ef0-4349-9cb0-689e00aeec29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b6372a54e145509d0e41c97c96c939', 'request_id': 'req-5ef4d453-8ef0-4349-9cb0-689e00aeec29'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:56.087398 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5ef4d453-8ef0-4349-9cb0-689e00aeec29 admin admin] The token cache is being invalidate because project a4b6372a54e145509d0e41c97c96c939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:39:56.087708 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5ef4d453-8ef0-4349-9cb0-689e00aeec29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:56.088451 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5ef4d453-8ef0-4349-9cb0-689e00aeec29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:56.089957 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1307/2613] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:39:55 2022] DELETE /identity/v3/projects/a4b6372a54e145509d0e41c97c96c939 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:39:56.094132 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e33611-e5ad-4d38-b557-f0d6b72128ec service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:56.104477 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e33611-e5ad-4d38-b557-f0d6b72128ec service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:56.173975 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c5353-3b32-4f1a-aa46-e58112b7aa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:56.175133 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c5353-3b32-4f1a-aa46-e58112b7aa01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:56.175507 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c5353-3b32-4f1a-aa46-e58112b7aa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:56.175789 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c5353-3b32-4f1a-aa46-e58112b7aa01 admin admin] PATH_INFO: `/v3/users/2261501874d84e68833151d88c06a75a` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:56.177056 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c5353-3b32-4f1a-aa46-e58112b7aa01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2261501874d84e68833151d88c06a75a)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:56.179580 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c5353-3b32-4f1a-aa46-e58112b7aa01 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:56.231068 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-154c5353-3b32-4f1a-aa46-e58112b7aa01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2261501874d84e68833151d88c06a75a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:56.243489 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-154c5353-3b32-4f1a-aa46-e58112b7aa01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2261501874d84e68833151d88c06a75a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:56.244552 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-154c5353-3b32-4f1a-aa46-e58112b7aa01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2261501874d84e68833151d88c06a75a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:56.245162 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-154c5353-3b32-4f1a-aa46-e58112b7aa01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2261501874d84e68833151d88c06a75a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:56.254824 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-154c5353-3b32-4f1a-aa46-e58112b7aa01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2261501874d84e68833151d88c06a75a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:56.276782 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1307/2614] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:39:56 2022] DELETE /identity/v3/users/2261501874d84e68833151d88c06a75a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:39:56.567507 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4d453-8ef0-4349-9cb0-689e00aeec29 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:56.569008 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5ef4d453-8ef0-4349-9cb0-689e00aeec29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:56.587148 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4d453-8ef0-4349-9cb0-689e00aeec29 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:56.661198 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ff09b-d8c8-4ec6-9082-435125e9b44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:56.662014 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ff09b-d8c8-4ec6-9082-435125e9b44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:56.662297 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ff09b-d8c8-4ec6-9082-435125e9b44b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:56.662571 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ff09b-d8c8-4ec6-9082-435125e9b44b admin admin] PATH_INFO: `/v3/projects/26608b3279604d2f8d271ca23dec76b9` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:56.663762 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ff09b-d8c8-4ec6-9082-435125e9b44b admin admin] RBAC: Authorizing `identity:delete_project(project_id=26608b3279604d2f8d271ca23dec76b9)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:56.666329 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ff09b-d8c8-4ec6-9082-435125e9b44b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:56.719736 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-a38ff09b-d8c8-4ec6-9082-435125e9b44b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26608b3279604d2f8d271ca23dec76b9', 'request_id': 'req-a38ff09b-d8c8-4ec6-9082-435125e9b44b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:56.728123 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-a38ff09b-d8c8-4ec6-9082-435125e9b44b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26608b3279604d2f8d271ca23dec76b9', 'request_id': 'req-a38ff09b-d8c8-4ec6-9082-435125e9b44b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:56.734071 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-a38ff09b-d8c8-4ec6-9082-435125e9b44b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26608b3279604d2f8d271ca23dec76b9', 'request_id': 'req-a38ff09b-d8c8-4ec6-9082-435125e9b44b'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:56.745181 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-a38ff09b-d8c8-4ec6-9082-435125e9b44b admin admin] The token cache is being invalidate because project 26608b3279604d2f8d271ca23dec76b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:39:56.745496 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-a38ff09b-d8c8-4ec6-9082-435125e9b44b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:56.746140 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-a38ff09b-d8c8-4ec6-9082-435125e9b44b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:56.747717 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1308/2615] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:39:56 2022] DELETE /identity/v3/projects/26608b3279604d2f8d271ca23dec76b9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:39:56.752888 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282521f-13e5-48f0-895b-5fb509946c6c None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:56.753297 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282521f-13e5-48f0-895b-5fb509946c6c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:56.753675 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282521f-13e5-48f0-895b-5fb509946c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:56.774710 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-3282521f-13e5-48f0-895b-5fb509946c6c None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:39:56.776092 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3282521f-13e5-48f0-895b-5fb509946c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:56.856411 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1308/2616] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:39:56.865795 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2d768-8d27-4ee7-b413-79cb5f9ef0af None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:56.866018 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2d768-8d27-4ee7-b413-79cb5f9ef0af None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:56.866252 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2d768-8d27-4ee7-b413-79cb5f9ef0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:56.884512 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-a7b2d768-8d27-4ee7-b413-79cb5f9ef0af None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:39:56.885737 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a7b2d768-8d27-4ee7-b413-79cb5f9ef0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:56.893959 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1309/2617] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:39:56.898269 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282521f-13e5-48f0-895b-5fb509946c6c None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:56.908428 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282521f-13e5-48f0-895b-5fb509946c6c None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:56.913224 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8622c-d4c5-4d38-bfd0-50f1e5da35a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:56.913842 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8622c-d4c5-4d38-bfd0-50f1e5da35a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:56.914125 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8622c-d4c5-4d38-bfd0-50f1e5da35a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:56.914394 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8622c-d4c5-4d38-bfd0-50f1e5da35a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:56.915741 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8622c-d4c5-4d38-bfd0-50f1e5da35a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:39:56.916051 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8622c-d4c5-4d38-bfd0-50f1e5da35a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:56.918034 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8622c-d4c5-4d38-bfd0-50f1e5da35a9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:56.930241 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1309/2618] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:39:56.934470 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2d768-8d27-4ee7-b413-79cb5f9ef0af None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:56.943949 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2d768-8d27-4ee7-b413-79cb5f9ef0af None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:56.949422 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8579d-f5fd-4798-8730-fc7bf38e3b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:56.950688 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8579d-f5fd-4798-8730-fc7bf38e3b27 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:56.951076 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8579d-f5fd-4798-8730-fc7bf38e3b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:56.951554 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8579d-f5fd-4798-8730-fc7bf38e3b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:56.952330 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8579d-f5fd-4798-8730-fc7bf38e3b27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:56.954355 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8579d-f5fd-4798-8730-fc7bf38e3b27 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:56.985112 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1310/2619] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:39:56 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:39:56.986242 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8622c-d4c5-4d38-bfd0-50f1e5da35a9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:56.996994 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8622c-d4c5-4d38-bfd0-50f1e5da35a9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:57.060167 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0288b-c7d2-4e59-b768-60e52815e679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:57.061113 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0288b-c7d2-4e59-b768-60e52815e679 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:57.061628 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0288b-c7d2-4e59-b768-60e52815e679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:57.062070 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0288b-c7d2-4e59-b768-60e52815e679 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:57.062933 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0288b-c7d2-4e59-b768-60e52815e679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:57.065051 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0288b-c7d2-4e59-b768-60e52815e679 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:57.094692 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1310/2620] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:39:56 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:39:57.095831 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8579d-f5fd-4798-8730-fc7bf38e3b27 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:57.110862 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8579d-f5fd-4798-8730-fc7bf38e3b27 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:57.126703 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b30b7-03d7-4ba0-af14-e2f1aa70d0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:57.127376 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b30b7-03d7-4ba0-af14-e2f1aa70d0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:57.127656 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b30b7-03d7-4ba0-af14-e2f1aa70d0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:57.127925 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b30b7-03d7-4ba0-af14-e2f1aa70d0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:57.128656 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b30b7-03d7-4ba0-af14-e2f1aa70d0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:57.130272 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b30b7-03d7-4ba0-af14-e2f1aa70d0e1 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:57.145093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1311/2621] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:39:57.149009 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0288b-c7d2-4e59-b768-60e52815e679 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:57.169355 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0288b-c7d2-4e59-b768-60e52815e679 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:57.174397 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660d389-bc07-415c-8a01-5d2310a9a971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:57.175189 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660d389-bc07-415c-8a01-5d2310a9a971 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:57.175573 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660d389-bc07-415c-8a01-5d2310a9a971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:57.175946 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660d389-bc07-415c-8a01-5d2310a9a971 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:57.177058 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660d389-bc07-415c-8a01-5d2310a9a971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:57.178923 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660d389-bc07-415c-8a01-5d2310a9a971 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:57.194442 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1311/2622] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:39:57.198511 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b30b7-03d7-4ba0-af14-e2f1aa70d0e1 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:57.217231 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b30b7-03d7-4ba0-af14-e2f1aa70d0e1 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:57.222589 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697a633-c74c-48c1-b62f-33e270eb1d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:57.223489 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697a633-c74c-48c1-b62f-33e270eb1d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:57.223764 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697a633-c74c-48c1-b62f-33e270eb1d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:57.224032 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697a633-c74c-48c1-b62f-33e270eb1d32 admin admin] PATH_INFO: `/v3/projects/63b18edee5ef4c758aaba4ec112871b8/users/b6877817a96b458893829d3ecf048357/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:57.239895 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697a633-c74c-48c1-b62f-33e270eb1d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b18edee5ef4c758aaba4ec112871b8, user_id=b6877817a96b458893829d3ecf048357, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:57.242711 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7697a633-c74c-48c1-b62f-33e270eb1d32 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:57.261653 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1312/2623] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:39:57 2022] PUT /identity/v3/projects/63b18edee5ef4c758aaba4ec112871b8/users/b6877817a96b458893829d3ecf048357/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:39:57.272380 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9af97-90de-4b37-862d-f8e554d3f0ca None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:57.272914 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9af97-90de-4b37-862d-f8e554d3f0ca None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:57.273015 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9af97-90de-4b37-862d-f8e554d3f0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:57.305820 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-caf9af97-90de-4b37-862d-f8e554d3f0ca None None] MFA Rules not processed for user `b6877817a96b458893829d3ecf048357`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:39:57.307067 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-caf9af97-90de-4b37-862d-f8e554d3f0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:57.375247 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1312/2624] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:39:57 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:39:57.379953 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697a633-c74c-48c1-b62f-33e270eb1d32 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:57.443244 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7697a633-c74c-48c1-b62f-33e270eb1d32 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:57.447978 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f4a2b-7c65-4a83-8921-c1e919a42a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:57.448628 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f4a2b-7c65-4a83-8921-c1e919a42a2b admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:57.448903 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f4a2b-7c65-4a83-8921-c1e919a42a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:57.449170 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f4a2b-7c65-4a83-8921-c1e919a42a2b admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:57.449876 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f4a2b-7c65-4a83-8921-c1e919a42a2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:57.451819 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f4a2b-7c65-4a83-8921-c1e919a42a2b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:57.483884 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1313/2625] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:39:57 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:39:57.484382 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9af97-90de-4b37-862d-f8e554d3f0ca None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:57.495493 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9af97-90de-4b37-862d-f8e554d3f0ca None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:57.560088 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1005a-ae6a-4e9c-835e-e96f6d2e54f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:57.560786 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1005a-ae6a-4e9c-835e-e96f6d2e54f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:57.561067 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1005a-ae6a-4e9c-835e-e96f6d2e54f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:57.561383 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1005a-ae6a-4e9c-835e-e96f6d2e54f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:57.562091 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1005a-ae6a-4e9c-835e-e96f6d2e54f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:57.564102 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1005a-ae6a-4e9c-835e-e96f6d2e54f7 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:57.585315 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1313/2626] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:39:57 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:39:57.589159 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f4a2b-7c65-4a83-8921-c1e919a42a2b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:57.600671 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f4a2b-7c65-4a83-8921-c1e919a42a2b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:57.606273 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc12ad1-c686-4241-aa41-df54e219132e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:57.607056 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc12ad1-c686-4241-aa41-df54e219132e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:57.607401 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc12ad1-c686-4241-aa41-df54e219132e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:57.607743 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc12ad1-c686-4241-aa41-df54e219132e admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:57.608583 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc12ad1-c686-4241-aa41-df54e219132e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:57.610265 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc12ad1-c686-4241-aa41-df54e219132e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:57.622070 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1314/2627] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:39:57.626168 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1005a-ae6a-4e9c-835e-e96f6d2e54f7 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:57.636404 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1005a-ae6a-4e9c-835e-e96f6d2e54f7 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:57.641868 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46636389-9638-4915-a906-9fbe3d53b998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:57.642976 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46636389-9638-4915-a906-9fbe3d53b998 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:57.643259 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46636389-9638-4915-a906-9fbe3d53b998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:57.643525 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46636389-9638-4915-a906-9fbe3d53b998 admin admin] PATH_INFO: `/v3/projects/5105c732b5ed48c3a5dae09f5335f241/users/90a06f56c2f44f059919e19edaf846af/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:57.659046 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46636389-9638-4915-a906-9fbe3d53b998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5105c732b5ed48c3a5dae09f5335f241, user_id=90a06f56c2f44f059919e19edaf846af, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:57.661773 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46636389-9638-4915-a906-9fbe3d53b998 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:57.677526 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1314/2628] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:39:57 2022] PUT /identity/v3/projects/5105c732b5ed48c3a5dae09f5335f241/users/90a06f56c2f44f059919e19edaf846af/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:39:57.681528 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc12ad1-c686-4241-aa41-df54e219132e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:57.692512 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc12ad1-c686-4241-aa41-df54e219132e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:57.766233 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4687e6f-8115-47c2-af67-60f7e5a6525b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:57.766892 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4687e6f-8115-47c2-af67-60f7e5a6525b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:57.767168 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4687e6f-8115-47c2-af67-60f7e5a6525b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:57.767436 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4687e6f-8115-47c2-af67-60f7e5a6525b admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:57.768155 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4687e6f-8115-47c2-af67-60f7e5a6525b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:57.769778 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4687e6f-8115-47c2-af67-60f7e5a6525b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:57.781248 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1315/2629] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:39:57.785613 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46636389-9638-4915-a906-9fbe3d53b998 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:57.795931 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46636389-9638-4915-a906-9fbe3d53b998 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:57.800445 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d3282-f396-47b4-8259-b445075dd6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:57.801323 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d3282-f396-47b4-8259-b445075dd6e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:57.801603 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d3282-f396-47b4-8259-b445075dd6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:57.801868 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d3282-f396-47b4-8259-b445075dd6e9 admin admin] PATH_INFO: `/v3/projects/5105c732b5ed48c3a5dae09f5335f241/users/90a06f56c2f44f059919e19edaf846af/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:57.803801 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d3282-f396-47b4-8259-b445075dd6e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5105c732b5ed48c3a5dae09f5335f241, user_id=90a06f56c2f44f059919e19edaf846af, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:57.806476 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d3282-f396-47b4-8259-b445075dd6e9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:57.817911 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1315/2630] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:39:57 2022] PUT /identity/v3/projects/5105c732b5ed48c3a5dae09f5335f241/users/90a06f56c2f44f059919e19edaf846af/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:39:57.829914 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d74631-9c75-4db0-b0a3-6240222168c9 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:57.830195 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d74631-9c75-4db0-b0a3-6240222168c9 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:57.830608 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d74631-9c75-4db0-b0a3-6240222168c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:57.863087 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-51d74631-9c75-4db0-b0a3-6240222168c9 None None] MFA Rules not processed for user `90a06f56c2f44f059919e19edaf846af`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:39:57.864397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-51d74631-9c75-4db0-b0a3-6240222168c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:57.945517 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1316/2631] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:39:57 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:39:57.955785 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d3282-f396-47b4-8259-b445075dd6e9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:57.957954 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-b78d3282-f396-47b4-8259-b445075dd6e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:58.018662 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d3282-f396-47b4-8259-b445075dd6e9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:58.022264 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf97c6-d1b3-455e-8760-5a67ecda1e97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:58.022891 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf97c6-d1b3-455e-8760-5a67ecda1e97 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:58.023167 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf97c6-d1b3-455e-8760-5a67ecda1e97 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:58.023435 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf97c6-d1b3-455e-8760-5a67ecda1e97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:58.033290 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf97c6-d1b3-455e-8760-5a67ecda1e97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:58.034680 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf97c6-d1b3-455e-8760-5a67ecda1e97 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:58.044567 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1316/2632] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:39:57 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:39:59.448466 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d74631-9c75-4db0-b0a3-6240222168c9 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:59.507714 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d74631-9c75-4db0-b0a3-6240222168c9 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:59.512174 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb536660-e426-4166-8308-b6d5b0fb5788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:59.513660 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb536660-e426-4166-8308-b6d5b0fb5788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:59.513938 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb536660-e426-4166-8308-b6d5b0fb5788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:59.514210 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb536660-e426-4166-8308-b6d5b0fb5788 admin admin] PATH_INFO: `/v3/users/b6877817a96b458893829d3ecf048357` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:59.515389 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb536660-e426-4166-8308-b6d5b0fb5788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6877817a96b458893829d3ecf048357)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:59.517332 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb536660-e426-4166-8308-b6d5b0fb5788 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:59.563033 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-eb536660-e426-4166-8308-b6d5b0fb5788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6877817a96b458893829d3ecf048357'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:59.569862 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-eb536660-e426-4166-8308-b6d5b0fb5788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6877817a96b458893829d3ecf048357'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:59.581504 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-eb536660-e426-4166-8308-b6d5b0fb5788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6877817a96b458893829d3ecf048357'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:59.582226 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-eb536660-e426-4166-8308-b6d5b0fb5788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6877817a96b458893829d3ecf048357'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:59.582827 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-eb536660-e426-4166-8308-b6d5b0fb5788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6877817a96b458893829d3ecf048357'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:39:59.594801 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1317/2633] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:39:59 2022] DELETE /identity/v3/users/b6877817a96b458893829d3ecf048357 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:39:59.599469 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ea396-1509-4a2e-8a0d-6259c0a0bbca None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:59.600005 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ea396-1509-4a2e-8a0d-6259c0a0bbca None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:59.600112 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ea396-1509-4a2e-8a0d-6259c0a0bbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:59.617789 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c52ea396-1509-4a2e-8a0d-6259c0a0bbca None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:39:59.619006 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c52ea396-1509-4a2e-8a0d-6259c0a0bbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:59.677252 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1317/2634] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:39:59.688230 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb536660-e426-4166-8308-b6d5b0fb5788 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:39:59.689690 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-eb536660-e426-4166-8308-b6d5b0fb5788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:39:59.750580 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb536660-e426-4166-8308-b6d5b0fb5788 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:39:59.754220 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da18de-f528-48fb-b68c-4fc3626ebd95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:39:59.754851 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da18de-f528-48fb-b68c-4fc3626ebd95 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:39:59.755185 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da18de-f528-48fb-b68c-4fc3626ebd95 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:39:59.755461 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da18de-f528-48fb-b68c-4fc3626ebd95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:39:59.764433 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da18de-f528-48fb-b68c-4fc3626ebd95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:39:59.765820 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da18de-f528-48fb-b68c-4fc3626ebd95 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:39:59.774987 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1318/2635] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:40:00.029677 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ea396-1509-4a2e-8a0d-6259c0a0bbca None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:00.031087 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c52ea396-1509-4a2e-8a0d-6259c0a0bbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:00.045242 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ea396-1509-4a2e-8a0d-6259c0a0bbca None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:00.050380 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e65db-baf9-425f-a4fc-48054dd0a8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:00.051406 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e65db-baf9-425f-a4fc-48054dd0a8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:00.051692 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e65db-baf9-425f-a4fc-48054dd0a8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:00.051968 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e65db-baf9-425f-a4fc-48054dd0a8c3 admin admin] PATH_INFO: `/v3/projects/63b18edee5ef4c758aaba4ec112871b8` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:00.053276 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e65db-baf9-425f-a4fc-48054dd0a8c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63b18edee5ef4c758aaba4ec112871b8)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:00.055134 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e65db-baf9-425f-a4fc-48054dd0a8c3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:00.098558 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0a7e65db-baf9-425f-a4fc-48054dd0a8c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63b18edee5ef4c758aaba4ec112871b8', 'request_id': 'req-0a7e65db-baf9-425f-a4fc-48054dd0a8c3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:00.105431 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0a7e65db-baf9-425f-a4fc-48054dd0a8c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63b18edee5ef4c758aaba4ec112871b8', 'request_id': 'req-0a7e65db-baf9-425f-a4fc-48054dd0a8c3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:00.111607 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0a7e65db-baf9-425f-a4fc-48054dd0a8c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63b18edee5ef4c758aaba4ec112871b8', 'request_id': 'req-0a7e65db-baf9-425f-a4fc-48054dd0a8c3'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:00.121954 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0a7e65db-baf9-425f-a4fc-48054dd0a8c3 admin admin] The token cache is being invalidate because project 63b18edee5ef4c758aaba4ec112871b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:40:00.122235 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0a7e65db-baf9-425f-a4fc-48054dd0a8c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:00.122871 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-0a7e65db-baf9-425f-a4fc-48054dd0a8c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:00.124358 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1318/2636] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:40:00 2022] DELETE /identity/v3/projects/63b18edee5ef4c758aaba4ec112871b8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:00.128446 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da18de-f528-48fb-b68c-4fc3626ebd95 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:00.137867 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da18de-f528-48fb-b68c-4fc3626ebd95 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:00.190817 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe68ae6-4277-4f48-a595-5af1414d83ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:00.191663 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68ae6-4277-4f48-a595-5af1414d83ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:00.191941 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68ae6-4277-4f48-a595-5af1414d83ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:00.192212 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe68ae6-4277-4f48-a595-5af1414d83ca admin admin] PATH_INFO: `/v3/users/90a06f56c2f44f059919e19edaf846af` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:00.193416 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe68ae6-4277-4f48-a595-5af1414d83ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a06f56c2f44f059919e19edaf846af)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:00.195311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe68ae6-4277-4f48-a595-5af1414d83ca admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:00.236985 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-cfe68ae6-4277-4f48-a595-5af1414d83ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a06f56c2f44f059919e19edaf846af'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:00.243456 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-cfe68ae6-4277-4f48-a595-5af1414d83ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a06f56c2f44f059919e19edaf846af'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:00.254460 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-cfe68ae6-4277-4f48-a595-5af1414d83ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a06f56c2f44f059919e19edaf846af'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:00.255097 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-cfe68ae6-4277-4f48-a595-5af1414d83ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a06f56c2f44f059919e19edaf846af'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:00.255690 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-cfe68ae6-4277-4f48-a595-5af1414d83ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a06f56c2f44f059919e19edaf846af'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:00.268145 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1319/2637] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:40:00 2022] DELETE /identity/v3/users/90a06f56c2f44f059919e19edaf846af => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:00.522818 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e65db-baf9-425f-a4fc-48054dd0a8c3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:00.524351 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-0a7e65db-baf9-425f-a4fc-48054dd0a8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:00.538702 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e65db-baf9-425f-a4fc-48054dd0a8c3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:00.594784 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccaf2b1-c66a-415f-b71f-c94dc0a480bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:00.595789 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaf2b1-c66a-415f-b71f-c94dc0a480bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:00.596095 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaf2b1-c66a-415f-b71f-c94dc0a480bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:00.596365 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccaf2b1-c66a-415f-b71f-c94dc0a480bd admin admin] PATH_INFO: `/v3/projects/5105c732b5ed48c3a5dae09f5335f241` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:00.597568 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccaf2b1-c66a-415f-b71f-c94dc0a480bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5105c732b5ed48c3a5dae09f5335f241)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:00.599492 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccaf2b1-c66a-415f-b71f-c94dc0a480bd admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:00.642947 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7ccaf2b1-c66a-415f-b71f-c94dc0a480bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5105c732b5ed48c3a5dae09f5335f241', 'request_id': 'req-7ccaf2b1-c66a-415f-b71f-c94dc0a480bd'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:00.649881 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7ccaf2b1-c66a-415f-b71f-c94dc0a480bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5105c732b5ed48c3a5dae09f5335f241', 'request_id': 'req-7ccaf2b1-c66a-415f-b71f-c94dc0a480bd'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:00.655892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7ccaf2b1-c66a-415f-b71f-c94dc0a480bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5105c732b5ed48c3a5dae09f5335f241', 'request_id': 'req-7ccaf2b1-c66a-415f-b71f-c94dc0a480bd'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:00.666815 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7ccaf2b1-c66a-415f-b71f-c94dc0a480bd admin admin] The token cache is being invalidate because project 5105c732b5ed48c3a5dae09f5335f241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:40:00.667095 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7ccaf2b1-c66a-415f-b71f-c94dc0a480bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:00.667742 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-7ccaf2b1-c66a-415f-b71f-c94dc0a480bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:00.669653 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1319/2638] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:40:00 2022] DELETE /identity/v3/projects/5105c732b5ed48c3a5dae09f5335f241 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:00.674584 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac150f-23ae-4966-9d5b-446ea1cca386 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:00.675007 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac150f-23ae-4966-9d5b-446ea1cca386 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:00.675134 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac150f-23ae-4966-9d5b-446ea1cca386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:00.695372 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-9cac150f-23ae-4966-9d5b-446ea1cca386 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:00.697117 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9cac150f-23ae-4966-9d5b-446ea1cca386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:00.768642 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1320/2639] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:00.776719 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fd5a8-4b68-4c11-bc40-30c7cb69dc17 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:00.777008 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fd5a8-4b68-4c11-bc40-30c7cb69dc17 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:00.777374 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fd5a8-4b68-4c11-bc40-30c7cb69dc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:00.795560 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-985fd5a8-4b68-4c11-bc40-30c7cb69dc17 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:00.797084 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-985fd5a8-4b68-4c11-bc40-30c7cb69dc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:00.804717 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1320/2640] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:00.808871 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac150f-23ae-4966-9d5b-446ea1cca386 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:00.818991 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac150f-23ae-4966-9d5b-446ea1cca386 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:00.823582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59558492-3282-458d-8857-ffb9e8bb9e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:00.824256 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59558492-3282-458d-8857-ffb9e8bb9e20 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:00.824533 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59558492-3282-458d-8857-ffb9e8bb9e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:00.824806 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59558492-3282-458d-8857-ffb9e8bb9e20 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:00.826201 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59558492-3282-458d-8857-ffb9e8bb9e20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:40:00.826504 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59558492-3282-458d-8857-ffb9e8bb9e20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:00.828090 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59558492-3282-458d-8857-ffb9e8bb9e20 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:00.839404 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1321/2641] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:40:00.843658 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fd5a8-4b68-4c11-bc40-30c7cb69dc17 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:00.852781 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fd5a8-4b68-4c11-bc40-30c7cb69dc17 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:00.857713 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db16b5-e160-4280-81c1-580876b9ac9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:00.858367 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db16b5-e160-4280-81c1-580876b9ac9b admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:00.858653 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db16b5-e160-4280-81c1-580876b9ac9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:00.858925 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db16b5-e160-4280-81c1-580876b9ac9b admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:00.859624 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db16b5-e160-4280-81c1-580876b9ac9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:00.861595 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db16b5-e160-4280-81c1-580876b9ac9b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:00.887143 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1321/2642] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:40:00 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:40:00.891973 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59558492-3282-458d-8857-ffb9e8bb9e20 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:00.901801 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59558492-3282-458d-8857-ffb9e8bb9e20 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:00.956770 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39521779-b188-4149-ace0-7e669f7bf1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:00.957435 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39521779-b188-4149-ace0-7e669f7bf1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:00.957723 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39521779-b188-4149-ace0-7e669f7bf1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:00.957994 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39521779-b188-4149-ace0-7e669f7bf1f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:00.958679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39521779-b188-4149-ace0-7e669f7bf1f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:00.960654 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39521779-b188-4149-ace0-7e669f7bf1f6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:00.979170 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1322/2643] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:40:00 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:40:00.983491 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db16b5-e160-4280-81c1-580876b9ac9b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:00.993371 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db16b5-e160-4280-81c1-580876b9ac9b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:00.998627 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056c457-e41e-4ab6-866b-ec450b14cbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:00.999274 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056c457-e41e-4ab6-866b-ec450b14cbed admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:00.999553 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056c457-e41e-4ab6-866b-ec450b14cbed admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:00.999830 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056c457-e41e-4ab6-866b-ec450b14cbed admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:01.000574 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056c457-e41e-4ab6-866b-ec450b14cbed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:01.002200 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4056c457-e41e-4ab6-866b-ec450b14cbed admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:01.013122 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1322/2644] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:40:01.016962 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39521779-b188-4149-ace0-7e669f7bf1f6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:01.026937 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39521779-b188-4149-ace0-7e669f7bf1f6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:01.031579 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049a929-0595-4e58-b7cc-916d9c52766e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:01.032225 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049a929-0595-4e58-b7cc-916d9c52766e admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:01.032509 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049a929-0595-4e58-b7cc-916d9c52766e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:01.032778 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049a929-0595-4e58-b7cc-916d9c52766e admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:01.033572 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049a929-0595-4e58-b7cc-916d9c52766e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:01.035175 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049a929-0595-4e58-b7cc-916d9c52766e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:01.045669 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1323/2645] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:40:01.053628 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056c457-e41e-4ab6-866b-ec450b14cbed admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:01.064618 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056c457-e41e-4ab6-866b-ec450b14cbed admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:01.069128 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278be3a8-89dc-4b9d-a46a-ebf06a6573d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:01.070015 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278be3a8-89dc-4b9d-a46a-ebf06a6573d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:01.070293 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278be3a8-89dc-4b9d-a46a-ebf06a6573d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:01.070561 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278be3a8-89dc-4b9d-a46a-ebf06a6573d5 admin admin] PATH_INFO: `/v3/projects/07d289a08b494f508ff271c08d80fb71/users/3cecba379b4b45c288e6edce60f99d8f/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:01.084902 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278be3a8-89dc-4b9d-a46a-ebf06a6573d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d289a08b494f508ff271c08d80fb71, user_id=3cecba379b4b45c288e6edce60f99d8f, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:01.087563 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278be3a8-89dc-4b9d-a46a-ebf06a6573d5 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:01.100010 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1323/2646] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:40:01 2022] PUT /identity/v3/projects/07d289a08b494f508ff271c08d80fb71/users/3cecba379b4b45c288e6edce60f99d8f/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:01.110679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e896dd-6afe-4e64-a8a5-1463340023de None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:01.111090 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e896dd-6afe-4e64-a8a5-1463340023de None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:01.111365 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e896dd-6afe-4e64-a8a5-1463340023de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:01.137194 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-f9e896dd-6afe-4e64-a8a5-1463340023de None None] MFA Rules not processed for user `3cecba379b4b45c288e6edce60f99d8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:01.138466 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-f9e896dd-6afe-4e64-a8a5-1463340023de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:01.198865 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1324/2647] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:40:01.203239 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278be3a8-89dc-4b9d-a46a-ebf06a6573d5 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:01.261855 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278be3a8-89dc-4b9d-a46a-ebf06a6573d5 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:01.266492 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f249b-f42e-44b3-b089-61a72998fc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:01.267131 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f249b-f42e-44b3-b089-61a72998fc73 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:01.267412 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f249b-f42e-44b3-b089-61a72998fc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:01.267689 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f249b-f42e-44b3-b089-61a72998fc73 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:01.268374 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f249b-f42e-44b3-b089-61a72998fc73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:01.270355 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f249b-f42e-44b3-b089-61a72998fc73 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:01.294539 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1324/2648] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:40:01 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:40:01.298627 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e896dd-6afe-4e64-a8a5-1463340023de None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:01.310277 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e896dd-6afe-4e64-a8a5-1463340023de None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:01.363712 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc128ca5-a5e4-4777-b14f-88f031a6a08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:01.364369 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc128ca5-a5e4-4777-b14f-88f031a6a08c admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:01.364650 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc128ca5-a5e4-4777-b14f-88f031a6a08c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:01.364920 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc128ca5-a5e4-4777-b14f-88f031a6a08c admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:01.365645 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc128ca5-a5e4-4777-b14f-88f031a6a08c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:01.367558 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc128ca5-a5e4-4777-b14f-88f031a6a08c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:01.386755 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1325/2649] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:40:01 2022] POST /identity/v3/users => generated 299 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:40:01.391416 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f249b-f42e-44b3-b089-61a72998fc73 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:01.401411 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f249b-f42e-44b3-b089-61a72998fc73 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:01.406547 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2c6e3-680a-4906-80e1-f5850c4d6ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:01.407185 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2c6e3-680a-4906-80e1-f5850c4d6ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:01.407536 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2c6e3-680a-4906-80e1-f5850c4d6ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:01.407808 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2c6e3-680a-4906-80e1-f5850c4d6ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:01.408528 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2c6e3-680a-4906-80e1-f5850c4d6ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:01.410357 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2c6e3-680a-4906-80e1-f5850c4d6ce9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:01.420553 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1325/2650] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:40:01.424662 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc128ca5-a5e4-4777-b14f-88f031a6a08c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:01.434138 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc128ca5-a5e4-4777-b14f-88f031a6a08c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:01.438671 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b754fb-fb41-4bac-ae8c-d0f8059591be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:01.439533 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b754fb-fb41-4bac-ae8c-d0f8059591be admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:01.439803 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b754fb-fb41-4bac-ae8c-d0f8059591be admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:01.440069 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b754fb-fb41-4bac-ae8c-d0f8059591be admin admin] PATH_INFO: `/v3/projects/a802c0f6288e4161ab1e38bc2b230d45/users/bb7fd11b77b748dc94aff30bc1ce82cc/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:01.454846 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b754fb-fb41-4bac-ae8c-d0f8059591be admin admin] RBAC: Authorizing `identity:create_grant(project_id=a802c0f6288e4161ab1e38bc2b230d45, user_id=bb7fd11b77b748dc94aff30bc1ce82cc, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:01.457527 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b754fb-fb41-4bac-ae8c-d0f8059591be admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:01.470203 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1326/2651] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:40:01 2022] PUT /identity/v3/projects/a802c0f6288e4161ab1e38bc2b230d45/users/bb7fd11b77b748dc94aff30bc1ce82cc/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:01.474219 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2c6e3-680a-4906-80e1-f5850c4d6ce9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:01.484082 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2c6e3-680a-4906-80e1-f5850c4d6ce9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:01.537370 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d79636-d240-469a-a9cc-cb6a53a4c1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:01.538050 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d79636-d240-469a-a9cc-cb6a53a4c1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:01.538329 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d79636-d240-469a-a9cc-cb6a53a4c1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:01.538602 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d79636-d240-469a-a9cc-cb6a53a4c1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:01.539317 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d79636-d240-469a-a9cc-cb6a53a4c1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:01.541243 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d79636-d240-469a-a9cc-cb6a53a4c1f6 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:01.550655 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1326/2652] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:40:01.554699 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b754fb-fb41-4bac-ae8c-d0f8059591be admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:01.565074 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b754fb-fb41-4bac-ae8c-d0f8059591be admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:01.569695 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ce226-2cb0-422e-8a50-96f4d7e4f4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:01.570559 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ce226-2cb0-422e-8a50-96f4d7e4f4a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:01.570838 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ce226-2cb0-422e-8a50-96f4d7e4f4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:01.571115 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ce226-2cb0-422e-8a50-96f4d7e4f4a4 admin admin] PATH_INFO: `/v3/projects/a802c0f6288e4161ab1e38bc2b230d45/users/bb7fd11b77b748dc94aff30bc1ce82cc/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:01.573070 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ce226-2cb0-422e-8a50-96f4d7e4f4a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a802c0f6288e4161ab1e38bc2b230d45, user_id=bb7fd11b77b748dc94aff30bc1ce82cc, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:01.576388 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ce226-2cb0-422e-8a50-96f4d7e4f4a4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:01.586379 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1327/2653] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:40:01 2022] PUT /identity/v3/projects/a802c0f6288e4161ab1e38bc2b230d45/users/bb7fd11b77b748dc94aff30bc1ce82cc/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:01.597314 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860cc3f-39de-4a01-bbde-5979c9814ed9 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:01.597605 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860cc3f-39de-4a01-bbde-5979c9814ed9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:01.597906 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860cc3f-39de-4a01-bbde-5979c9814ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:01.623546 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-a860cc3f-39de-4a01-bbde-5979c9814ed9 None None] MFA Rules not processed for user `bb7fd11b77b748dc94aff30bc1ce82cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:01.624736 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a860cc3f-39de-4a01-bbde-5979c9814ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:01.690381 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1327/2654] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:01.701046 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ce226-2cb0-422e-8a50-96f4d7e4f4a4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:01.702865 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a97ce226-2cb0-422e-8a50-96f4d7e4f4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:01.758122 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ce226-2cb0-422e-8a50-96f4d7e4f4a4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:01.761705 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e11d88a-f857-4544-ac70-093a2fcc7ee3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:01.762329 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11d88a-f857-4544-ac70-093a2fcc7ee3 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:01.763234 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11d88a-f857-4544-ac70-093a2fcc7ee3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:01.763505 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e11d88a-f857-4544-ac70-093a2fcc7ee3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:01.772021 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11d88a-f857-4544-ac70-093a2fcc7ee3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:01.773467 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e11d88a-f857-4544-ac70-093a2fcc7ee3 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:01.782462 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1328/2655] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:40:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:40:01.810080 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860cc3f-39de-4a01-bbde-5979c9814ed9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:01.868601 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860cc3f-39de-4a01-bbde-5979c9814ed9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:01.873793 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d8f3a-ff65-44b5-9980-014cb33dff49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:01.874639 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d8f3a-ff65-44b5-9980-014cb33dff49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:01.874917 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d8f3a-ff65-44b5-9980-014cb33dff49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:01.875299 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d8f3a-ff65-44b5-9980-014cb33dff49 admin admin] PATH_INFO: `/v3/users/3cecba379b4b45c288e6edce60f99d8f` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:01.876499 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d8f3a-ff65-44b5-9980-014cb33dff49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cecba379b4b45c288e6edce60f99d8f)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:01.878455 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d8f3a-ff65-44b5-9980-014cb33dff49 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:01.929274 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ab5d8f3a-ff65-44b5-9980-014cb33dff49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cecba379b4b45c288e6edce60f99d8f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:01.942235 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ab5d8f3a-ff65-44b5-9980-014cb33dff49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cecba379b4b45c288e6edce60f99d8f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:01.942978 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ab5d8f3a-ff65-44b5-9980-014cb33dff49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cecba379b4b45c288e6edce60f99d8f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:01.943597 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ab5d8f3a-ff65-44b5-9980-014cb33dff49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cecba379b4b45c288e6edce60f99d8f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:01.950801 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-ab5d8f3a-ff65-44b5-9980-014cb33dff49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cecba379b4b45c288e6edce60f99d8f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:01.962956 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1328/2656] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:40:01 2022] DELETE /identity/v3/users/3cecba379b4b45c288e6edce60f99d8f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:01.967399 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf91c2-ed11-4501-af04-016aa5dd9709 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:01.967680 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf91c2-ed11-4501-af04-016aa5dd9709 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:01.967949 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf91c2-ed11-4501-af04-016aa5dd9709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:01.987010 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-cdcf91c2-ed11-4501-af04-016aa5dd9709 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:01.988275 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cdcf91c2-ed11-4501-af04-016aa5dd9709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:02.046870 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1329/2657] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:02.055983 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d8f3a-ff65-44b5-9980-014cb33dff49 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:02.057371 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-ab5d8f3a-ff65-44b5-9980-014cb33dff49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:02.111428 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d8f3a-ff65-44b5-9980-014cb33dff49 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:02.115075 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a7df4-2a91-4b25-b55b-341d1b6e93b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:02.115698 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a7df4-2a91-4b25-b55b-341d1b6e93b5 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:02.115974 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a7df4-2a91-4b25-b55b-341d1b6e93b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:02.116247 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a7df4-2a91-4b25-b55b-341d1b6e93b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:02.126249 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a7df4-2a91-4b25-b55b-341d1b6e93b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:02.127680 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a7df4-2a91-4b25-b55b-341d1b6e93b5 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:02.136820 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1329/2658] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:40:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:40:02.601884 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf91c2-ed11-4501-af04-016aa5dd9709 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:02.603293 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cdcf91c2-ed11-4501-af04-016aa5dd9709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:02.616401 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf91c2-ed11-4501-af04-016aa5dd9709 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:02.621013 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0b4a5-736a-4fc9-bfea-9f7b53df0579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:02.622468 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0b4a5-736a-4fc9-bfea-9f7b53df0579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:02.622746 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0b4a5-736a-4fc9-bfea-9f7b53df0579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:02.623013 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0b4a5-736a-4fc9-bfea-9f7b53df0579 admin admin] PATH_INFO: `/v3/projects/07d289a08b494f508ff271c08d80fb71` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:02.624204 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0b4a5-736a-4fc9-bfea-9f7b53df0579 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d289a08b494f508ff271c08d80fb71)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:02.626124 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0b4a5-736a-4fc9-bfea-9f7b53df0579 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:02.669860 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ded0b4a5-736a-4fc9-bfea-9f7b53df0579 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d289a08b494f508ff271c08d80fb71', 'request_id': 'req-ded0b4a5-736a-4fc9-bfea-9f7b53df0579'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:02.676939 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ded0b4a5-736a-4fc9-bfea-9f7b53df0579 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d289a08b494f508ff271c08d80fb71', 'request_id': 'req-ded0b4a5-736a-4fc9-bfea-9f7b53df0579'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:02.682280 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ded0b4a5-736a-4fc9-bfea-9f7b53df0579 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d289a08b494f508ff271c08d80fb71', 'request_id': 'req-ded0b4a5-736a-4fc9-bfea-9f7b53df0579'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:02.693386 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ded0b4a5-736a-4fc9-bfea-9f7b53df0579 admin admin] The token cache is being invalidate because project 07d289a08b494f508ff271c08d80fb71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:40:02.693604 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ded0b4a5-736a-4fc9-bfea-9f7b53df0579 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:02.694201 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-ded0b4a5-736a-4fc9-bfea-9f7b53df0579 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:02.695716 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1330/2659] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:40:02 2022] DELETE /identity/v3/projects/07d289a08b494f508ff271c08d80fb71 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:02.699565 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a7df4-2a91-4b25-b55b-341d1b6e93b5 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:02.709363 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a7df4-2a91-4b25-b55b-341d1b6e93b5 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:02.763321 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770fc02a-464c-4e47-8888-b6094845b218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:02.764161 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fc02a-464c-4e47-8888-b6094845b218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:02.764436 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fc02a-464c-4e47-8888-b6094845b218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:02.764706 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770fc02a-464c-4e47-8888-b6094845b218 admin admin] PATH_INFO: `/v3/users/bb7fd11b77b748dc94aff30bc1ce82cc` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:02.765888 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fc02a-464c-4e47-8888-b6094845b218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb7fd11b77b748dc94aff30bc1ce82cc)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:02.767804 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770fc02a-464c-4e47-8888-b6094845b218 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:02.810793 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-770fc02a-464c-4e47-8888-b6094845b218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb7fd11b77b748dc94aff30bc1ce82cc'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:02.823494 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-770fc02a-464c-4e47-8888-b6094845b218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb7fd11b77b748dc94aff30bc1ce82cc'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:02.824268 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-770fc02a-464c-4e47-8888-b6094845b218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb7fd11b77b748dc94aff30bc1ce82cc'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:02.825468 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-770fc02a-464c-4e47-8888-b6094845b218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb7fd11b77b748dc94aff30bc1ce82cc'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:02.832247 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-770fc02a-464c-4e47-8888-b6094845b218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb7fd11b77b748dc94aff30bc1ce82cc'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:02.844693 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1330/2660] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:40:02 2022] DELETE /identity/v3/users/bb7fd11b77b748dc94aff30bc1ce82cc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:03.098562 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0b4a5-736a-4fc9-bfea-9f7b53df0579 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:03.099960 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ded0b4a5-736a-4fc9-bfea-9f7b53df0579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:03.113067 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0b4a5-736a-4fc9-bfea-9f7b53df0579 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:03.172836 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d41e6e-0f1e-4284-857b-51cae8d6c9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:03.173712 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d41e6e-0f1e-4284-857b-51cae8d6c9a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:03.173988 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d41e6e-0f1e-4284-857b-51cae8d6c9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:03.174255 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d41e6e-0f1e-4284-857b-51cae8d6c9a0 admin admin] PATH_INFO: `/v3/projects/a802c0f6288e4161ab1e38bc2b230d45` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:03.175419 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d41e6e-0f1e-4284-857b-51cae8d6c9a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a802c0f6288e4161ab1e38bc2b230d45)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:03.177330 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d41e6e-0f1e-4284-857b-51cae8d6c9a0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:03.223959 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-75d41e6e-0f1e-4284-857b-51cae8d6c9a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a802c0f6288e4161ab1e38bc2b230d45', 'request_id': 'req-75d41e6e-0f1e-4284-857b-51cae8d6c9a0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:03.233114 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-75d41e6e-0f1e-4284-857b-51cae8d6c9a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a802c0f6288e4161ab1e38bc2b230d45', 'request_id': 'req-75d41e6e-0f1e-4284-857b-51cae8d6c9a0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:03.238949 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-75d41e6e-0f1e-4284-857b-51cae8d6c9a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a802c0f6288e4161ab1e38bc2b230d45', 'request_id': 'req-75d41e6e-0f1e-4284-857b-51cae8d6c9a0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:03.250047 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-75d41e6e-0f1e-4284-857b-51cae8d6c9a0 admin admin] The token cache is being invalidate because project a802c0f6288e4161ab1e38bc2b230d45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:40:03.250333 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-75d41e6e-0f1e-4284-857b-51cae8d6c9a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:03.250956 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-75d41e6e-0f1e-4284-857b-51cae8d6c9a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:03.252483 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1331/2661] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:40:03 2022] DELETE /identity/v3/projects/a802c0f6288e4161ab1e38bc2b230d45 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:03.257448 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb2974-3cd9-4535-813e-beeb34bdb3cf None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:03.257763 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb2974-3cd9-4535-813e-beeb34bdb3cf None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:03.258038 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb2974-3cd9-4535-813e-beeb34bdb3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:03.275504 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-5bdb2974-3cd9-4535-813e-beeb34bdb3cf None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:03.276697 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5bdb2974-3cd9-4535-813e-beeb34bdb3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:03.332914 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1331/2662] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:03.340866 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184a2d0-2c2e-4049-a42a-682ed67f246a None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:03.341147 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184a2d0-2c2e-4049-a42a-682ed67f246a None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:03.341452 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184a2d0-2c2e-4049-a42a-682ed67f246a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:03.359846 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-7184a2d0-2c2e-4049-a42a-682ed67f246a None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:03.361058 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7184a2d0-2c2e-4049-a42a-682ed67f246a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:03.369116 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1332/2663] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:03.373975 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb2974-3cd9-4535-813e-beeb34bdb3cf None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:03.383278 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb2974-3cd9-4535-813e-beeb34bdb3cf None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:03.387910 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7255fd-0d29-467a-b525-3d1ae3585182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:03.388563 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7255fd-0d29-467a-b525-3d1ae3585182 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:03.388845 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7255fd-0d29-467a-b525-3d1ae3585182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:03.389118 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7255fd-0d29-467a-b525-3d1ae3585182 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:03.389879 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7255fd-0d29-467a-b525-3d1ae3585182 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:40:03.390184 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7255fd-0d29-467a-b525-3d1ae3585182 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:03.391796 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7255fd-0d29-467a-b525-3d1ae3585182 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:03.402904 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1332/2664] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:40:03.407407 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184a2d0-2c2e-4049-a42a-682ed67f246a None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:03.416525 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184a2d0-2c2e-4049-a42a-682ed67f246a None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:03.421761 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a23eb-931a-4ac9-be61-ee0f451445e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:03.422389 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a23eb-931a-4ac9-be61-ee0f451445e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:03.422669 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a23eb-931a-4ac9-be61-ee0f451445e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:03.422934 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a23eb-931a-4ac9-be61-ee0f451445e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:03.423617 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a23eb-931a-4ac9-be61-ee0f451445e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:03.425531 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a23eb-931a-4ac9-be61-ee0f451445e6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:03.454408 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1333/2665] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:40:03 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:40:03.455585 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7255fd-0d29-467a-b525-3d1ae3585182 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:03.465285 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7255fd-0d29-467a-b525-3d1ae3585182 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:03.521052 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145bdfd-8fbb-434a-8ebf-af6ef9e23dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:03.521896 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145bdfd-8fbb-434a-8ebf-af6ef9e23dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:03.522300 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145bdfd-8fbb-434a-8ebf-af6ef9e23dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:03.522474 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145bdfd-8fbb-434a-8ebf-af6ef9e23dc9 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:03.523520 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145bdfd-8fbb-434a-8ebf-af6ef9e23dc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:03.525722 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145bdfd-8fbb-434a-8ebf-af6ef9e23dc9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:03.548066 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1333/2666] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:40:03 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:40:03.552788 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a23eb-931a-4ac9-be61-ee0f451445e6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:03.563815 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a23eb-931a-4ac9-be61-ee0f451445e6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:03.568559 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cce5f-c606-4c96-be10-d3a5d9b96629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:03.569207 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cce5f-c606-4c96-be10-d3a5d9b96629 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:03.569521 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cce5f-c606-4c96-be10-d3a5d9b96629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:03.569795 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cce5f-c606-4c96-be10-d3a5d9b96629 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:03.570518 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7cce5f-c606-4c96-be10-d3a5d9b96629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:03.572105 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7cce5f-c606-4c96-be10-d3a5d9b96629 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:03.582302 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1334/2667] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:40:03.586297 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145bdfd-8fbb-434a-8ebf-af6ef9e23dc9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:03.596226 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145bdfd-8fbb-434a-8ebf-af6ef9e23dc9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:03.600830 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd591bf9-f08e-456e-884f-4e1f7ed30733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:03.601501 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd591bf9-f08e-456e-884f-4e1f7ed30733 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:03.601783 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd591bf9-f08e-456e-884f-4e1f7ed30733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:03.602056 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd591bf9-f08e-456e-884f-4e1f7ed30733 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:03.602785 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd591bf9-f08e-456e-884f-4e1f7ed30733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:03.604389 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd591bf9-f08e-456e-884f-4e1f7ed30733 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:03.614437 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1334/2668] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:40:03.618744 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cce5f-c606-4c96-be10-d3a5d9b96629 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:03.629023 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cce5f-c606-4c96-be10-d3a5d9b96629 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:03.633625 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5daef6e-2167-4419-ad80-6a993d53d2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:03.634482 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5daef6e-2167-4419-ad80-6a993d53d2c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:03.634761 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5daef6e-2167-4419-ad80-6a993d53d2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:03.635028 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5daef6e-2167-4419-ad80-6a993d53d2c4 admin admin] PATH_INFO: `/v3/projects/4653bd63cd344bc19fcc04d2ed236b16/users/c8ef2895bd784f7a9e2065445834fe0a/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:03.648927 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5daef6e-2167-4419-ad80-6a993d53d2c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4653bd63cd344bc19fcc04d2ed236b16, user_id=c8ef2895bd784f7a9e2065445834fe0a, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:03.651676 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5daef6e-2167-4419-ad80-6a993d53d2c4 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:03.664142 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1335/2669] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:40:03 2022] PUT /identity/v3/projects/4653bd63cd344bc19fcc04d2ed236b16/users/c8ef2895bd784f7a9e2065445834fe0a/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:40:03.675147 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231bed7-4992-4525-8d9a-cbb5e3d0573f None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:03.675431 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231bed7-4992-4525-8d9a-cbb5e3d0573f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:03.675702 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231bed7-4992-4525-8d9a-cbb5e3d0573f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:03.701490 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-4231bed7-4992-4525-8d9a-cbb5e3d0573f None None] MFA Rules not processed for user `c8ef2895bd784f7a9e2065445834fe0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:03.702678 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4231bed7-4992-4525-8d9a-cbb5e3d0573f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:03.765076 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1335/2670] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:03.774814 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5daef6e-2167-4419-ad80-6a993d53d2c4 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:03.776473 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c5daef6e-2167-4419-ad80-6a993d53d2c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:03.831087 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5daef6e-2167-4419-ad80-6a993d53d2c4 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:03.834750 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a008e69-3bcd-4c60-8e7d-902275830b84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:03.835393 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a008e69-3bcd-4c60-8e7d-902275830b84 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:03.835671 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a008e69-3bcd-4c60-8e7d-902275830b84 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:03.835943 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a008e69-3bcd-4c60-8e7d-902275830b84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:03.845183 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a008e69-3bcd-4c60-8e7d-902275830b84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:03.846869 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a008e69-3bcd-4c60-8e7d-902275830b84 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:03.857105 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1336/2671] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:40:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:40:03.875298 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231bed7-4992-4525-8d9a-cbb5e3d0573f None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:03.939132 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231bed7-4992-4525-8d9a-cbb5e3d0573f None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:03.943667 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db105a37-b5a5-40ee-88f8-79bbca2d5a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:03.944519 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db105a37-b5a5-40ee-88f8-79bbca2d5a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:03.944806 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db105a37-b5a5-40ee-88f8-79bbca2d5a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:03.945078 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db105a37-b5a5-40ee-88f8-79bbca2d5a85 admin admin] PATH_INFO: `/v3/users/c8ef2895bd784f7a9e2065445834fe0a` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:03.946293 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db105a37-b5a5-40ee-88f8-79bbca2d5a85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ef2895bd784f7a9e2065445834fe0a)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:03.948232 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db105a37-b5a5-40ee-88f8-79bbca2d5a85 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:03.993505 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-db105a37-b5a5-40ee-88f8-79bbca2d5a85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ef2895bd784f7a9e2065445834fe0a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:04.004597 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-db105a37-b5a5-40ee-88f8-79bbca2d5a85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ef2895bd784f7a9e2065445834fe0a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:04.005294 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-db105a37-b5a5-40ee-88f8-79bbca2d5a85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ef2895bd784f7a9e2065445834fe0a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:04.005914 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-db105a37-b5a5-40ee-88f8-79bbca2d5a85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ef2895bd784f7a9e2065445834fe0a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:04.012783 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-db105a37-b5a5-40ee-88f8-79bbca2d5a85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ef2895bd784f7a9e2065445834fe0a'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:04.024735 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1336/2672] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:40:03 2022] DELETE /identity/v3/users/c8ef2895bd784f7a9e2065445834fe0a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:04.029756 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f06b18-987d-4625-a991-0021b5b2afbc None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:04.030041 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f06b18-987d-4625-a991-0021b5b2afbc None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:04.030313 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f06b18-987d-4625-a991-0021b5b2afbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:04.047607 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-d1f06b18-987d-4625-a991-0021b5b2afbc None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:04.048783 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d1f06b18-987d-4625-a991-0021b5b2afbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:04.103011 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1337/2673] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:40:04.113070 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db105a37-b5a5-40ee-88f8-79bbca2d5a85 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:04.114498 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-db105a37-b5a5-40ee-88f8-79bbca2d5a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:04.169630 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db105a37-b5a5-40ee-88f8-79bbca2d5a85 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:04.173308 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184c601-ed43-410f-b406-2b32a251f460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:04.173976 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184c601-ed43-410f-b406-2b32a251f460 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:04.174256 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184c601-ed43-410f-b406-2b32a251f460 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:04.174525 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184c601-ed43-410f-b406-2b32a251f460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:04.183364 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184c601-ed43-410f-b406-2b32a251f460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:04.184808 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184c601-ed43-410f-b406-2b32a251f460 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:04.195163 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1337/2674] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:40:04.463748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f06b18-987d-4625-a991-0021b5b2afbc None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:04.465153 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d1f06b18-987d-4625-a991-0021b5b2afbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:04.479338 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f06b18-987d-4625-a991-0021b5b2afbc None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:04.484087 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24507a3-264c-457a-93ea-36bce8bd4da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:04.485045 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24507a3-264c-457a-93ea-36bce8bd4da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:04.485429 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24507a3-264c-457a-93ea-36bce8bd4da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:04.485772 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24507a3-264c-457a-93ea-36bce8bd4da6 admin admin] PATH_INFO: `/v3/projects/4653bd63cd344bc19fcc04d2ed236b16` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:04.487279 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24507a3-264c-457a-93ea-36bce8bd4da6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4653bd63cd344bc19fcc04d2ed236b16)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:04.489460 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24507a3-264c-457a-93ea-36bce8bd4da6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:04.533898 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e24507a3-264c-457a-93ea-36bce8bd4da6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4653bd63cd344bc19fcc04d2ed236b16', 'request_id': 'req-e24507a3-264c-457a-93ea-36bce8bd4da6'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:04.541225 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e24507a3-264c-457a-93ea-36bce8bd4da6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4653bd63cd344bc19fcc04d2ed236b16', 'request_id': 'req-e24507a3-264c-457a-93ea-36bce8bd4da6'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:04.546849 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e24507a3-264c-457a-93ea-36bce8bd4da6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4653bd63cd344bc19fcc04d2ed236b16', 'request_id': 'req-e24507a3-264c-457a-93ea-36bce8bd4da6'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:04.557720 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e24507a3-264c-457a-93ea-36bce8bd4da6 admin admin] The token cache is being invalidate because project 4653bd63cd344bc19fcc04d2ed236b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:40:04.558007 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e24507a3-264c-457a-93ea-36bce8bd4da6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:04.558651 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-e24507a3-264c-457a-93ea-36bce8bd4da6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:04.560684 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1338/2675] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:40:04 2022] DELETE /identity/v3/projects/4653bd63cd344bc19fcc04d2ed236b16 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:40:04.565827 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35b493-fe15-4338-b802-c9fabe1e14d7 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:04.566116 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35b493-fe15-4338-b802-c9fabe1e14d7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:04.566390 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35b493-fe15-4338-b802-c9fabe1e14d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:04.583799 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-5e35b493-fe15-4338-b802-c9fabe1e14d7 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:04.584992 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5e35b493-fe15-4338-b802-c9fabe1e14d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:04.640865 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1338/2676] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:04.649570 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65383e-ff92-47e2-a7b7-494b4c57a0c0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:04.649858 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65383e-ff92-47e2-a7b7-494b4c57a0c0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:04.650137 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65383e-ff92-47e2-a7b7-494b4c57a0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:04.672577 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-ac65383e-ff92-47e2-a7b7-494b4c57a0c0 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:04.674220 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ac65383e-ff92-47e2-a7b7-494b4c57a0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:04.685016 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1339/2677] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:04.689156 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35b493-fe15-4338-b802-c9fabe1e14d7 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:04.698571 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35b493-fe15-4338-b802-c9fabe1e14d7 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:04.703691 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3fbf5-3127-4a71-81e0-1a7dfc598d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:04.704320 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3fbf5-3127-4a71-81e0-1a7dfc598d36 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:04.704594 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3fbf5-3127-4a71-81e0-1a7dfc598d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:04.704860 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3fbf5-3127-4a71-81e0-1a7dfc598d36 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:04.705607 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3fbf5-3127-4a71-81e0-1a7dfc598d36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:40:04.705906 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3fbf5-3127-4a71-81e0-1a7dfc598d36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:04.707481 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3fbf5-3127-4a71-81e0-1a7dfc598d36 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:04.718909 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1339/2678] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:40:04.723232 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65383e-ff92-47e2-a7b7-494b4c57a0c0 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:04.732951 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65383e-ff92-47e2-a7b7-494b4c57a0c0 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:04.737609 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10b665-f1d5-4751-850d-619e4d4800b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:04.738243 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10b665-f1d5-4751-850d-619e4d4800b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:04.738517 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10b665-f1d5-4751-850d-619e4d4800b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:04.738786 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10b665-f1d5-4751-850d-619e4d4800b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:04.739471 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10b665-f1d5-4751-850d-619e4d4800b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:04.741380 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10b665-f1d5-4751-850d-619e4d4800b6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:04.766560 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1340/2679] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:40:04 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:40:04.770576 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3fbf5-3127-4a71-81e0-1a7dfc598d36 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:04.780226 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3fbf5-3127-4a71-81e0-1a7dfc598d36 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:04.833157 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5148970-e1ff-4d2e-90c9-84e618232b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:04.833787 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5148970-e1ff-4d2e-90c9-84e618232b34 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:04.834049 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5148970-e1ff-4d2e-90c9-84e618232b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:04.834320 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5148970-e1ff-4d2e-90c9-84e618232b34 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:04.834998 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5148970-e1ff-4d2e-90c9-84e618232b34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:04.836923 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5148970-e1ff-4d2e-90c9-84e618232b34 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:04.857183 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1340/2680] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:40:04 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:40:04.861107 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10b665-f1d5-4751-850d-619e4d4800b6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:04.871117 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10b665-f1d5-4751-850d-619e4d4800b6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:04.876318 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f0be6-ee55-46f3-a361-eeb87dd7e58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:04.876956 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f0be6-ee55-46f3-a361-eeb87dd7e58a admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:04.877236 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f0be6-ee55-46f3-a361-eeb87dd7e58a admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:04.877627 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f0be6-ee55-46f3-a361-eeb87dd7e58a admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:04.878435 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f0be6-ee55-46f3-a361-eeb87dd7e58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:04.879966 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f0be6-ee55-46f3-a361-eeb87dd7e58a admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:04.890911 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1341/2681] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:40:04.894707 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5148970-e1ff-4d2e-90c9-84e618232b34 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:04.904349 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5148970-e1ff-4d2e-90c9-84e618232b34 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:04.908864 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95cd7a-0d7a-4356-9199-89578013894b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:04.909601 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95cd7a-0d7a-4356-9199-89578013894b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:04.909884 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95cd7a-0d7a-4356-9199-89578013894b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:04.910156 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95cd7a-0d7a-4356-9199-89578013894b admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:04.910875 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95cd7a-0d7a-4356-9199-89578013894b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:04.912520 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95cd7a-0d7a-4356-9199-89578013894b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:04.922809 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1341/2682] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:40:04.926581 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f0be6-ee55-46f3-a361-eeb87dd7e58a admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:04.936824 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f0be6-ee55-46f3-a361-eeb87dd7e58a admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:04.941366 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d222db-271f-4826-9e23-a270918d9ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:04.942223 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d222db-271f-4826-9e23-a270918d9ebe admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:04.942503 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d222db-271f-4826-9e23-a270918d9ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:04.942772 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d222db-271f-4826-9e23-a270918d9ebe admin admin] PATH_INFO: `/v3/projects/0470f164fb44480885c88cc3619d2371/users/75e4a489f6d948219aa5ac34c1d7a95c/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:04.956440 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d222db-271f-4826-9e23-a270918d9ebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0470f164fb44480885c88cc3619d2371, user_id=75e4a489f6d948219aa5ac34c1d7a95c, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:04.959100 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d222db-271f-4826-9e23-a270918d9ebe admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:04.971228 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1342/2683] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:40:04 2022] PUT /identity/v3/projects/0470f164fb44480885c88cc3619d2371/users/75e4a489f6d948219aa5ac34c1d7a95c/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:40:04.981815 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf76c80-e0ad-48ab-a56e-6301484a51db None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:04.982086 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf76c80-e0ad-48ab-a56e-6301484a51db None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:04.982389 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf76c80-e0ad-48ab-a56e-6301484a51db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:05.008375 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-8bf76c80-e0ad-48ab-a56e-6301484a51db None None] MFA Rules not processed for user `75e4a489f6d948219aa5ac34c1d7a95c`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:05.009598 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8bf76c80-e0ad-48ab-a56e-6301484a51db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:05.076065 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1342/2684] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:05.085559 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d222db-271f-4826-9e23-a270918d9ebe admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:05.087158 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b3d222db-271f-4826-9e23-a270918d9ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:05.141893 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d222db-271f-4826-9e23-a270918d9ebe admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:05.145590 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30ea91-2445-4e17-ba77-83dbccf3102f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:05.146216 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30ea91-2445-4e17-ba77-83dbccf3102f service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:05.146492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30ea91-2445-4e17-ba77-83dbccf3102f service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:05.146761 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30ea91-2445-4e17-ba77-83dbccf3102f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:05.154755 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30ea91-2445-4e17-ba77-83dbccf3102f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:05.156157 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30ea91-2445-4e17-ba77-83dbccf3102f service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:05.164554 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1343/2685] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:40:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:40:06.892926 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143ca2e-d926-4c1d-8d81-7149d20889d1 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:06.893401 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143ca2e-d926-4c1d-8d81-7149d20889d1 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:06.893568 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143ca2e-d926-4c1d-8d81-7149d20889d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:06.910691 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-8143ca2e-d926-4c1d-8d81-7149d20889d1 None None] MFA Rules not processed for user `4d22345d2e2646cc99c74a2f9692b648`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:06.911873 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-8143ca2e-d926-4c1d-8d81-7149d20889d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:06.964550 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1343/2686] 10.222.0.75 () {58 vars in 967 bytes} [Wed Feb 16 05:40:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:06.976748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30ea91-2445-4e17-ba77-83dbccf3102f service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:06.978231 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-eb30ea91-2445-4e17-ba77-83dbccf3102f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:07.044303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30ea91-2445-4e17-ba77-83dbccf3102f service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:07.049354 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a4fa2-d028-4467-970e-bf7311c95eec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eb49cac0c94e73a70361831dd789b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:07.049988 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a4fa2-d028-4467-970e-bf7311c95eec service swift] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:07.050269 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a4fa2-d028-4467-970e-bf7311c95eec service swift] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:07.050542 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a4fa2-d028-4467-970e-bf7311c95eec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:07.058373 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a4fa2-d028-4467-970e-bf7311c95eec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:07.060450 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a4fa2-d028-4467-970e-bf7311c95eec service swift] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:07.068235 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1344/2687] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Feb 16 05:40:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:40:12.447079 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143ca2e-d926-4c1d-8d81-7149d20889d1 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:12.505515 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143ca2e-d926-4c1d-8d81-7149d20889d1 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:12.510131 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72028017-40ed-4de2-9a2b-e1df2689399b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:12.510984 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72028017-40ed-4de2-9a2b-e1df2689399b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:12.511243 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72028017-40ed-4de2-9a2b-e1df2689399b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:12.511515 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72028017-40ed-4de2-9a2b-e1df2689399b admin admin] PATH_INFO: `/v3/users/75e4a489f6d948219aa5ac34c1d7a95c` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:12.512931 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72028017-40ed-4de2-9a2b-e1df2689399b admin admin] RBAC: Authorizing `identity:delete_user(user_id=75e4a489f6d948219aa5ac34c1d7a95c)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:12.514703 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72028017-40ed-4de2-9a2b-e1df2689399b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:12.557109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-72028017-40ed-4de2-9a2b-e1df2689399b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75e4a489f6d948219aa5ac34c1d7a95c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:12.568912 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-72028017-40ed-4de2-9a2b-e1df2689399b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75e4a489f6d948219aa5ac34c1d7a95c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:12.569587 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-72028017-40ed-4de2-9a2b-e1df2689399b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75e4a489f6d948219aa5ac34c1d7a95c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:12.570197 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-72028017-40ed-4de2-9a2b-e1df2689399b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75e4a489f6d948219aa5ac34c1d7a95c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:12.577280 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-72028017-40ed-4de2-9a2b-e1df2689399b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75e4a489f6d948219aa5ac34c1d7a95c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:12.589022 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1344/2688] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:40:12 2022] DELETE /identity/v3/users/75e4a489f6d948219aa5ac34c1d7a95c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:12.593566 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa5763-50ce-42e3-a5ff-5075a92893ca None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:12.594046 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa5763-50ce-42e3-a5ff-5075a92893ca None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:12.594145 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa5763-50ce-42e3-a5ff-5075a92893ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:12.611110 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-bcaa5763-50ce-42e3-a5ff-5075a92893ca None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:12.612293 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-bcaa5763-50ce-42e3-a5ff-5075a92893ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:12.669914 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1345/2689] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:40:12.679502 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72028017-40ed-4de2-9a2b-e1df2689399b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:12.681030 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-72028017-40ed-4de2-9a2b-e1df2689399b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:12.739006 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72028017-40ed-4de2-9a2b-e1df2689399b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:12.742840 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771731b-a897-4e21-9a3a-c4483338f185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:12.743481 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771731b-a897-4e21-9a3a-c4483338f185 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:12.743760 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771731b-a897-4e21-9a3a-c4483338f185 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:12.744032 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771731b-a897-4e21-9a3a-c4483338f185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:12.754058 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771731b-a897-4e21-9a3a-c4483338f185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:12.755517 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771731b-a897-4e21-9a3a-c4483338f185 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:12.765036 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1345/2690] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:40:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:40:13.109501 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa5763-50ce-42e3-a5ff-5075a92893ca None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:13.111730 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-bcaa5763-50ce-42e3-a5ff-5075a92893ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:13.124265 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa5763-50ce-42e3-a5ff-5075a92893ca None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:13.129211 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6ded4-374c-422f-9ac9-ac76862032e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:13.130138 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6ded4-374c-422f-9ac9-ac76862032e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:13.130415 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6ded4-374c-422f-9ac9-ac76862032e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:13.130687 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6ded4-374c-422f-9ac9-ac76862032e0 admin admin] PATH_INFO: `/v3/projects/0470f164fb44480885c88cc3619d2371` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:13.131886 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6ded4-374c-422f-9ac9-ac76862032e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0470f164fb44480885c88cc3619d2371)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:13.133845 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6ded4-374c-422f-9ac9-ac76862032e0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:13.181706 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-65b6ded4-374c-422f-9ac9-ac76862032e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0470f164fb44480885c88cc3619d2371', 'request_id': 'req-65b6ded4-374c-422f-9ac9-ac76862032e0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:13.189068 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-65b6ded4-374c-422f-9ac9-ac76862032e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0470f164fb44480885c88cc3619d2371', 'request_id': 'req-65b6ded4-374c-422f-9ac9-ac76862032e0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:13.194631 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-65b6ded4-374c-422f-9ac9-ac76862032e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0470f164fb44480885c88cc3619d2371', 'request_id': 'req-65b6ded4-374c-422f-9ac9-ac76862032e0'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:13.206072 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-65b6ded4-374c-422f-9ac9-ac76862032e0 admin admin] The token cache is being invalidate because project 0470f164fb44480885c88cc3619d2371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:40:13.206354 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-65b6ded4-374c-422f-9ac9-ac76862032e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:13.207006 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-65b6ded4-374c-422f-9ac9-ac76862032e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:13.208751 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1346/2691] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:40:13 2022] DELETE /identity/v3/projects/0470f164fb44480885c88cc3619d2371 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:13.214085 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d244d5-19de-451b-b894-c184684dafe7 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:13.214445 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d244d5-19de-451b-b894-c184684dafe7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:13.214790 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d244d5-19de-451b-b894-c184684dafe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:13.232889 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f1d244d5-19de-451b-b894-c184684dafe7 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:13.234122 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f1d244d5-19de-451b-b894-c184684dafe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:13.292189 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1346/2692] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:40:13.301088 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4598f6a-bec3-4951-b4c4-19c7888fa55d None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:13.301398 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4598f6a-bec3-4951-b4c4-19c7888fa55d None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:13.301674 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4598f6a-bec3-4951-b4c4-19c7888fa55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:13.319778 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-e4598f6a-bec3-4951-b4c4-19c7888fa55d None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:13.320992 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e4598f6a-bec3-4951-b4c4-19c7888fa55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:13.329424 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1347/2693] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:13.333651 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d244d5-19de-451b-b894-c184684dafe7 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:13.344088 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d244d5-19de-451b-b894-c184684dafe7 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:13.348716 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e1d0a-56ac-4920-bab2-4c412f1d269a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:13.349480 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e1d0a-56ac-4920-bab2-4c412f1d269a admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:13.349740 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e1d0a-56ac-4920-bab2-4c412f1d269a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:13.350014 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e1d0a-56ac-4920-bab2-4c412f1d269a admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:13.350737 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e1d0a-56ac-4920-bab2-4c412f1d269a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:40:13.351041 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e1d0a-56ac-4920-bab2-4c412f1d269a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:13.352748 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e1d0a-56ac-4920-bab2-4c412f1d269a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:13.364666 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1347/2694] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:40:13.368955 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4598f6a-bec3-4951-b4c4-19c7888fa55d None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:13.378020 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4598f6a-bec3-4951-b4c4-19c7888fa55d None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:13.382668 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767bd97-d346-472d-ad8c-deb00fc632d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:13.383304 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767bd97-d346-472d-ad8c-deb00fc632d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:13.383582 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767bd97-d346-472d-ad8c-deb00fc632d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:13.383850 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767bd97-d346-472d-ad8c-deb00fc632d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:13.384528 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767bd97-d346-472d-ad8c-deb00fc632d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:13.386501 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767bd97-d346-472d-ad8c-deb00fc632d3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:13.413602 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1348/2695] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:40:13 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:40:13.418100 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e1d0a-56ac-4920-bab2-4c412f1d269a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:13.428105 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e1d0a-56ac-4920-bab2-4c412f1d269a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:13.481870 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d189b-b855-4fc6-bb2b-fe641507f51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:13.482472 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d189b-b855-4fc6-bb2b-fe641507f51c admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:13.482724 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d189b-b855-4fc6-bb2b-fe641507f51c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:13.482997 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d189b-b855-4fc6-bb2b-fe641507f51c admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:13.483672 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d189b-b855-4fc6-bb2b-fe641507f51c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:13.485633 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d189b-b855-4fc6-bb2b-fe641507f51c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:13.505226 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1348/2696] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:40:13 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:40:13.509205 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767bd97-d346-472d-ad8c-deb00fc632d3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:13.519721 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767bd97-d346-472d-ad8c-deb00fc632d3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:13.524786 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34dfbae-2824-43d4-ab44-c1113a5e4866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:13.525402 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34dfbae-2824-43d4-ab44-c1113a5e4866 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:13.525680 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34dfbae-2824-43d4-ab44-c1113a5e4866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:13.525951 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34dfbae-2824-43d4-ab44-c1113a5e4866 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:13.526674 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34dfbae-2824-43d4-ab44-c1113a5e4866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:13.528254 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34dfbae-2824-43d4-ab44-c1113a5e4866 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:13.538569 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1349/2697] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:40:13.542787 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d189b-b855-4fc6-bb2b-fe641507f51c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:13.552537 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d189b-b855-4fc6-bb2b-fe641507f51c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:13.557069 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfc2e0-5be5-4106-b26f-5541d9fd35bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:13.557748 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfc2e0-5be5-4106-b26f-5541d9fd35bb admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:13.558030 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfc2e0-5be5-4106-b26f-5541d9fd35bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:13.558303 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfc2e0-5be5-4106-b26f-5541d9fd35bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:13.559564 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfc2e0-5be5-4106-b26f-5541d9fd35bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:13.561207 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfc2e0-5be5-4106-b26f-5541d9fd35bb admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:13.570595 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1349/2698] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:40:13.574459 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34dfbae-2824-43d4-ab44-c1113a5e4866 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:13.584577 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34dfbae-2824-43d4-ab44-c1113a5e4866 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:13.589130 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef637c-f201-4e13-a57d-2de664f2af56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:13.590012 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef637c-f201-4e13-a57d-2de664f2af56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:13.590287 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef637c-f201-4e13-a57d-2de664f2af56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:13.590555 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef637c-f201-4e13-a57d-2de664f2af56 admin admin] PATH_INFO: `/v3/projects/123106ff77724860b79fd62733dd01a2/users/c3e0d4297e7f4da0badc6de630d0752c/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:13.604084 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef637c-f201-4e13-a57d-2de664f2af56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=123106ff77724860b79fd62733dd01a2, user_id=c3e0d4297e7f4da0badc6de630d0752c, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:13.606758 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef637c-f201-4e13-a57d-2de664f2af56 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:13.619049 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1350/2699] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:40:13 2022] PUT /identity/v3/projects/123106ff77724860b79fd62733dd01a2/users/c3e0d4297e7f4da0badc6de630d0752c/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:13.629866 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b9d61-a30b-42c5-b3e2-76b962fcdf6a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:13.630174 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b9d61-a30b-42c5-b3e2-76b962fcdf6a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:13.630456 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b9d61-a30b-42c5-b3e2-76b962fcdf6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:13.658408 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-782b9d61-a30b-42c5-b3e2-76b962fcdf6a None None] MFA Rules not processed for user `c3e0d4297e7f4da0badc6de630d0752c`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:13.659618 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-782b9d61-a30b-42c5-b3e2-76b962fcdf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:13.721626 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1350/2700] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:13.732019 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef637c-f201-4e13-a57d-2de664f2af56 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:13.733757 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-99ef637c-f201-4e13-a57d-2de664f2af56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:13.788358 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef637c-f201-4e13-a57d-2de664f2af56 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:13.792299 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275331da-67f9-40ad-b5c1-26e11a822144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:13.792928 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275331da-67f9-40ad-b5c1-26e11a822144 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:13.793210 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275331da-67f9-40ad-b5c1-26e11a822144 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:13.793541 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275331da-67f9-40ad-b5c1-26e11a822144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:13.801652 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275331da-67f9-40ad-b5c1-26e11a822144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:13.803077 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275331da-67f9-40ad-b5c1-26e11a822144 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:13.812188 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1351/2701] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:40:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:40:16.302223 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b9d61-a30b-42c5-b3e2-76b962fcdf6a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:16.362042 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b9d61-a30b-42c5-b3e2-76b962fcdf6a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:16.366483 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ff407-5467-4f93-86e1-fe5373728c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:16.367326 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ff407-5467-4f93-86e1-fe5373728c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:16.367607 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ff407-5467-4f93-86e1-fe5373728c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:16.367878 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ff407-5467-4f93-86e1-fe5373728c30 admin admin] PATH_INFO: `/v3/users/c3e0d4297e7f4da0badc6de630d0752c` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:16.369082 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ff407-5467-4f93-86e1-fe5373728c30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3e0d4297e7f4da0badc6de630d0752c)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:16.371003 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ff407-5467-4f93-86e1-fe5373728c30 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:16.414979 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9c5ff407-5467-4f93-86e1-fe5373728c30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3e0d4297e7f4da0badc6de630d0752c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:16.427421 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9c5ff407-5467-4f93-86e1-fe5373728c30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3e0d4297e7f4da0badc6de630d0752c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:16.428303 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9c5ff407-5467-4f93-86e1-fe5373728c30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3e0d4297e7f4da0badc6de630d0752c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:16.428927 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9c5ff407-5467-4f93-86e1-fe5373728c30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3e0d4297e7f4da0badc6de630d0752c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:16.437798 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-9c5ff407-5467-4f93-86e1-fe5373728c30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3e0d4297e7f4da0badc6de630d0752c'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:16.454603 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1351/2702] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:40:16 2022] DELETE /identity/v3/users/c3e0d4297e7f4da0badc6de630d0752c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:16.459251 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561e571-6eba-4b6e-9723-2988d027c0d9 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:16.459711 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561e571-6eba-4b6e-9723-2988d027c0d9 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:16.459832 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561e571-6eba-4b6e-9723-2988d027c0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:16.476534 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-9561e571-6eba-4b6e-9723-2988d027c0d9 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:16.477811 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9561e571-6eba-4b6e-9723-2988d027c0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:16.533758 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1352/2703] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:16.544280 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ff407-5467-4f93-86e1-fe5373728c30 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:16.545783 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9c5ff407-5467-4f93-86e1-fe5373728c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:16.599724 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ff407-5467-4f93-86e1-fe5373728c30 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:16.603384 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47aa97-52b4-4703-827f-b1b3d2cc6321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:16.604011 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47aa97-52b4-4703-827f-b1b3d2cc6321 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:16.604293 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47aa97-52b4-4703-827f-b1b3d2cc6321 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:16.604569 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47aa97-52b4-4703-827f-b1b3d2cc6321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:16.613984 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47aa97-52b4-4703-827f-b1b3d2cc6321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:16.615414 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47aa97-52b4-4703-827f-b1b3d2cc6321 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:16.624496 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1352/2704] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:40:16.883245 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561e571-6eba-4b6e-9723-2988d027c0d9 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:16.884669 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9561e571-6eba-4b6e-9723-2988d027c0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:16.896722 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561e571-6eba-4b6e-9723-2988d027c0d9 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:16.901388 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece4773-fd94-492d-9ce7-581b38099490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:16.902233 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece4773-fd94-492d-9ce7-581b38099490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:16.902509 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece4773-fd94-492d-9ce7-581b38099490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:16.903442 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece4773-fd94-492d-9ce7-581b38099490 admin admin] PATH_INFO: `/v3/projects/123106ff77724860b79fd62733dd01a2` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:16.904652 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece4773-fd94-492d-9ce7-581b38099490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=123106ff77724860b79fd62733dd01a2)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:16.906679 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece4773-fd94-492d-9ce7-581b38099490 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:16.950896 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5ece4773-fd94-492d-9ce7-581b38099490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '123106ff77724860b79fd62733dd01a2', 'request_id': 'req-5ece4773-fd94-492d-9ce7-581b38099490'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:16.957438 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5ece4773-fd94-492d-9ce7-581b38099490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '123106ff77724860b79fd62733dd01a2', 'request_id': 'req-5ece4773-fd94-492d-9ce7-581b38099490'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:16.962662 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5ece4773-fd94-492d-9ce7-581b38099490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '123106ff77724860b79fd62733dd01a2', 'request_id': 'req-5ece4773-fd94-492d-9ce7-581b38099490'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:16.973689 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5ece4773-fd94-492d-9ce7-581b38099490 admin admin] The token cache is being invalidate because project 123106ff77724860b79fd62733dd01a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:40:16.973971 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5ece4773-fd94-492d-9ce7-581b38099490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:16.974588 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5ece4773-fd94-492d-9ce7-581b38099490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:16.976083 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1353/2705] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:40:16 2022] DELETE /identity/v3/projects/123106ff77724860b79fd62733dd01a2 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:46.978889 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47aa97-52b4-4703-827f-b1b3d2cc6321 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:46.987283 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47aa97-52b4-4703-827f-b1b3d2cc6321 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:47.033000 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f01f9-924b-46b6-8df4-b39fc2a55e44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:47.033660 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f01f9-924b-46b6-8df4-b39fc2a55e44 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:47.033942 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f01f9-924b-46b6-8df4-b39fc2a55e44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:47.034215 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f01f9-924b-46b6-8df4-b39fc2a55e44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:47.036053 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2e7f01f9-924b-46b6-8df4-b39fc2a55e44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:47.094752 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f01f9-924b-46b6-8df4-b39fc2a55e44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:47.096179 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f01f9-924b-46b6-8df4-b39fc2a55e44 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:47.105548 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1353/2706] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:40:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:40:50.062330 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece4773-fd94-492d-9ce7-581b38099490 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:50.067378 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5ece4773-fd94-492d-9ce7-581b38099490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:50.081144 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece4773-fd94-492d-9ce7-581b38099490 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:50.086215 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19509523-7188-4c03-b074-6babf6aed365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:50.087090 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19509523-7188-4c03-b074-6babf6aed365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:50.087367 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19509523-7188-4c03-b074-6babf6aed365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:50.087634 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19509523-7188-4c03-b074-6babf6aed365 admin admin] PATH_INFO: `/v3/users/9d3207da0fb24b3f8f329b6837fd9376` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:50.088842 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19509523-7188-4c03-b074-6babf6aed365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d3207da0fb24b3f8f329b6837fd9376)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:50.090858 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19509523-7188-4c03-b074-6babf6aed365 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:50.140405 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-19509523-7188-4c03-b074-6babf6aed365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d3207da0fb24b3f8f329b6837fd9376'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:50.147407 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-19509523-7188-4c03-b074-6babf6aed365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d3207da0fb24b3f8f329b6837fd9376'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:50.159087 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-19509523-7188-4c03-b074-6babf6aed365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d3207da0fb24b3f8f329b6837fd9376'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:50.164476 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-19509523-7188-4c03-b074-6babf6aed365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d3207da0fb24b3f8f329b6837fd9376'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:50.165246 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-19509523-7188-4c03-b074-6babf6aed365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d3207da0fb24b3f8f329b6837fd9376'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:50.178993 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1354/2707] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:40:50 2022] DELETE /identity/v3/users/9d3207da0fb24b3f8f329b6837fd9376 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:50.354269 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f01f9-924b-46b6-8df4-b39fc2a55e44 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:50.366356 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f01f9-924b-46b6-8df4-b39fc2a55e44 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:50.422245 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f90a5-72c0-4082-bd91-f9adf24beda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:50.423086 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f90a5-72c0-4082-bd91-f9adf24beda1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:50.423367 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f90a5-72c0-4082-bd91-f9adf24beda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:50.423640 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f90a5-72c0-4082-bd91-f9adf24beda1 admin admin] PATH_INFO: `/v3/projects/98f0673600914ab1a0a8636e309c3306` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:50.424806 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f90a5-72c0-4082-bd91-f9adf24beda1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98f0673600914ab1a0a8636e309c3306)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:50.426777 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f90a5-72c0-4082-bd91-f9adf24beda1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:50.469957 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d95f90a5-72c0-4082-bd91-f9adf24beda1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98f0673600914ab1a0a8636e309c3306', 'request_id': 'req-d95f90a5-72c0-4082-bd91-f9adf24beda1'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:50.476964 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d95f90a5-72c0-4082-bd91-f9adf24beda1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98f0673600914ab1a0a8636e309c3306', 'request_id': 'req-d95f90a5-72c0-4082-bd91-f9adf24beda1'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:50.483211 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d95f90a5-72c0-4082-bd91-f9adf24beda1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98f0673600914ab1a0a8636e309c3306', 'request_id': 'req-d95f90a5-72c0-4082-bd91-f9adf24beda1'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:50.493551 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d95f90a5-72c0-4082-bd91-f9adf24beda1 admin admin] The token cache is being invalidate because project 98f0673600914ab1a0a8636e309c3306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:40:50.493834 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d95f90a5-72c0-4082-bd91-f9adf24beda1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:50.494452 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-d95f90a5-72c0-4082-bd91-f9adf24beda1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:50.495957 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1354/2708] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:40:50 2022] DELETE /identity/v3/projects/98f0673600914ab1a0a8636e309c3306 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:50.500950 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d0d15-1252-4d04-8860-28e3042107fe None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:50.501236 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d0d15-1252-4d04-8860-28e3042107fe None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:50.501583 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d0d15-1252-4d04-8860-28e3042107fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:50.518485 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-df4d0d15-1252-4d04-8860-28e3042107fe None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:50.519704 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-df4d0d15-1252-4d04-8860-28e3042107fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:50.575499 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1355/2709] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:50.583196 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e2c07-4949-4e33-a77d-f342011a7463 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:50.583504 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e2c07-4949-4e33-a77d-f342011a7463 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:50.583778 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e2c07-4949-4e33-a77d-f342011a7463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:50.601782 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c44e2c07-4949-4e33-a77d-f342011a7463 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:50.602993 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c44e2c07-4949-4e33-a77d-f342011a7463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:50.611364 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1355/2710] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:50.615491 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d0d15-1252-4d04-8860-28e3042107fe None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:50.624987 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d0d15-1252-4d04-8860-28e3042107fe None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:50.629641 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c8dd0-5c9b-4bf7-9fed-df7f657b3115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:50.630278 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c8dd0-5c9b-4bf7-9fed-df7f657b3115 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:50.630553 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c8dd0-5c9b-4bf7-9fed-df7f657b3115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:50.630821 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c8dd0-5c9b-4bf7-9fed-df7f657b3115 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:50.631530 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c8dd0-5c9b-4bf7-9fed-df7f657b3115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:40:50.631830 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c8dd0-5c9b-4bf7-9fed-df7f657b3115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:50.633442 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c8dd0-5c9b-4bf7-9fed-df7f657b3115 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:50.645044 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1356/2711] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:40:50.649179 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e2c07-4949-4e33-a77d-f342011a7463 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:50.658828 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e2c07-4949-4e33-a77d-f342011a7463 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:50.663463 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb878c9-aa1c-4b10-b440-2da5f8640877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:50.664357 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb878c9-aa1c-4b10-b440-2da5f8640877 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:50.664632 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb878c9-aa1c-4b10-b440-2da5f8640877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:50.664902 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb878c9-aa1c-4b10-b440-2da5f8640877 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:50.665622 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb878c9-aa1c-4b10-b440-2da5f8640877 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:50.667668 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb878c9-aa1c-4b10-b440-2da5f8640877 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:50.692475 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1356/2712] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:40:50 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:40:50.696662 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c8dd0-5c9b-4bf7-9fed-df7f657b3115 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:50.707025 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c8dd0-5c9b-4bf7-9fed-df7f657b3115 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:50.763437 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca038edf-aea7-4a0a-8602-7db09f664470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:50.764010 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca038edf-aea7-4a0a-8602-7db09f664470 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:50.764285 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca038edf-aea7-4a0a-8602-7db09f664470 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:50.764552 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca038edf-aea7-4a0a-8602-7db09f664470 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:50.765217 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca038edf-aea7-4a0a-8602-7db09f664470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:50.767127 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca038edf-aea7-4a0a-8602-7db09f664470 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:50.786571 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1357/2713] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:40:50 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:40:50.791004 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb878c9-aa1c-4b10-b440-2da5f8640877 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:50.800814 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb878c9-aa1c-4b10-b440-2da5f8640877 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:50.805480 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2e38f-c960-4d03-8772-94fc32c2d6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:50.806114 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2e38f-c960-4d03-8772-94fc32c2d6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:50.806390 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2e38f-c960-4d03-8772-94fc32c2d6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:50.806659 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2e38f-c960-4d03-8772-94fc32c2d6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:50.807373 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2e38f-c960-4d03-8772-94fc32c2d6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:50.808977 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2e38f-c960-4d03-8772-94fc32c2d6f0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:50.818816 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1357/2714] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:40:50.822531 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca038edf-aea7-4a0a-8602-7db09f664470 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:50.832439 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca038edf-aea7-4a0a-8602-7db09f664470 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:50.837329 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53b7533-3481-4fd5-ad79-445d58c8c1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:50.837973 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b7533-3481-4fd5-ad79-445d58c8c1cd admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:50.838250 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b7533-3481-4fd5-ad79-445d58c8c1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:50.838518 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b7533-3481-4fd5-ad79-445d58c8c1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:50.839838 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b7533-3481-4fd5-ad79-445d58c8c1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:50.841467 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53b7533-3481-4fd5-ad79-445d58c8c1cd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:50.851050 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1358/2715] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:40:50.854920 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2e38f-c960-4d03-8772-94fc32c2d6f0 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:50.864741 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2e38f-c960-4d03-8772-94fc32c2d6f0 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:50.869174 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbff22-7021-4186-bc91-d2fed079bc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:50.870055 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbff22-7021-4186-bc91-d2fed079bc84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:50.870359 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbff22-7021-4186-bc91-d2fed079bc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:50.870629 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbff22-7021-4186-bc91-d2fed079bc84 admin admin] PATH_INFO: `/v3/projects/227d71ef8fe04a8597618388ef672635/users/a92b4b68c94b4316a398dfd11f8e25e9/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:50.884655 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbff22-7021-4186-bc91-d2fed079bc84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=227d71ef8fe04a8597618388ef672635, user_id=a92b4b68c94b4316a398dfd11f8e25e9, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:50.887950 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cbff22-7021-4186-bc91-d2fed079bc84 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:50.902190 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1358/2716] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:40:50 2022] PUT /identity/v3/projects/227d71ef8fe04a8597618388ef672635/users/a92b4b68c94b4316a398dfd11f8e25e9/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:50.912119 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80b1d2-1115-4639-8dcb-cee6bbdd7486 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:50.912400 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80b1d2-1115-4639-8dcb-cee6bbdd7486 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:50.912670 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80b1d2-1115-4639-8dcb-cee6bbdd7486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:50.938653 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-ed80b1d2-1115-4639-8dcb-cee6bbdd7486 None None] MFA Rules not processed for user `a92b4b68c94b4316a398dfd11f8e25e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:50.939839 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ed80b1d2-1115-4639-8dcb-cee6bbdd7486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:51.001509 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1359/2717] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:40:51.012429 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbff22-7021-4186-bc91-d2fed079bc84 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:51.014193 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-48cbff22-7021-4186-bc91-d2fed079bc84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:51.084639 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cbff22-7021-4186-bc91-d2fed079bc84 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:51.090579 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e75f5-6b02-4d3a-92fc-504c0cb7bb69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:51.091201 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e75f5-6b02-4d3a-92fc-504c0cb7bb69 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:51.091479 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e75f5-6b02-4d3a-92fc-504c0cb7bb69 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:51.091751 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e75f5-6b02-4d3a-92fc-504c0cb7bb69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:51.099342 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e75f5-6b02-4d3a-92fc-504c0cb7bb69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:51.100970 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052e75f5-6b02-4d3a-92fc-504c0cb7bb69 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:51.110098 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1359/2718] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:40:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:40:51.284814 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80b1d2-1115-4639-8dcb-cee6bbdd7486 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:51.344933 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80b1d2-1115-4639-8dcb-cee6bbdd7486 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:51.349465 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa01eb-a0ec-42d3-84c5-47736dd87d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:51.350313 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa01eb-a0ec-42d3-84c5-47736dd87d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:51.350591 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa01eb-a0ec-42d3-84c5-47736dd87d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:51.350861 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa01eb-a0ec-42d3-84c5-47736dd87d71 admin admin] PATH_INFO: `/v3/users/a92b4b68c94b4316a398dfd11f8e25e9` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:51.352024 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa01eb-a0ec-42d3-84c5-47736dd87d71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a92b4b68c94b4316a398dfd11f8e25e9)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:51.354025 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa01eb-a0ec-42d3-84c5-47736dd87d71 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:51.397242 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-26fa01eb-a0ec-42d3-84c5-47736dd87d71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a92b4b68c94b4316a398dfd11f8e25e9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:51.404294 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-26fa01eb-a0ec-42d3-84c5-47736dd87d71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a92b4b68c94b4316a398dfd11f8e25e9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:51.415728 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-26fa01eb-a0ec-42d3-84c5-47736dd87d71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a92b4b68c94b4316a398dfd11f8e25e9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:51.416398 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-26fa01eb-a0ec-42d3-84c5-47736dd87d71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a92b4b68c94b4316a398dfd11f8e25e9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:51.417008 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-26fa01eb-a0ec-42d3-84c5-47736dd87d71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a92b4b68c94b4316a398dfd11f8e25e9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:51.430022 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1360/2719] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:40:51 2022] DELETE /identity/v3/users/a92b4b68c94b4316a398dfd11f8e25e9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:51.434668 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53909018-a795-4547-8bb3-302f1a1c3e72 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:51.435128 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53909018-a795-4547-8bb3-302f1a1c3e72 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:51.435277 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53909018-a795-4547-8bb3-302f1a1c3e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:51.452408 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-53909018-a795-4547-8bb3-302f1a1c3e72 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:51.453633 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-53909018-a795-4547-8bb3-302f1a1c3e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:51.507727 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1360/2720] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:51.517820 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa01eb-a0ec-42d3-84c5-47736dd87d71 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:51.519235 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-26fa01eb-a0ec-42d3-84c5-47736dd87d71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:51.572792 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa01eb-a0ec-42d3-84c5-47736dd87d71 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:51.576939 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21e3c1-ac2e-4351-976c-3a48b47bce18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:51.577595 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21e3c1-ac2e-4351-976c-3a48b47bce18 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:51.577871 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21e3c1-ac2e-4351-976c-3a48b47bce18 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:51.578140 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21e3c1-ac2e-4351-976c-3a48b47bce18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:51.587182 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21e3c1-ac2e-4351-976c-3a48b47bce18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:51.588618 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd21e3c1-ac2e-4351-976c-3a48b47bce18 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:51.598492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1361/2721] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:40:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:40:51.850566 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53909018-a795-4547-8bb3-302f1a1c3e72 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:51.851972 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-53909018-a795-4547-8bb3-302f1a1c3e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:51.865542 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53909018-a795-4547-8bb3-302f1a1c3e72 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:51.871621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a690637-74e9-420a-b5cc-af4d8e6d4f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:51.872619 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a690637-74e9-420a-b5cc-af4d8e6d4f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:51.873130 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a690637-74e9-420a-b5cc-af4d8e6d4f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:51.873476 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a690637-74e9-420a-b5cc-af4d8e6d4f89 admin admin] PATH_INFO: `/v3/projects/227d71ef8fe04a8597618388ef672635` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:51.874617 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a690637-74e9-420a-b5cc-af4d8e6d4f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=227d71ef8fe04a8597618388ef672635)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:51.876531 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a690637-74e9-420a-b5cc-af4d8e6d4f89 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:51.921692 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4a690637-74e9-420a-b5cc-af4d8e6d4f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '227d71ef8fe04a8597618388ef672635', 'request_id': 'req-4a690637-74e9-420a-b5cc-af4d8e6d4f89'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:51.928410 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4a690637-74e9-420a-b5cc-af4d8e6d4f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '227d71ef8fe04a8597618388ef672635', 'request_id': 'req-4a690637-74e9-420a-b5cc-af4d8e6d4f89'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:51.934430 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4a690637-74e9-420a-b5cc-af4d8e6d4f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '227d71ef8fe04a8597618388ef672635', 'request_id': 'req-4a690637-74e9-420a-b5cc-af4d8e6d4f89'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:51.944929 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4a690637-74e9-420a-b5cc-af4d8e6d4f89 admin admin] The token cache is being invalidate because project 227d71ef8fe04a8597618388ef672635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:40:51.945214 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4a690637-74e9-420a-b5cc-af4d8e6d4f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:51.945883 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4a690637-74e9-420a-b5cc-af4d8e6d4f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:51.947381 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1361/2722] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:40:51 2022] DELETE /identity/v3/projects/227d71ef8fe04a8597618388ef672635 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:51.953093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f74151-0740-45bd-8323-1ed6577fbf4b None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:51.953425 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f74151-0740-45bd-8323-1ed6577fbf4b None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:51.953701 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f74151-0740-45bd-8323-1ed6577fbf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:51.970719 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-b1f74151-0740-45bd-8323-1ed6577fbf4b None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:51.971897 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-b1f74151-0740-45bd-8323-1ed6577fbf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:52.027192 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1362/2723] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:52.036283 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bf1c8-cadd-4516-a41d-d11f8fbbf6f7 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:52.036617 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bf1c8-cadd-4516-a41d-d11f8fbbf6f7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:52.036921 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bf1c8-cadd-4516-a41d-d11f8fbbf6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:52.055147 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-cf8bf1c8-cadd-4516-a41d-d11f8fbbf6f7 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:52.056342 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-cf8bf1c8-cadd-4516-a41d-d11f8fbbf6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:52.064722 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1362/2724] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:52.069027 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f74151-0740-45bd-8323-1ed6577fbf4b None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:52.078959 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f74151-0740-45bd-8323-1ed6577fbf4b None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:52.083442 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b9bde-0b1f-4541-806b-6aa0a7419bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:52.084073 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b9bde-0b1f-4541-806b-6aa0a7419bcf admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:52.084350 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b9bde-0b1f-4541-806b-6aa0a7419bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:52.084615 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b9bde-0b1f-4541-806b-6aa0a7419bcf admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:52.085353 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b9bde-0b1f-4541-806b-6aa0a7419bcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:40:52.085653 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b9bde-0b1f-4541-806b-6aa0a7419bcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:52.087217 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b9bde-0b1f-4541-806b-6aa0a7419bcf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:52.098126 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1363/2725] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:40:52.102270 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bf1c8-cadd-4516-a41d-d11f8fbbf6f7 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:52.111806 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bf1c8-cadd-4516-a41d-d11f8fbbf6f7 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:52.116445 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2531e03-8d76-44c9-bbba-f6c546462c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:52.117074 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2531e03-8d76-44c9-bbba-f6c546462c89 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:52.117382 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2531e03-8d76-44c9-bbba-f6c546462c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:52.117656 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2531e03-8d76-44c9-bbba-f6c546462c89 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:52.118343 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2531e03-8d76-44c9-bbba-f6c546462c89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:52.120824 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2531e03-8d76-44c9-bbba-f6c546462c89 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:52.144806 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1363/2726] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:40:52 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:40:52.148806 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b9bde-0b1f-4541-806b-6aa0a7419bcf admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:52.158766 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b9bde-0b1f-4541-806b-6aa0a7419bcf admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:52.212313 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac7580-43f4-41ec-84c1-9ab6fcf18dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:52.212962 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac7580-43f4-41ec-84c1-9ab6fcf18dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:52.213235 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac7580-43f4-41ec-84c1-9ab6fcf18dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:52.213537 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac7580-43f4-41ec-84c1-9ab6fcf18dc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:52.214213 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac7580-43f4-41ec-84c1-9ab6fcf18dc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:52.216102 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac7580-43f4-41ec-84c1-9ab6fcf18dc8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:52.235106 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1364/2727] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:40:52 2022] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:40:52.239156 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2531e03-8d76-44c9-bbba-f6c546462c89 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:52.249546 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2531e03-8d76-44c9-bbba-f6c546462c89 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:52.254029 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc57d37-bca6-4a0b-9587-f34fe7d61161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:52.254660 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc57d37-bca6-4a0b-9587-f34fe7d61161 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:52.254934 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc57d37-bca6-4a0b-9587-f34fe7d61161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:52.255202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc57d37-bca6-4a0b-9587-f34fe7d61161 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:52.255916 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc57d37-bca6-4a0b-9587-f34fe7d61161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:52.257568 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc57d37-bca6-4a0b-9587-f34fe7d61161 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:52.267553 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1364/2728] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:40:52.271308 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac7580-43f4-41ec-84c1-9ab6fcf18dc8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:52.280849 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac7580-43f4-41ec-84c1-9ab6fcf18dc8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:52.285530 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc01cbf-d07b-4a78-ade4-fe5b43b8f826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:52.286171 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc01cbf-d07b-4a78-ade4-fe5b43b8f826 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:52.286453 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc01cbf-d07b-4a78-ade4-fe5b43b8f826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:52.286729 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc01cbf-d07b-4a78-ade4-fe5b43b8f826 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:52.287476 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc01cbf-d07b-4a78-ade4-fe5b43b8f826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:52.289346 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc01cbf-d07b-4a78-ade4-fe5b43b8f826 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:52.299251 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1365/2729] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:40:52.303077 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc57d37-bca6-4a0b-9587-f34fe7d61161 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:52.315532 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc57d37-bca6-4a0b-9587-f34fe7d61161 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:52.320080 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb6c35-afe7-40d9-8f61-762eb630960b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:52.320935 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb6c35-afe7-40d9-8f61-762eb630960b admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:52.321209 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb6c35-afe7-40d9-8f61-762eb630960b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:52.321512 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb6c35-afe7-40d9-8f61-762eb630960b admin admin] PATH_INFO: `/v3/projects/85932a3168324e8fa141768ff9faa99c/users/42db1d937742433eac80b8da9c11f4a9/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:52.335227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb6c35-afe7-40d9-8f61-762eb630960b admin admin] RBAC: Authorizing `identity:create_grant(project_id=85932a3168324e8fa141768ff9faa99c, user_id=42db1d937742433eac80b8da9c11f4a9, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:52.337896 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb6c35-afe7-40d9-8f61-762eb630960b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:52.350434 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1365/2730] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:40:52 2022] PUT /identity/v3/projects/85932a3168324e8fa141768ff9faa99c/users/42db1d937742433eac80b8da9c11f4a9/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:52.361486 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad56dc-edcc-4069-8921-9a1b99144c30 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:52.361775 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad56dc-edcc-4069-8921-9a1b99144c30 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:52.362051 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad56dc-edcc-4069-8921-9a1b99144c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:52.388292 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-4aad56dc-edcc-4069-8921-9a1b99144c30 None None] MFA Rules not processed for user `42db1d937742433eac80b8da9c11f4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:52.389544 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4aad56dc-edcc-4069-8921-9a1b99144c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:52.450271 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1366/2731] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:40:52.454779 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb6c35-afe7-40d9-8f61-762eb630960b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:52.512536 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb6c35-afe7-40d9-8f61-762eb630960b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:52.517116 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31ef71-cc4b-4022-af14-010dc6125008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:52.517775 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31ef71-cc4b-4022-af14-010dc6125008 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:52.518050 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31ef71-cc4b-4022-af14-010dc6125008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:52.518320 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31ef71-cc4b-4022-af14-010dc6125008 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:52.518997 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31ef71-cc4b-4022-af14-010dc6125008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:52.520888 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31ef71-cc4b-4022-af14-010dc6125008 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:52.545872 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1366/2732] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:40:52 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:40:52.549956 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad56dc-edcc-4069-8921-9a1b99144c30 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:52.565197 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad56dc-edcc-4069-8921-9a1b99144c30 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:52.621195 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e920a4-0363-447a-a1eb-c2c8b8b056b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:52.621883 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e920a4-0363-447a-a1eb-c2c8b8b056b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:52.622167 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e920a4-0363-447a-a1eb-c2c8b8b056b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:52.622441 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e920a4-0363-447a-a1eb-c2c8b8b056b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:52.623113 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e920a4-0363-447a-a1eb-c2c8b8b056b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:52.625021 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e920a4-0363-447a-a1eb-c2c8b8b056b6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:52.643907 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1367/2733] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:40:52 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:40:52.648047 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31ef71-cc4b-4022-af14-010dc6125008 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:52.658548 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31ef71-cc4b-4022-af14-010dc6125008 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:52.663180 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f69f82-b907-41fa-aa8b-3c623795b24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:52.663820 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f69f82-b907-41fa-aa8b-3c623795b24e admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:52.664353 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f69f82-b907-41fa-aa8b-3c623795b24e admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:52.664624 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f69f82-b907-41fa-aa8b-3c623795b24e admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:52.665389 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f69f82-b907-41fa-aa8b-3c623795b24e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:52.667006 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f69f82-b907-41fa-aa8b-3c623795b24e admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:52.677854 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1367/2734] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:40:52.681992 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e920a4-0363-447a-a1eb-c2c8b8b056b6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:52.691702 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e920a4-0363-447a-a1eb-c2c8b8b056b6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:52.696268 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af942f0-e246-4107-853d-75d11ff19d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:52.697128 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af942f0-e246-4107-853d-75d11ff19d18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:52.697449 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af942f0-e246-4107-853d-75d11ff19d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:52.697724 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af942f0-e246-4107-853d-75d11ff19d18 admin admin] PATH_INFO: `/v3/projects/9647b1e45a47489e83c886932618f2c5/users/7b1ba358842240b883302e6589194cdb/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:52.711955 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af942f0-e246-4107-853d-75d11ff19d18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9647b1e45a47489e83c886932618f2c5, user_id=7b1ba358842240b883302e6589194cdb, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:52.715802 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af942f0-e246-4107-853d-75d11ff19d18 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:52.729168 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1368/2735] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:40:52 2022] PUT /identity/v3/projects/9647b1e45a47489e83c886932618f2c5/users/7b1ba358842240b883302e6589194cdb/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:52.733945 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f69f82-b907-41fa-aa8b-3c623795b24e admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:52.743786 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f69f82-b907-41fa-aa8b-3c623795b24e admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:52.797409 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6fb0a-6230-4a92-aab6-2b1a2d8fc09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:52.798003 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6fb0a-6230-4a92-aab6-2b1a2d8fc09c admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:52.798288 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6fb0a-6230-4a92-aab6-2b1a2d8fc09c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:52.798563 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6fb0a-6230-4a92-aab6-2b1a2d8fc09c admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:52.799288 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6fb0a-6230-4a92-aab6-2b1a2d8fc09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:52.800895 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6fb0a-6230-4a92-aab6-2b1a2d8fc09c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:52.810207 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1368/2736] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:40:52.814297 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af942f0-e246-4107-853d-75d11ff19d18 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:52.824274 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af942f0-e246-4107-853d-75d11ff19d18 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:52.828867 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812a675-3d8d-4287-9655-43cd0f5270d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:52.829758 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812a675-3d8d-4287-9655-43cd0f5270d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:52.830078 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812a675-3d8d-4287-9655-43cd0f5270d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:52.830315 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1812a675-3d8d-4287-9655-43cd0f5270d6 admin admin] PATH_INFO: `/v3/projects/9647b1e45a47489e83c886932618f2c5/users/7b1ba358842240b883302e6589194cdb/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:52.832281 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812a675-3d8d-4287-9655-43cd0f5270d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9647b1e45a47489e83c886932618f2c5, user_id=7b1ba358842240b883302e6589194cdb, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:52.834937 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1812a675-3d8d-4287-9655-43cd0f5270d6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:52.845886 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1369/2737] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:40:52 2022] PUT /identity/v3/projects/9647b1e45a47489e83c886932618f2c5/users/7b1ba358842240b883302e6589194cdb/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:40:52.856749 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbbe9a-b80f-4a62-a70e-020a50d0d5ff None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:52.857285 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbbe9a-b80f-4a62-a70e-020a50d0d5ff None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:52.857828 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbbe9a-b80f-4a62-a70e-020a50d0d5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:52.885283 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-36fbbe9a-b80f-4a62-a70e-020a50d0d5ff None None] MFA Rules not processed for user `7b1ba358842240b883302e6589194cdb`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:52.887042 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-36fbbe9a-b80f-4a62-a70e-020a50d0d5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:52.952172 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1369/2738] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:52.962887 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812a675-3d8d-4287-9655-43cd0f5270d6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:52.965160 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1812a675-3d8d-4287-9655-43cd0f5270d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:53.019031 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1812a675-3d8d-4287-9655-43cd0f5270d6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:53.022775 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d49e5f-6bfa-49a6-9d07-ee2688cf7cb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:53.023399 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d49e5f-6bfa-49a6-9d07-ee2688cf7cb3 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:53.023680 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d49e5f-6bfa-49a6-9d07-ee2688cf7cb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:53.023953 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d49e5f-6bfa-49a6-9d07-ee2688cf7cb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:53.033337 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d49e5f-6bfa-49a6-9d07-ee2688cf7cb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:53.034758 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d49e5f-6bfa-49a6-9d07-ee2688cf7cb3 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:53.044250 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1370/2739] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:40:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:40:53.321342 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbbe9a-b80f-4a62-a70e-020a50d0d5ff None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:53.330872 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbbe9a-b80f-4a62-a70e-020a50d0d5ff None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:53.335498 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0432050-9bcc-4fed-8208-74d2a5ce7a20 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1ba358842240b883302e6589194cdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9647b1e45a47489e83c886932618f2c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:53.336139 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0432050-9bcc-4fed-8208-74d2a5ce7a20 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:53.336426 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0432050-9bcc-4fed-8208-74d2a5ce7a20 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:53.336707 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0432050-9bcc-4fed-8208-74d2a5ce7a20 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:53.337464 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0432050-9bcc-4fed-8208-74d2a5ce7a20 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:40:53.337775 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0432050-9bcc-4fed-8208-74d2a5ce7a20 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:53.339380 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0432050-9bcc-4fed-8208-74d2a5ce7a20 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:53.350370 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1370/2740] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:40:53.354425 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d49e5f-6bfa-49a6-9d07-ee2688cf7cb3 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:53.363429 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d49e5f-6bfa-49a6-9d07-ee2688cf7cb3 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:53.367971 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3d5c4-a752-4e03-856d-47c51fefb500 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1ba358842240b883302e6589194cdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9647b1e45a47489e83c886932618f2c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:53.368604 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3d5c4-a752-4e03-856d-47c51fefb500 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:53.368893 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3d5c4-a752-4e03-856d-47c51fefb500 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:53.369170 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3d5c4-a752-4e03-856d-47c51fefb500 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:53.369887 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3d5c4-a752-4e03-856d-47c51fefb500 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:53.372289 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b3d5c4-a752-4e03-856d-47c51fefb500 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:53.396568 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1371/2741] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:40:53 2022] POST /identity/v3/projects => generated 355 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:40:53.400563 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0432050-9bcc-4fed-8208-74d2a5ce7a20 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:53.410233 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0432050-9bcc-4fed-8208-74d2a5ce7a20 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:53.463988 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26485f3e-d7cb-446f-9faf-513e4e8b5343 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1ba358842240b883302e6589194cdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9647b1e45a47489e83c886932618f2c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:53.464678 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26485f3e-d7cb-446f-9faf-513e4e8b5343 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:53.464910 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26485f3e-d7cb-446f-9faf-513e4e8b5343 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:53.465185 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26485f3e-d7cb-446f-9faf-513e4e8b5343 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:53.465935 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26485f3e-d7cb-446f-9faf-513e4e8b5343 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:40:53.466240 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26485f3e-d7cb-446f-9faf-513e4e8b5343 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:53.467849 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26485f3e-d7cb-446f-9faf-513e4e8b5343 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:53.478719 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1371/2742] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:40:53.512125 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3d5c4-a752-4e03-856d-47c51fefb500 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:53.521963 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3d5c4-a752-4e03-856d-47c51fefb500 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:53.526478 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc16ff2-60a2-4254-8191-3f2969fd80ad tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b1ba358842240b883302e6589194cdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9647b1e45a47489e83c886932618f2c5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:53.527328 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc16ff2-60a2-4254-8191-3f2969fd80ad tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:53.527609 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc16ff2-60a2-4254-8191-3f2969fd80ad tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:53.527884 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc16ff2-60a2-4254-8191-3f2969fd80ad tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] PATH_INFO: `/v3/projects/1366c91f54474fc983d2b1952ef5b6e7` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:53.529050 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc16ff2-60a2-4254-8191-3f2969fd80ad tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1366c91f54474fc983d2b1952ef5b6e7)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:53.530973 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc16ff2-60a2-4254-8191-3f2969fd80ad tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:53.575260 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6bc16ff2-60a2-4254-8191-3f2969fd80ad tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1366c91f54474fc983d2b1952ef5b6e7', 'request_id': 'req-6bc16ff2-60a2-4254-8191-3f2969fd80ad'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:53.581885 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6bc16ff2-60a2-4254-8191-3f2969fd80ad tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1366c91f54474fc983d2b1952ef5b6e7', 'request_id': 'req-6bc16ff2-60a2-4254-8191-3f2969fd80ad'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:53.587458 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6bc16ff2-60a2-4254-8191-3f2969fd80ad tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1366c91f54474fc983d2b1952ef5b6e7', 'request_id': 'req-6bc16ff2-60a2-4254-8191-3f2969fd80ad'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:53.599015 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6bc16ff2-60a2-4254-8191-3f2969fd80ad tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] The token cache is being invalidate because project 1366c91f54474fc983d2b1952ef5b6e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:40:53.599303 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6bc16ff2-60a2-4254-8191-3f2969fd80ad tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:53.599938 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-6bc16ff2-60a2-4254-8191-3f2969fd80ad tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:53.601479 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1372/2743] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:40:53 2022] DELETE /identity/v3/projects/1366c91f54474fc983d2b1952ef5b6e7 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:53.780650 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26485f3e-d7cb-446f-9faf-513e4e8b5343 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:53.782395 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-26485f3e-d7cb-446f-9faf-513e4e8b5343 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:53.844344 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26485f3e-d7cb-446f-9faf-513e4e8b5343 tempest-VolumeQuotaClassesTest-1229420323 tempest-VolumeQuotaClassesTest-1229420323-project-admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:53.896525 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc867f-15e7-483c-ba9d-459cbdb0509f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:53.897408 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc867f-15e7-483c-ba9d-459cbdb0509f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:53.897686 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc867f-15e7-483c-ba9d-459cbdb0509f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:53.897969 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc867f-15e7-483c-ba9d-459cbdb0509f admin admin] PATH_INFO: `/v3/users/42db1d937742433eac80b8da9c11f4a9` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:53.899121 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc867f-15e7-483c-ba9d-459cbdb0509f admin admin] RBAC: Authorizing `identity:delete_user(user_id=42db1d937742433eac80b8da9c11f4a9)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:53.901038 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc867f-15e7-483c-ba9d-459cbdb0509f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:53.942604 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-6fbc867f-15e7-483c-ba9d-459cbdb0509f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42db1d937742433eac80b8da9c11f4a9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:53.954273 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-6fbc867f-15e7-483c-ba9d-459cbdb0509f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42db1d937742433eac80b8da9c11f4a9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:53.954906 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-6fbc867f-15e7-483c-ba9d-459cbdb0509f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42db1d937742433eac80b8da9c11f4a9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:53.955502 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-6fbc867f-15e7-483c-ba9d-459cbdb0509f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42db1d937742433eac80b8da9c11f4a9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:53.962363 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-6fbc867f-15e7-483c-ba9d-459cbdb0509f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42db1d937742433eac80b8da9c11f4a9'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:53.974561 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1372/2744] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:40:53 2022] DELETE /identity/v3/users/42db1d937742433eac80b8da9c11f4a9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:53.979172 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33133ed-628f-4934-9bcd-1d00f6f4967f None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:53.979498 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33133ed-628f-4934-9bcd-1d00f6f4967f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:53.979780 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33133ed-628f-4934-9bcd-1d00f6f4967f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:53.997035 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-c33133ed-628f-4934-9bcd-1d00f6f4967f None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:53.998290 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c33133ed-628f-4934-9bcd-1d00f6f4967f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:54.053148 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1373/2745] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:40:54.063057 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc867f-15e7-483c-ba9d-459cbdb0509f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:54.064415 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6fbc867f-15e7-483c-ba9d-459cbdb0509f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:54.118227 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc867f-15e7-483c-ba9d-459cbdb0509f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:54.122416 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc124b2-5fa5-4971-a1b1-d83e0f6127b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:54.123049 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc124b2-5fa5-4971-a1b1-d83e0f6127b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:54.123332 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc124b2-5fa5-4971-a1b1-d83e0f6127b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:54.123615 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc124b2-5fa5-4971-a1b1-d83e0f6127b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:54.132356 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc124b2-5fa5-4971-a1b1-d83e0f6127b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:54.133849 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc124b2-5fa5-4971-a1b1-d83e0f6127b2 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:54.143595 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1373/2746] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:40:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:40:54.400148 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33133ed-628f-4934-9bcd-1d00f6f4967f None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:54.401609 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c33133ed-628f-4934-9bcd-1d00f6f4967f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:54.415432 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33133ed-628f-4934-9bcd-1d00f6f4967f None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:54.421157 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eceb96-6cbb-4cd4-9e78-a79fe7adb7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:54.422314 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eceb96-6cbb-4cd4-9e78-a79fe7adb7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:54.422486 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eceb96-6cbb-4cd4-9e78-a79fe7adb7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:54.422782 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eceb96-6cbb-4cd4-9e78-a79fe7adb7ca admin admin] PATH_INFO: `/v3/projects/85932a3168324e8fa141768ff9faa99c` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:54.423931 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eceb96-6cbb-4cd4-9e78-a79fe7adb7ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=85932a3168324e8fa141768ff9faa99c)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:54.425907 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eceb96-6cbb-4cd4-9e78-a79fe7adb7ca admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:54.470526 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5eceb96-6cbb-4cd4-9e78-a79fe7adb7ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85932a3168324e8fa141768ff9faa99c', 'request_id': 'req-c5eceb96-6cbb-4cd4-9e78-a79fe7adb7ca'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:54.477137 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5eceb96-6cbb-4cd4-9e78-a79fe7adb7ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85932a3168324e8fa141768ff9faa99c', 'request_id': 'req-c5eceb96-6cbb-4cd4-9e78-a79fe7adb7ca'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:54.483047 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5eceb96-6cbb-4cd4-9e78-a79fe7adb7ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85932a3168324e8fa141768ff9faa99c', 'request_id': 'req-c5eceb96-6cbb-4cd4-9e78-a79fe7adb7ca'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:54.493864 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5eceb96-6cbb-4cd4-9e78-a79fe7adb7ca admin admin] The token cache is being invalidate because project 85932a3168324e8fa141768ff9faa99c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:40:54.494150 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5eceb96-6cbb-4cd4-9e78-a79fe7adb7ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:54.494775 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-c5eceb96-6cbb-4cd4-9e78-a79fe7adb7ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:54.496856 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1374/2747] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:40:54 2022] DELETE /identity/v3/projects/85932a3168324e8fa141768ff9faa99c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:40:54.500770 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc124b2-5fa5-4971-a1b1-d83e0f6127b2 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:54.510019 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc124b2-5fa5-4971-a1b1-d83e0f6127b2 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:54.564252 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073e3ef-a3ae-49ca-98a4-8423b1207b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:54.565113 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073e3ef-a3ae-49ca-98a4-8423b1207b25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:54.565422 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073e3ef-a3ae-49ca-98a4-8423b1207b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:54.565691 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073e3ef-a3ae-49ca-98a4-8423b1207b25 admin admin] PATH_INFO: `/v3/users/7b1ba358842240b883302e6589194cdb` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:54.566882 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073e3ef-a3ae-49ca-98a4-8423b1207b25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b1ba358842240b883302e6589194cdb)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:54.568809 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073e3ef-a3ae-49ca-98a4-8423b1207b25 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:54.611503 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5073e3ef-a3ae-49ca-98a4-8423b1207b25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b1ba358842240b883302e6589194cdb'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:54.623295 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5073e3ef-a3ae-49ca-98a4-8423b1207b25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b1ba358842240b883302e6589194cdb'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:54.623950 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5073e3ef-a3ae-49ca-98a4-8423b1207b25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b1ba358842240b883302e6589194cdb'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:54.624541 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5073e3ef-a3ae-49ca-98a4-8423b1207b25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b1ba358842240b883302e6589194cdb'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:54.631430 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5073e3ef-a3ae-49ca-98a4-8423b1207b25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b1ba358842240b883302e6589194cdb'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:54.643081 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1374/2748] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:40:54 2022] DELETE /identity/v3/users/7b1ba358842240b883302e6589194cdb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:54.908766 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eceb96-6cbb-4cd4-9e78-a79fe7adb7ca admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:54.910456 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c5eceb96-6cbb-4cd4-9e78-a79fe7adb7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:54.924730 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eceb96-6cbb-4cd4-9e78-a79fe7adb7ca admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:54.978497 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa455a0-f8ea-42c2-bbf2-1b8568c3d779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:54.979335 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa455a0-f8ea-42c2-bbf2-1b8568c3d779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:54.980182 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa455a0-f8ea-42c2-bbf2-1b8568c3d779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:54.980453 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa455a0-f8ea-42c2-bbf2-1b8568c3d779 admin admin] PATH_INFO: `/v3/projects/9647b1e45a47489e83c886932618f2c5` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:54.981646 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa455a0-f8ea-42c2-bbf2-1b8568c3d779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9647b1e45a47489e83c886932618f2c5)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:54.983543 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa455a0-f8ea-42c2-bbf2-1b8568c3d779 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:55.024989 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5fa455a0-f8ea-42c2-bbf2-1b8568c3d779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9647b1e45a47489e83c886932618f2c5', 'request_id': 'req-5fa455a0-f8ea-42c2-bbf2-1b8568c3d779'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:55.031820 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5fa455a0-f8ea-42c2-bbf2-1b8568c3d779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9647b1e45a47489e83c886932618f2c5', 'request_id': 'req-5fa455a0-f8ea-42c2-bbf2-1b8568c3d779'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:55.037718 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5fa455a0-f8ea-42c2-bbf2-1b8568c3d779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9647b1e45a47489e83c886932618f2c5', 'request_id': 'req-5fa455a0-f8ea-42c2-bbf2-1b8568c3d779'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:55.049185 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5fa455a0-f8ea-42c2-bbf2-1b8568c3d779 admin admin] The token cache is being invalidate because project 9647b1e45a47489e83c886932618f2c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:40:55.049506 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5fa455a0-f8ea-42c2-bbf2-1b8568c3d779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:55.050160 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5fa455a0-f8ea-42c2-bbf2-1b8568c3d779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:55.051682 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1375/2749] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:40:54 2022] DELETE /identity/v3/projects/9647b1e45a47489e83c886932618f2c5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:40:55.056605 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61f96-a66e-4e78-ac6b-440f336d2fd0 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:55.056896 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61f96-a66e-4e78-ac6b-440f336d2fd0 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:55.057172 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed61f96-a66e-4e78-ac6b-440f336d2fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:55.074535 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-4ed61f96-a66e-4e78-ac6b-440f336d2fd0 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:55.075741 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4ed61f96-a66e-4e78-ac6b-440f336d2fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:55.131649 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1375/2750] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:55.141058 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc096569-4f9d-4aa0-a415-0a8331ffb3f2 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:55.141365 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc096569-4f9d-4aa0-a415-0a8331ffb3f2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:55.141645 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc096569-4f9d-4aa0-a415-0a8331ffb3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:55.159894 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-fc096569-4f9d-4aa0-a415-0a8331ffb3f2 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:55.161019 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-fc096569-4f9d-4aa0-a415-0a8331ffb3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:55.169463 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1376/2751] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:55.173562 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed61f96-a66e-4e78-ac6b-440f336d2fd0 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:55.184235 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed61f96-a66e-4e78-ac6b-440f336d2fd0 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:55.191095 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7088720-f301-4d8a-8e8f-4147ed86dfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:55.191758 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7088720-f301-4d8a-8e8f-4147ed86dfea admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:55.192032 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7088720-f301-4d8a-8e8f-4147ed86dfea admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:55.192353 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7088720-f301-4d8a-8e8f-4147ed86dfea admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:55.193494 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7088720-f301-4d8a-8e8f-4147ed86dfea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:40:55.194034 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7088720-f301-4d8a-8e8f-4147ed86dfea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:55.197100 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7088720-f301-4d8a-8e8f-4147ed86dfea admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:55.211315 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1376/2752] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:40:55.216125 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc096569-4f9d-4aa0-a415-0a8331ffb3f2 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:55.225400 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc096569-4f9d-4aa0-a415-0a8331ffb3f2 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:55.230105 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ab94e-1177-459f-bc1d-c60a78811a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:55.230740 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ab94e-1177-459f-bc1d-c60a78811a14 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:55.231018 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ab94e-1177-459f-bc1d-c60a78811a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:55.231317 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ab94e-1177-459f-bc1d-c60a78811a14 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:55.232037 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ab94e-1177-459f-bc1d-c60a78811a14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:55.233961 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ab94e-1177-459f-bc1d-c60a78811a14 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:55.257776 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1377/2753] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:40:55 2022] POST /identity/v3/projects => generated 373 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:40:55.262377 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7088720-f301-4d8a-8e8f-4147ed86dfea admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:55.271939 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7088720-f301-4d8a-8e8f-4147ed86dfea admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:55.325188 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ef701-64b9-4fe7-9338-19c51e2706ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:55.325867 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ef701-64b9-4fe7-9338-19c51e2706ef admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:55.326147 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ef701-64b9-4fe7-9338-19c51e2706ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:55.326416 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ef701-64b9-4fe7-9338-19c51e2706ef admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:55.327097 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ef701-64b9-4fe7-9338-19c51e2706ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:55.329014 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ef701-64b9-4fe7-9338-19c51e2706ef admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:55.349601 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1377/2754] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:40:55 2022] POST /identity/v3/users => generated 287 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:40:55.352193 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ab94e-1177-459f-bc1d-c60a78811a14 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:55.362365 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ab94e-1177-459f-bc1d-c60a78811a14 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:55.367480 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d3fcb-cf10-4e52-8d77-39ad22c47ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:55.368125 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d3fcb-cf10-4e52-8d77-39ad22c47ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:55.368411 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d3fcb-cf10-4e52-8d77-39ad22c47ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:55.368684 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d3fcb-cf10-4e52-8d77-39ad22c47ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:55.369535 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d3fcb-cf10-4e52-8d77-39ad22c47ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:55.371158 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2d3fcb-cf10-4e52-8d77-39ad22c47ba9 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:55.381247 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1378/2755] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:40:55.385007 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ef701-64b9-4fe7-9338-19c51e2706ef admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:55.395299 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ef701-64b9-4fe7-9338-19c51e2706ef admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:55.399847 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe41d9-ed8d-41b9-bc45-43ad69451467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:55.400486 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe41d9-ed8d-41b9-bc45-43ad69451467 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:55.400764 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe41d9-ed8d-41b9-bc45-43ad69451467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:55.401040 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe41d9-ed8d-41b9-bc45-43ad69451467 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:55.402340 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe41d9-ed8d-41b9-bc45-43ad69451467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:55.403935 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe41d9-ed8d-41b9-bc45-43ad69451467 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:55.413480 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1378/2756] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:40:55.417556 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d3fcb-cf10-4e52-8d77-39ad22c47ba9 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:55.427297 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d3fcb-cf10-4e52-8d77-39ad22c47ba9 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:55.431959 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b238e7-a78f-447c-ba9c-a7b6fd790b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:55.432811 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b238e7-a78f-447c-ba9c-a7b6fd790b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:55.433089 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b238e7-a78f-447c-ba9c-a7b6fd790b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:55.433398 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b238e7-a78f-447c-ba9c-a7b6fd790b9d admin admin] PATH_INFO: `/v3/projects/7835fb125fe843b1b0bf34a6f3e1867b/users/7f7b0e06dd7640f6b9e545c8e8ffa9ed/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:55.447320 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b238e7-a78f-447c-ba9c-a7b6fd790b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7835fb125fe843b1b0bf34a6f3e1867b, user_id=7f7b0e06dd7640f6b9e545c8e8ffa9ed, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:55.450501 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b238e7-a78f-447c-ba9c-a7b6fd790b9d admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:55.462604 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1379/2757] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:40:55 2022] PUT /identity/v3/projects/7835fb125fe843b1b0bf34a6f3e1867b/users/7f7b0e06dd7640f6b9e545c8e8ffa9ed/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:40:55.473449 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263940c-95c7-48d9-a742-a09a387ab508 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:55.473738 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263940c-95c7-48d9-a742-a09a387ab508 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:55.474061 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263940c-95c7-48d9-a742-a09a387ab508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:55.499872 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-4263940c-95c7-48d9-a742-a09a387ab508 None None] MFA Rules not processed for user `7f7b0e06dd7640f6b9e545c8e8ffa9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:55.501091 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4263940c-95c7-48d9-a742-a09a387ab508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:55.561410 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1379/2758] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:55.571033 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b238e7-a78f-447c-ba9c-a7b6fd790b9d admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:55.572736 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-60b238e7-a78f-447c-ba9c-a7b6fd790b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:55.629168 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b238e7-a78f-447c-ba9c-a7b6fd790b9d admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:55.632825 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240cc52-3e1f-4b94-8975-2bdce314caf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:55.633488 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240cc52-3e1f-4b94-8975-2bdce314caf0 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:55.633768 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240cc52-3e1f-4b94-8975-2bdce314caf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:55.634038 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240cc52-3e1f-4b94-8975-2bdce314caf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:55.642692 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240cc52-3e1f-4b94-8975-2bdce314caf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:55.644100 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240cc52-3e1f-4b94-8975-2bdce314caf0 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:55.652629 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1380/2759] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:40:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:40:55.671762 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263940c-95c7-48d9-a742-a09a387ab508 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:55.732743 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263940c-95c7-48d9-a742-a09a387ab508 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:55.738338 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670a677-0fa2-4440-95a4-9b9c75eccc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:55.739291 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670a677-0fa2-4440-95a4-9b9c75eccc2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:55.739573 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670a677-0fa2-4440-95a4-9b9c75eccc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:55.739842 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670a677-0fa2-4440-95a4-9b9c75eccc2c admin admin] PATH_INFO: `/v3/users/7f7b0e06dd7640f6b9e545c8e8ffa9ed` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:55.741052 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670a677-0fa2-4440-95a4-9b9c75eccc2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f7b0e06dd7640f6b9e545c8e8ffa9ed)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:55.743029 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670a677-0fa2-4440-95a4-9b9c75eccc2c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:55.787592 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4670a677-0fa2-4440-95a4-9b9c75eccc2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f7b0e06dd7640f6b9e545c8e8ffa9ed'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:55.799121 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4670a677-0fa2-4440-95a4-9b9c75eccc2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f7b0e06dd7640f6b9e545c8e8ffa9ed'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:55.799823 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4670a677-0fa2-4440-95a4-9b9c75eccc2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f7b0e06dd7640f6b9e545c8e8ffa9ed'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:55.800438 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4670a677-0fa2-4440-95a4-9b9c75eccc2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f7b0e06dd7640f6b9e545c8e8ffa9ed'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:55.807195 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-4670a677-0fa2-4440-95a4-9b9c75eccc2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f7b0e06dd7640f6b9e545c8e8ffa9ed'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:55.819309 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1380/2760] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:40:55 2022] DELETE /identity/v3/users/7f7b0e06dd7640f6b9e545c8e8ffa9ed => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:55.824624 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbed97-83b4-4d27-954c-44bdd48afb81 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:55.824998 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbed97-83b4-4d27-954c-44bdd48afb81 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:55.825305 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbed97-83b4-4d27-954c-44bdd48afb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:55.841927 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-05dbed97-83b4-4d27-954c-44bdd48afb81 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:55.843153 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-05dbed97-83b4-4d27-954c-44bdd48afb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:55.899522 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1381/2761] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:55.909100 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670a677-0fa2-4440-95a4-9b9c75eccc2c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:55.910592 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-4670a677-0fa2-4440-95a4-9b9c75eccc2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:55.966560 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670a677-0fa2-4440-95a4-9b9c75eccc2c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:55.970164 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8647462-c9f3-40cc-af9d-675ccf2c79ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:55.970798 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8647462-c9f3-40cc-af9d-675ccf2c79ef service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:55.971081 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8647462-c9f3-40cc-af9d-675ccf2c79ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:55.971380 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8647462-c9f3-40cc-af9d-675ccf2c79ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:55.980824 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8647462-c9f3-40cc-af9d-675ccf2c79ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:55.982290 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8647462-c9f3-40cc-af9d-675ccf2c79ef service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:55.991477 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1381/2762] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:40:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:40:56.251088 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbed97-83b4-4d27-954c-44bdd48afb81 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:56.252646 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-05dbed97-83b4-4d27-954c-44bdd48afb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:56.271034 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbed97-83b4-4d27-954c-44bdd48afb81 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:56.276913 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09d31f-1c40-462d-b9db-b077fbe69b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:56.277828 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09d31f-1c40-462d-b9db-b077fbe69b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:56.278017 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09d31f-1c40-462d-b9db-b077fbe69b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:56.278277 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09d31f-1c40-462d-b9db-b077fbe69b13 admin admin] PATH_INFO: `/v3/projects/7835fb125fe843b1b0bf34a6f3e1867b` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:56.279555 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09d31f-1c40-462d-b9db-b077fbe69b13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7835fb125fe843b1b0bf34a6f3e1867b)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:56.281539 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09d31f-1c40-462d-b9db-b077fbe69b13 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:56.326646 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7c09d31f-1c40-462d-b9db-b077fbe69b13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7835fb125fe843b1b0bf34a6f3e1867b', 'request_id': 'req-7c09d31f-1c40-462d-b9db-b077fbe69b13'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:56.334378 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7c09d31f-1c40-462d-b9db-b077fbe69b13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7835fb125fe843b1b0bf34a6f3e1867b', 'request_id': 'req-7c09d31f-1c40-462d-b9db-b077fbe69b13'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:56.340518 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7c09d31f-1c40-462d-b9db-b077fbe69b13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7835fb125fe843b1b0bf34a6f3e1867b', 'request_id': 'req-7c09d31f-1c40-462d-b9db-b077fbe69b13'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:56.351194 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7c09d31f-1c40-462d-b9db-b077fbe69b13 admin admin] The token cache is being invalidate because project 7835fb125fe843b1b0bf34a6f3e1867b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:40:56.351480 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7c09d31f-1c40-462d-b9db-b077fbe69b13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:56.352113 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-7c09d31f-1c40-462d-b9db-b077fbe69b13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:40:56.353680 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1382/2763] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:40:56 2022] DELETE /identity/v3/projects/7835fb125fe843b1b0bf34a6f3e1867b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:56.360668 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454ecff-7150-43e5-88dd-3612754be69f None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:56.360961 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454ecff-7150-43e5-88dd-3612754be69f None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:56.361238 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454ecff-7150-43e5-88dd-3612754be69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:56.378883 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-2454ecff-7150-43e5-88dd-3612754be69f None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:56.380096 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2454ecff-7150-43e5-88dd-3612754be69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:56.436372 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1382/2764] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:56.444164 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b2266-9ea7-4a64-8850-d9c5ac188ce9 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:56.444639 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b2266-9ea7-4a64-8850-d9c5ac188ce9 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:56.444840 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b2266-9ea7-4a64-8850-d9c5ac188ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:56.462493 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-198b2266-9ea7-4a64-8850-d9c5ac188ce9 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:56.463681 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-198b2266-9ea7-4a64-8850-d9c5ac188ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:56.471946 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1383/2765] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:56.475923 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454ecff-7150-43e5-88dd-3612754be69f None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:56.485921 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454ecff-7150-43e5-88dd-3612754be69f None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:56.490456 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef145725-6e0b-43fb-92ba-c12d7353ecb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:56.491086 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef145725-6e0b-43fb-92ba-c12d7353ecb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:56.491367 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef145725-6e0b-43fb-92ba-c12d7353ecb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:56.491640 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef145725-6e0b-43fb-92ba-c12d7353ecb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:56.492387 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef145725-6e0b-43fb-92ba-c12d7353ecb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:40:56.492691 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef145725-6e0b-43fb-92ba-c12d7353ecb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:56.494416 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef145725-6e0b-43fb-92ba-c12d7353ecb2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:56.505325 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1383/2766] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:40:56.509273 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b2266-9ea7-4a64-8850-d9c5ac188ce9 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:56.518054 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b2266-9ea7-4a64-8850-d9c5ac188ce9 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:56.522620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734d755-9e66-47e1-8bc1-839b66b96d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:56.523247 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734d755-9e66-47e1-8bc1-839b66b96d06 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:56.523531 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734d755-9e66-47e1-8bc1-839b66b96d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:56.523806 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734d755-9e66-47e1-8bc1-839b66b96d06 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:56.524489 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734d755-9e66-47e1-8bc1-839b66b96d06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:56.526920 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734d755-9e66-47e1-8bc1-839b66b96d06 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:56.552964 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1384/2767] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:40:56 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:40:56.557170 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef145725-6e0b-43fb-92ba-c12d7353ecb2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:56.567287 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef145725-6e0b-43fb-92ba-c12d7353ecb2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:56.619720 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70987c-e413-4ecb-bd23-0559aa6a44c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:56.620367 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70987c-e413-4ecb-bd23-0559aa6a44c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:56.620643 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70987c-e413-4ecb-bd23-0559aa6a44c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:56.620910 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70987c-e413-4ecb-bd23-0559aa6a44c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:56.621611 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70987c-e413-4ecb-bd23-0559aa6a44c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:56.623517 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70987c-e413-4ecb-bd23-0559aa6a44c3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:56.643574 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1384/2768] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:40:56 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:40:56.647653 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734d755-9e66-47e1-8bc1-839b66b96d06 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:56.658323 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734d755-9e66-47e1-8bc1-839b66b96d06 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:56.662893 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774831f-4268-41da-9ed2-8c08799c4caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:56.663533 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774831f-4268-41da-9ed2-8c08799c4caf admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:56.664061 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774831f-4268-41da-9ed2-8c08799c4caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:56.664340 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774831f-4268-41da-9ed2-8c08799c4caf admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:56.665090 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774831f-4268-41da-9ed2-8c08799c4caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:56.666800 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774831f-4268-41da-9ed2-8c08799c4caf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:56.677078 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1385/2769] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:40:56.681132 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70987c-e413-4ecb-bd23-0559aa6a44c3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:56.691027 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70987c-e413-4ecb-bd23-0559aa6a44c3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:56.695579 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e10d2-2261-49ca-a4ad-9404e3b5c12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:56.696210 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e10d2-2261-49ca-a4ad-9404e3b5c12b admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:56.696486 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e10d2-2261-49ca-a4ad-9404e3b5c12b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:56.696759 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e10d2-2261-49ca-a4ad-9404e3b5c12b admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:56.697509 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e10d2-2261-49ca-a4ad-9404e3b5c12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:56.699768 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e10d2-2261-49ca-a4ad-9404e3b5c12b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:56.709160 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1385/2770] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:40:56.713064 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774831f-4268-41da-9ed2-8c08799c4caf admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:56.723829 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774831f-4268-41da-9ed2-8c08799c4caf admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:56.728670 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69882d5-b859-4388-a7c9-5abf82bb6f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:56.729616 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69882d5-b859-4388-a7c9-5abf82bb6f26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:56.729896 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69882d5-b859-4388-a7c9-5abf82bb6f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:56.730165 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69882d5-b859-4388-a7c9-5abf82bb6f26 admin admin] PATH_INFO: `/v3/projects/87236d70fca44dc8b162046ad6197d08/users/de438e57d7544a21a22c8b2d6015dfed/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:56.744165 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69882d5-b859-4388-a7c9-5abf82bb6f26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87236d70fca44dc8b162046ad6197d08, user_id=de438e57d7544a21a22c8b2d6015dfed, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:56.746902 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69882d5-b859-4388-a7c9-5abf82bb6f26 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:56.758860 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1386/2771] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:40:56 2022] PUT /identity/v3/projects/87236d70fca44dc8b162046ad6197d08/users/de438e57d7544a21a22c8b2d6015dfed/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:56.770486 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25e88e-c7ce-4c1b-b0f6-8d30d266c5f3 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:56.770770 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25e88e-c7ce-4c1b-b0f6-8d30d266c5f3 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:56.771042 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25e88e-c7ce-4c1b-b0f6-8d30d266c5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:56.797740 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-da25e88e-c7ce-4c1b-b0f6-8d30d266c5f3 None None] MFA Rules not processed for user `de438e57d7544a21a22c8b2d6015dfed`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:56.798935 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-da25e88e-c7ce-4c1b-b0f6-8d30d266c5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:56.858503 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1386/2772] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:56.863085 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69882d5-b859-4388-a7c9-5abf82bb6f26 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:56.922135 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69882d5-b859-4388-a7c9-5abf82bb6f26 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:56.926748 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d7b1e-9024-49e2-9347-3269bb43dfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:56.927385 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d7b1e-9024-49e2-9347-3269bb43dfa8 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:56.927667 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d7b1e-9024-49e2-9347-3269bb43dfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:56.927939 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d7b1e-9024-49e2-9347-3269bb43dfa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:56.928620 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d7b1e-9024-49e2-9347-3269bb43dfa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:56.930543 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d7b1e-9024-49e2-9347-3269bb43dfa8 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:56.954392 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1387/2773] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:40:56 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:40:56.958392 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25e88e-c7ce-4c1b-b0f6-8d30d266c5f3 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:56.969372 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25e88e-c7ce-4c1b-b0f6-8d30d266c5f3 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:57.023532 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dcb3a-87cf-4ddf-8cb6-13b0ec48067c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:57.024110 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dcb3a-87cf-4ddf-8cb6-13b0ec48067c admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:57.024391 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dcb3a-87cf-4ddf-8cb6-13b0ec48067c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:57.024666 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dcb3a-87cf-4ddf-8cb6-13b0ec48067c admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:57.025387 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dcb3a-87cf-4ddf-8cb6-13b0ec48067c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:57.027351 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665dcb3a-87cf-4ddf-8cb6-13b0ec48067c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:57.046303 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1387/2774] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:40:56 2022] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:40:57.050242 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d7b1e-9024-49e2-9347-3269bb43dfa8 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:57.060574 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d7b1e-9024-49e2-9347-3269bb43dfa8 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:57.065451 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6da66-965d-44ac-942a-ab880a3740bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:57.066233 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6da66-965d-44ac-942a-ab880a3740bd admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:57.066510 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6da66-965d-44ac-942a-ab880a3740bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:57.066806 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6da66-965d-44ac-942a-ab880a3740bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:57.067521 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6da66-965d-44ac-942a-ab880a3740bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:57.069099 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6da66-965d-44ac-942a-ab880a3740bd admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:57.079699 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1388/2775] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:40:57.083540 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dcb3a-87cf-4ddf-8cb6-13b0ec48067c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:57.093289 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dcb3a-87cf-4ddf-8cb6-13b0ec48067c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:57.097894 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ca10b-84fc-4388-9949-42f74535fbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:57.098748 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ca10b-84fc-4388-9949-42f74535fbe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:57.099028 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ca10b-84fc-4388-9949-42f74535fbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:57.099301 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ca10b-84fc-4388-9949-42f74535fbe2 admin admin] PATH_INFO: `/v3/projects/ec1aa2d6663044b9875d0ace7ba34327/users/7e78e54fed5b4efbbb528632734ae3b9/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:57.113334 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ca10b-84fc-4388-9949-42f74535fbe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec1aa2d6663044b9875d0ace7ba34327, user_id=7e78e54fed5b4efbbb528632734ae3b9, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:57.115995 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ca10b-84fc-4388-9949-42f74535fbe2 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:57.128919 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1388/2776] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:40:57 2022] PUT /identity/v3/projects/ec1aa2d6663044b9875d0ace7ba34327/users/7e78e54fed5b4efbbb528632734ae3b9/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:40:57.132705 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6da66-965d-44ac-942a-ab880a3740bd admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:57.143093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6da66-965d-44ac-942a-ab880a3740bd admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:57.196441 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f09830-16b1-4d85-a934-baeff3ec8160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:57.197092 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f09830-16b1-4d85-a934-baeff3ec8160 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:57.197406 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f09830-16b1-4d85-a934-baeff3ec8160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:57.197705 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f09830-16b1-4d85-a934-baeff3ec8160 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:57.199052 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f09830-16b1-4d85-a934-baeff3ec8160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:57.200644 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f09830-16b1-4d85-a934-baeff3ec8160 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:57.210126 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1389/2777] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:40:57.214139 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ca10b-84fc-4388-9949-42f74535fbe2 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:57.224228 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ca10b-84fc-4388-9949-42f74535fbe2 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:57.228801 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbf73a-0667-4f1f-afac-a24674809070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:57.229719 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbf73a-0667-4f1f-afac-a24674809070 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:57.229997 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbf73a-0667-4f1f-afac-a24674809070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:57.230269 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbf73a-0667-4f1f-afac-a24674809070 admin admin] PATH_INFO: `/v3/projects/ec1aa2d6663044b9875d0ace7ba34327/users/7e78e54fed5b4efbbb528632734ae3b9/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:57.232237 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbf73a-0667-4f1f-afac-a24674809070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec1aa2d6663044b9875d0ace7ba34327, user_id=7e78e54fed5b4efbbb528632734ae3b9, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:57.234958 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbf73a-0667-4f1f-afac-a24674809070 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:57.244909 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1389/2778] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:40:57 2022] PUT /identity/v3/projects/ec1aa2d6663044b9875d0ace7ba34327/users/7e78e54fed5b4efbbb528632734ae3b9/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:40:57.255560 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed67742-388e-459b-96ad-a67c08e770f2 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:57.255845 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed67742-388e-459b-96ad-a67c08e770f2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:57.256120 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed67742-388e-459b-96ad-a67c08e770f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:57.287255 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-bed67742-388e-459b-96ad-a67c08e770f2 None None] MFA Rules not processed for user `7e78e54fed5b4efbbb528632734ae3b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:40:57.288497 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-bed67742-388e-459b-96ad-a67c08e770f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:57.353187 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1390/2779] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:40:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:40:57.363118 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbf73a-0667-4f1f-afac-a24674809070 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:40:57.364836 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-abbbf73a-0667-4f1f-afac-a24674809070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:40:57.419247 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbf73a-0667-4f1f-afac-a24674809070 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:40:57.422928 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6ab70-48f8-4f69-8b44-9b97bf53c860 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:40:57.423555 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6ab70-48f8-4f69-8b44-9b97bf53c860 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:40:57.423835 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6ab70-48f8-4f69-8b44-9b97bf53c860 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:40:57.424110 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6ab70-48f8-4f69-8b44-9b97bf53c860 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:40:57.476128 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6ab70-48f8-4f69-8b44-9b97bf53c860 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:40:57.477609 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6ab70-48f8-4f69-8b44-9b97bf53c860 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:40:57.486745 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1390/2780] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:40:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:40:59.971542 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed67742-388e-459b-96ad-a67c08e770f2 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:00.032557 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed67742-388e-459b-96ad-a67c08e770f2 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:00.037097 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429eb4b-1607-4d1e-ad06-17a895f9aba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:00.037982 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429eb4b-1607-4d1e-ad06-17a895f9aba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:00.038262 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429eb4b-1607-4d1e-ad06-17a895f9aba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:00.038533 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429eb4b-1607-4d1e-ad06-17a895f9aba0 admin admin] PATH_INFO: `/v3/users/de438e57d7544a21a22c8b2d6015dfed` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:00.040019 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429eb4b-1607-4d1e-ad06-17a895f9aba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de438e57d7544a21a22c8b2d6015dfed)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:00.041986 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4429eb4b-1607-4d1e-ad06-17a895f9aba0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:00.087094 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4429eb4b-1607-4d1e-ad06-17a895f9aba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de438e57d7544a21a22c8b2d6015dfed'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:00.093670 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4429eb4b-1607-4d1e-ad06-17a895f9aba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de438e57d7544a21a22c8b2d6015dfed'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:00.104707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4429eb4b-1607-4d1e-ad06-17a895f9aba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de438e57d7544a21a22c8b2d6015dfed'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:00.105396 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4429eb4b-1607-4d1e-ad06-17a895f9aba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de438e57d7544a21a22c8b2d6015dfed'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:00.105989 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-4429eb4b-1607-4d1e-ad06-17a895f9aba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de438e57d7544a21a22c8b2d6015dfed'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:00.118568 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1391/2781] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:40:59 2022] DELETE /identity/v3/users/de438e57d7544a21a22c8b2d6015dfed => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:41:00.123725 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103f5f6-cb4e-4537-a378-ebb97daaa1a7 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:00.124221 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103f5f6-cb4e-4537-a378-ebb97daaa1a7 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:00.124326 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103f5f6-cb4e-4537-a378-ebb97daaa1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:00.141491 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c103f5f6-cb4e-4537-a378-ebb97daaa1a7 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:41:00.142688 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c103f5f6-cb4e-4537-a378-ebb97daaa1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:00.199493 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1391/2782] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:41:00.209142 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429eb4b-1607-4d1e-ad06-17a895f9aba0 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:00.210541 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4429eb4b-1607-4d1e-ad06-17a895f9aba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:00.265290 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429eb4b-1607-4d1e-ad06-17a895f9aba0 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:00.268952 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468dca5-e1e6-433d-823f-22cc18e293a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:00.269640 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468dca5-e1e6-433d-823f-22cc18e293a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:00.269913 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468dca5-e1e6-433d-823f-22cc18e293a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:00.270180 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468dca5-e1e6-433d-823f-22cc18e293a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:00.278841 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468dca5-e1e6-433d-823f-22cc18e293a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:00.280239 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468dca5-e1e6-433d-823f-22cc18e293a2 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:00.289593 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1392/2783] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:41:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:41:00.545274 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103f5f6-cb4e-4537-a378-ebb97daaa1a7 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:00.546737 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c103f5f6-cb4e-4537-a378-ebb97daaa1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:00.559305 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103f5f6-cb4e-4537-a378-ebb97daaa1a7 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:00.564766 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8bcdd-5b1c-4dd8-85cd-7dfa78a15711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:00.565651 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8bcdd-5b1c-4dd8-85cd-7dfa78a15711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:00.565931 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8bcdd-5b1c-4dd8-85cd-7dfa78a15711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:00.566201 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8bcdd-5b1c-4dd8-85cd-7dfa78a15711 admin admin] PATH_INFO: `/v3/projects/87236d70fca44dc8b162046ad6197d08` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:00.567899 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8bcdd-5b1c-4dd8-85cd-7dfa78a15711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87236d70fca44dc8b162046ad6197d08)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:00.569827 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8bcdd-5b1c-4dd8-85cd-7dfa78a15711 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:00.615150 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5ea8bcdd-5b1c-4dd8-85cd-7dfa78a15711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87236d70fca44dc8b162046ad6197d08', 'request_id': 'req-5ea8bcdd-5b1c-4dd8-85cd-7dfa78a15711'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:00.622257 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5ea8bcdd-5b1c-4dd8-85cd-7dfa78a15711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87236d70fca44dc8b162046ad6197d08', 'request_id': 'req-5ea8bcdd-5b1c-4dd8-85cd-7dfa78a15711'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:00.627569 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5ea8bcdd-5b1c-4dd8-85cd-7dfa78a15711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87236d70fca44dc8b162046ad6197d08', 'request_id': 'req-5ea8bcdd-5b1c-4dd8-85cd-7dfa78a15711'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:00.638853 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5ea8bcdd-5b1c-4dd8-85cd-7dfa78a15711 admin admin] The token cache is being invalidate because project 87236d70fca44dc8b162046ad6197d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:41:00.639137 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5ea8bcdd-5b1c-4dd8-85cd-7dfa78a15711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:00.639757 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-5ea8bcdd-5b1c-4dd8-85cd-7dfa78a15711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:00.641316 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1392/2784] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:41:00 2022] DELETE /identity/v3/projects/87236d70fca44dc8b162046ad6197d08 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:41:00.645312 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468dca5-e1e6-433d-823f-22cc18e293a2 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:00.655166 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468dca5-e1e6-433d-823f-22cc18e293a2 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:00.708176 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0b853-1a33-4c30-8c7c-0b43f4788525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:00.709020 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0b853-1a33-4c30-8c7c-0b43f4788525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:00.709318 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0b853-1a33-4c30-8c7c-0b43f4788525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:00.709588 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0b853-1a33-4c30-8c7c-0b43f4788525 admin admin] PATH_INFO: `/v3/users/7e78e54fed5b4efbbb528632734ae3b9` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:00.710742 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0b853-1a33-4c30-8c7c-0b43f4788525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e78e54fed5b4efbbb528632734ae3b9)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:00.712693 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0b853-1a33-4c30-8c7c-0b43f4788525 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:00.756071 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f8b0b853-1a33-4c30-8c7c-0b43f4788525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e78e54fed5b4efbbb528632734ae3b9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:00.763089 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f8b0b853-1a33-4c30-8c7c-0b43f4788525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e78e54fed5b4efbbb528632734ae3b9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:00.774082 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f8b0b853-1a33-4c30-8c7c-0b43f4788525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e78e54fed5b4efbbb528632734ae3b9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:00.774733 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f8b0b853-1a33-4c30-8c7c-0b43f4788525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e78e54fed5b4efbbb528632734ae3b9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:00.775322 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-f8b0b853-1a33-4c30-8c7c-0b43f4788525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e78e54fed5b4efbbb528632734ae3b9'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:00.787189 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1393/2785] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:41:00 2022] DELETE /identity/v3/users/7e78e54fed5b4efbbb528632734ae3b9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:41:01.045284 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8bcdd-5b1c-4dd8-85cd-7dfa78a15711 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:01.046849 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-5ea8bcdd-5b1c-4dd8-85cd-7dfa78a15711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:01.060594 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8bcdd-5b1c-4dd8-85cd-7dfa78a15711 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:01.114936 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc529ad4-86a9-4743-b326-0db71b4137d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:01.115785 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc529ad4-86a9-4743-b326-0db71b4137d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:01.116065 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc529ad4-86a9-4743-b326-0db71b4137d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:01.116340 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc529ad4-86a9-4743-b326-0db71b4137d0 admin admin] PATH_INFO: `/v3/projects/ec1aa2d6663044b9875d0ace7ba34327` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:01.117554 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc529ad4-86a9-4743-b326-0db71b4137d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec1aa2d6663044b9875d0ace7ba34327)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:01.119471 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc529ad4-86a9-4743-b326-0db71b4137d0 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:01.163302 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-cc529ad4-86a9-4743-b326-0db71b4137d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec1aa2d6663044b9875d0ace7ba34327', 'request_id': 'req-cc529ad4-86a9-4743-b326-0db71b4137d0'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:01.170490 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-cc529ad4-86a9-4743-b326-0db71b4137d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec1aa2d6663044b9875d0ace7ba34327', 'request_id': 'req-cc529ad4-86a9-4743-b326-0db71b4137d0'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:01.176008 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-cc529ad4-86a9-4743-b326-0db71b4137d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec1aa2d6663044b9875d0ace7ba34327', 'request_id': 'req-cc529ad4-86a9-4743-b326-0db71b4137d0'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:01.186975 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-cc529ad4-86a9-4743-b326-0db71b4137d0 admin admin] The token cache is being invalidate because project ec1aa2d6663044b9875d0ace7ba34327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:41:01.187258 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-cc529ad4-86a9-4743-b326-0db71b4137d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:01.187907 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-cc529ad4-86a9-4743-b326-0db71b4137d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:01.189433 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1393/2786] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:41:01 2022] DELETE /identity/v3/projects/ec1aa2d6663044b9875d0ace7ba34327 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:41:01.194373 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449252df-c216-4c4f-9b0f-732422da722f None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:01.194838 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449252df-c216-4c4f-9b0f-732422da722f None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:01.194948 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449252df-c216-4c4f-9b0f-732422da722f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:01.211999 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-449252df-c216-4c4f-9b0f-732422da722f None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:41:01.213333 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-449252df-c216-4c4f-9b0f-732422da722f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:01.269461 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1394/2787] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:41:01.277184 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d189dd-13a7-41e2-b96c-8e97136598fd None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:01.277504 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d189dd-13a7-41e2-b96c-8e97136598fd None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:01.277781 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d189dd-13a7-41e2-b96c-8e97136598fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:01.296355 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-f9d189dd-13a7-41e2-b96c-8e97136598fd None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:41:01.297505 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f9d189dd-13a7-41e2-b96c-8e97136598fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:01.305116 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1394/2788] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:41:01.309782 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449252df-c216-4c4f-9b0f-732422da722f None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:01.319290 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449252df-c216-4c4f-9b0f-732422da722f None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:01.324454 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcc985-4638-4fe3-9e0f-ae293bcb0745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:01.325094 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcc985-4638-4fe3-9e0f-ae293bcb0745 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:01.325427 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcc985-4638-4fe3-9e0f-ae293bcb0745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:01.325699 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddcc985-4638-4fe3-9e0f-ae293bcb0745 admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:01.326416 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcc985-4638-4fe3-9e0f-ae293bcb0745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:41:01.326720 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcc985-4638-4fe3-9e0f-ae293bcb0745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:01.328306 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddcc985-4638-4fe3-9e0f-ae293bcb0745 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:01.340125 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1395/2789] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:41:01.344354 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d189dd-13a7-41e2-b96c-8e97136598fd None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:01.353147 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d189dd-13a7-41e2-b96c-8e97136598fd None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:01.357804 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259adc4-c35e-4d9a-9595-6db244f3c41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:01.358424 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259adc4-c35e-4d9a-9595-6db244f3c41c admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:01.358698 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259adc4-c35e-4d9a-9595-6db244f3c41c admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:01.358965 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259adc4-c35e-4d9a-9595-6db244f3c41c admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:01.359641 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259adc4-c35e-4d9a-9595-6db244f3c41c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:01.361543 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259adc4-c35e-4d9a-9595-6db244f3c41c admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:01.384849 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1395/2790] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:41:01 2022] POST /identity/v3/projects => generated 373 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:41:01.390892 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcc985-4638-4fe3-9e0f-ae293bcb0745 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:01.400930 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddcc985-4638-4fe3-9e0f-ae293bcb0745 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:01.454294 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2cfb3-7783-4ba0-847a-a43829c93330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:01.454941 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2cfb3-7783-4ba0-847a-a43829c93330 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:01.455218 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2cfb3-7783-4ba0-847a-a43829c93330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:01.455487 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2cfb3-7783-4ba0-847a-a43829c93330 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:01.456169 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2cfb3-7783-4ba0-847a-a43829c93330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:01.458104 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2cfb3-7783-4ba0-847a-a43829c93330 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:01.477347 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1396/2791] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:41:01 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:41:01.481600 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259adc4-c35e-4d9a-9595-6db244f3c41c admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:01.491584 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259adc4-c35e-4d9a-9595-6db244f3c41c admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:01.496655 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7193d-70ff-4524-8628-2c8b26655155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:01.497303 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7193d-70ff-4524-8628-2c8b26655155 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:01.497590 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7193d-70ff-4524-8628-2c8b26655155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:01.497866 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7193d-70ff-4524-8628-2c8b26655155 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:01.498623 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7193d-70ff-4524-8628-2c8b26655155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:01.500236 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7193d-70ff-4524-8628-2c8b26655155 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:01.510217 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1396/2792] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:41:01.514483 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2cfb3-7783-4ba0-847a-a43829c93330 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:01.524042 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2cfb3-7783-4ba0-847a-a43829c93330 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:01.528568 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74f9da-8aa0-4d1a-966f-f855533cd456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:01.529208 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74f9da-8aa0-4d1a-966f-f855533cd456 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:01.529524 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74f9da-8aa0-4d1a-966f-f855533cd456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:01.529796 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74f9da-8aa0-4d1a-966f-f855533cd456 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:01.530509 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74f9da-8aa0-4d1a-966f-f855533cd456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:01.532086 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74f9da-8aa0-4d1a-966f-f855533cd456 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:01.542101 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1397/2793] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:41:01.546007 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7193d-70ff-4524-8628-2c8b26655155 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:01.555716 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7193d-70ff-4524-8628-2c8b26655155 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:01.560971 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3371b65-c702-44e6-a310-952897cab9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:01.561860 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3371b65-c702-44e6-a310-952897cab9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:01.562141 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3371b65-c702-44e6-a310-952897cab9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:01.562411 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3371b65-c702-44e6-a310-952897cab9d4 admin admin] PATH_INFO: `/v3/projects/2812209babb242839e2ba754217f6e77/users/7e6c05fdfd8e4204a698f5273b818aac/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:01.576816 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3371b65-c702-44e6-a310-952897cab9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2812209babb242839e2ba754217f6e77, user_id=7e6c05fdfd8e4204a698f5273b818aac, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:01.579511 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3371b65-c702-44e6-a310-952897cab9d4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:01.591767 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1397/2794] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:41:01 2022] PUT /identity/v3/projects/2812209babb242839e2ba754217f6e77/users/7e6c05fdfd8e4204a698f5273b818aac/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:41:01.601736 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5211a0-e345-44ec-8e21-d18ddc2effd0 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:01.602023 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5211a0-e345-44ec-8e21-d18ddc2effd0 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:01.602298 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5211a0-e345-44ec-8e21-d18ddc2effd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:01.628085 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-cf5211a0-e345-44ec-8e21-d18ddc2effd0 None None] MFA Rules not processed for user `7e6c05fdfd8e4204a698f5273b818aac`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:41:01.629309 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cf5211a0-e345-44ec-8e21-d18ddc2effd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:01.691161 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1398/2795] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:41:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:41:01.700393 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3371b65-c702-44e6-a310-952897cab9d4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:01.702124 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e3371b65-c702-44e6-a310-952897cab9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:01.757497 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3371b65-c702-44e6-a310-952897cab9d4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:01.761207 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4aa727-1e34-4558-8feb-7eb73678ebbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:01.761866 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4aa727-1e34-4558-8feb-7eb73678ebbd service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:01.762148 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4aa727-1e34-4558-8feb-7eb73678ebbd service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:01.762423 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4aa727-1e34-4558-8feb-7eb73678ebbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:01.770430 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4aa727-1e34-4558-8feb-7eb73678ebbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:01.771867 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4aa727-1e34-4558-8feb-7eb73678ebbd service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:01.780922 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1398/2796] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:41:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:41:11.233217 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5211a0-e345-44ec-8e21-d18ddc2effd0 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:11.294274 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5211a0-e345-44ec-8e21-d18ddc2effd0 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:11.298824 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b41de-d827-48ff-9e94-8859d9ea1114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:11.299675 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b41de-d827-48ff-9e94-8859d9ea1114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:11.299957 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b41de-d827-48ff-9e94-8859d9ea1114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:11.300233 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b41de-d827-48ff-9e94-8859d9ea1114 admin admin] PATH_INFO: `/v3/users/7e6c05fdfd8e4204a698f5273b818aac` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:11.301441 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b41de-d827-48ff-9e94-8859d9ea1114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e6c05fdfd8e4204a698f5273b818aac)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:11.303354 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b41de-d827-48ff-9e94-8859d9ea1114 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:11.348186 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-603b41de-d827-48ff-9e94-8859d9ea1114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e6c05fdfd8e4204a698f5273b818aac'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:11.355777 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-603b41de-d827-48ff-9e94-8859d9ea1114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e6c05fdfd8e4204a698f5273b818aac'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:11.369498 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-603b41de-d827-48ff-9e94-8859d9ea1114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e6c05fdfd8e4204a698f5273b818aac'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:11.372560 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-603b41de-d827-48ff-9e94-8859d9ea1114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e6c05fdfd8e4204a698f5273b818aac'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:11.373473 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-603b41de-d827-48ff-9e94-8859d9ea1114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e6c05fdfd8e4204a698f5273b818aac'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:11.390916 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1399/2797] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:41:11 2022] DELETE /identity/v3/users/7e6c05fdfd8e4204a698f5273b818aac => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:41:11.395584 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57843e08-64dd-4fde-ab4a-6430069e8e8a None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:11.396416 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57843e08-64dd-4fde-ab4a-6430069e8e8a None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:11.396700 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57843e08-64dd-4fde-ab4a-6430069e8e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:11.415090 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-57843e08-64dd-4fde-ab4a-6430069e8e8a None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:41:11.416280 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-57843e08-64dd-4fde-ab4a-6430069e8e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:11.473752 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1399/2798] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:41:11.483343 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b41de-d827-48ff-9e94-8859d9ea1114 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:11.484832 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-603b41de-d827-48ff-9e94-8859d9ea1114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:11.542233 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b41de-d827-48ff-9e94-8859d9ea1114 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:11.545907 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df33a58-9ca6-4e00-90c4-a69ceb3f0bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:11.546545 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df33a58-9ca6-4e00-90c4-a69ceb3f0bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:11.546824 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df33a58-9ca6-4e00-90c4-a69ceb3f0bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:11.547093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df33a58-9ca6-4e00-90c4-a69ceb3f0bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:11.556006 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df33a58-9ca6-4e00-90c4-a69ceb3f0bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:11.557457 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df33a58-9ca6-4e00-90c4-a69ceb3f0bd2 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:11.567296 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1400/2799] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:41:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:41:11.841464 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57843e08-64dd-4fde-ab4a-6430069e8e8a None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:11.842873 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-57843e08-64dd-4fde-ab4a-6430069e8e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:11.859288 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57843e08-64dd-4fde-ab4a-6430069e8e8a None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:11.869317 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfa15d-a199-4735-87ec-bd1f04a29e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:11.870040 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfa15d-a199-4735-87ec-bd1f04a29e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:11.870344 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfa15d-a199-4735-87ec-bd1f04a29e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:11.870582 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfa15d-a199-4735-87ec-bd1f04a29e57 admin admin] PATH_INFO: `/v3/projects/2812209babb242839e2ba754217f6e77` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:11.871766 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfa15d-a199-4735-87ec-bd1f04a29e57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2812209babb242839e2ba754217f6e77)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:11.873727 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfa15d-a199-4735-87ec-bd1f04a29e57 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:11.924923 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e4cfa15d-a199-4735-87ec-bd1f04a29e57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2812209babb242839e2ba754217f6e77', 'request_id': 'req-e4cfa15d-a199-4735-87ec-bd1f04a29e57'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:11.932544 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e4cfa15d-a199-4735-87ec-bd1f04a29e57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2812209babb242839e2ba754217f6e77', 'request_id': 'req-e4cfa15d-a199-4735-87ec-bd1f04a29e57'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:11.938131 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e4cfa15d-a199-4735-87ec-bd1f04a29e57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2812209babb242839e2ba754217f6e77', 'request_id': 'req-e4cfa15d-a199-4735-87ec-bd1f04a29e57'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:11.949743 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e4cfa15d-a199-4735-87ec-bd1f04a29e57 admin admin] The token cache is being invalidate because project 2812209babb242839e2ba754217f6e77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:41:11.950029 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e4cfa15d-a199-4735-87ec-bd1f04a29e57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:11.950698 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-e4cfa15d-a199-4735-87ec-bd1f04a29e57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:11.952228 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1400/2800] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:41:11 2022] DELETE /identity/v3/projects/2812209babb242839e2ba754217f6e77 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:41:11.957297 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb13d60-0690-46f4-89c1-ef3baad96e66 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:11.957583 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb13d60-0690-46f4-89c1-ef3baad96e66 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:11.957853 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb13d60-0690-46f4-89c1-ef3baad96e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:11.976009 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-7eb13d60-0690-46f4-89c1-ef3baad96e66 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:41:11.977145 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-7eb13d60-0690-46f4-89c1-ef3baad96e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:12.037564 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1401/2801] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:41:12.046042 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca0379-06f8-40bf-9f93-e55033a87fb9 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:12.046333 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca0379-06f8-40bf-9f93-e55033a87fb9 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:12.046610 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca0379-06f8-40bf-9f93-e55033a87fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:12.065773 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-abca0379-06f8-40bf-9f93-e55033a87fb9 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:41:12.066980 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-abca0379-06f8-40bf-9f93-e55033a87fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:12.076228 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1401/2802] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:41:12.080658 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb13d60-0690-46f4-89c1-ef3baad96e66 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:12.090159 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb13d60-0690-46f4-89c1-ef3baad96e66 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:12.095663 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f852d98-c207-4a5e-9450-4d2dcb753f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:12.096313 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f852d98-c207-4a5e-9450-4d2dcb753f4c admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:12.096596 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f852d98-c207-4a5e-9450-4d2dcb753f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:12.096875 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f852d98-c207-4a5e-9450-4d2dcb753f4c admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:12.097632 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f852d98-c207-4a5e-9450-4d2dcb753f4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:41:12.098045 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f852d98-c207-4a5e-9450-4d2dcb753f4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:12.099530 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f852d98-c207-4a5e-9450-4d2dcb753f4c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:12.110868 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1402/2803] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:41:12.115709 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca0379-06f8-40bf-9f93-e55033a87fb9 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:12.125451 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca0379-06f8-40bf-9f93-e55033a87fb9 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:12.130186 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4ee0e-43bb-43d0-8ea2-bf1258e10d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:12.130961 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4ee0e-43bb-43d0-8ea2-bf1258e10d95 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:12.131448 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4ee0e-43bb-43d0-8ea2-bf1258e10d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:12.131944 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4ee0e-43bb-43d0-8ea2-bf1258e10d95 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:12.133146 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4ee0e-43bb-43d0-8ea2-bf1258e10d95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:12.135608 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4ee0e-43bb-43d0-8ea2-bf1258e10d95 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:12.162060 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1402/2804] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:41:12 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:41:12.166586 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f852d98-c207-4a5e-9450-4d2dcb753f4c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:12.176385 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f852d98-c207-4a5e-9450-4d2dcb753f4c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:12.231187 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb1d10-e170-4d41-98c5-55aa3c570751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:12.231764 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb1d10-e170-4d41-98c5-55aa3c570751 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:12.232037 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb1d10-e170-4d41-98c5-55aa3c570751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:12.232304 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb1d10-e170-4d41-98c5-55aa3c570751 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:12.233011 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb1d10-e170-4d41-98c5-55aa3c570751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:12.234928 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb1d10-e170-4d41-98c5-55aa3c570751 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:12.253904 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1403/2805] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:41:12 2022] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 16 05:41:12.258031 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4ee0e-43bb-43d0-8ea2-bf1258e10d95 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:12.268628 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4ee0e-43bb-43d0-8ea2-bf1258e10d95 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:12.273189 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e13912-cd16-42b8-b4b2-819eb062e5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:12.273856 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e13912-cd16-42b8-b4b2-819eb062e5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:12.274132 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e13912-cd16-42b8-b4b2-819eb062e5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:12.274409 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e13912-cd16-42b8-b4b2-819eb062e5e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:12.275124 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e13912-cd16-42b8-b4b2-819eb062e5e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:12.276755 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e13912-cd16-42b8-b4b2-819eb062e5e4 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:12.286901 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1403/2806] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:41:12.290963 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb1d10-e170-4d41-98c5-55aa3c570751 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:12.300571 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb1d10-e170-4d41-98c5-55aa3c570751 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:12.305105 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da17d4b-c39b-41d2-b762-b3f1e148ceaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:12.305783 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da17d4b-c39b-41d2-b762-b3f1e148ceaf admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:12.306064 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da17d4b-c39b-41d2-b762-b3f1e148ceaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:12.306337 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da17d4b-c39b-41d2-b762-b3f1e148ceaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:12.307052 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da17d4b-c39b-41d2-b762-b3f1e148ceaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:12.309131 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da17d4b-c39b-41d2-b762-b3f1e148ceaf admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:12.318599 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1404/2807] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:41:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:41:12.322428 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e13912-cd16-42b8-b4b2-819eb062e5e4 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:12.332495 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e13912-cd16-42b8-b4b2-819eb062e5e4 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:12.337128 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4934a76-d39b-4daf-84f0-69a23c3989a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:12.338019 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4934a76-d39b-4daf-84f0-69a23c3989a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:12.338303 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4934a76-d39b-4daf-84f0-69a23c3989a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:12.338580 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4934a76-d39b-4daf-84f0-69a23c3989a9 admin admin] PATH_INFO: `/v3/projects/21d5f7ee775d41109f8b5ab2bc21a1d4/users/06f239454be64bee8f08d5742a89395c/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:12.352189 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4934a76-d39b-4daf-84f0-69a23c3989a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d5f7ee775d41109f8b5ab2bc21a1d4, user_id=06f239454be64bee8f08d5742a89395c, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:12.355746 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4934a76-d39b-4daf-84f0-69a23c3989a9 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:12.368726 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1404/2808] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:41:12 2022] PUT /identity/v3/projects/21d5f7ee775d41109f8b5ab2bc21a1d4/users/06f239454be64bee8f08d5742a89395c/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:41:12.380069 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3d084-174f-4cfb-9d69-5752772aa501 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:12.380352 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3d084-174f-4cfb-9d69-5752772aa501 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:12.380618 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3d084-174f-4cfb-9d69-5752772aa501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:12.406205 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-0ef3d084-174f-4cfb-9d69-5752772aa501 None None] MFA Rules not processed for user `06f239454be64bee8f08d5742a89395c`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:41:12.407398 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-0ef3d084-174f-4cfb-9d69-5752772aa501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:12.467977 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1405/2809] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:41:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:41:12.477288 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4934a76-d39b-4daf-84f0-69a23c3989a9 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:12.478943 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-d4934a76-d39b-4daf-84f0-69a23c3989a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:12.540006 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4934a76-d39b-4daf-84f0-69a23c3989a9 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:12.544128 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eeafaf-5021-46fd-9a95-6118d6870a07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:12.544754 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeafaf-5021-46fd-9a95-6118d6870a07 service cinder] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:12.545030 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeafaf-5021-46fd-9a95-6118d6870a07 service cinder] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:12.545340 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeafaf-5021-46fd-9a95-6118d6870a07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:12.553911 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eeafaf-5021-46fd-9a95-6118d6870a07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:12.555340 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eeafaf-5021-46fd-9a95-6118d6870a07 service cinder] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:12.565099 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1405/2810] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:41:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:41:17.069825 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6866900-9aa9-43bf-ab4d-e67bb9dea540 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:17.070364 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6866900-9aa9-43bf-ab4d-e67bb9dea540 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:17.070364 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6866900-9aa9-43bf-ab4d-e67bb9dea540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:17.087534 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-a6866900-9aa9-43bf-ab4d-e67bb9dea540 None None] MFA Rules not processed for user `87279464d1b74c0d88c95f4dec9871ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:41:17.088733 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-a6866900-9aa9-43bf-ab4d-e67bb9dea540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:17.150968 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1406/2811] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:41:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 16 05:41:20.093885 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eeafaf-5021-46fd-9a95-6118d6870a07 service cinder] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:20.095254 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-60eeafaf-5021-46fd-9a95-6118d6870a07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:20.161033 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eeafaf-5021-46fd-9a95-6118d6870a07 service cinder] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:20.166293 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ca32b-4b29-424a-97a0-5404ba0729cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc233f62146a49099216c6236fb2ee2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:20.166933 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ca32b-4b29-424a-97a0-5404ba0729cb service placement] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:20.167214 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ca32b-4b29-424a-97a0-5404ba0729cb service placement] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:20.167490 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ca32b-4b29-424a-97a0-5404ba0729cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:20.169797 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e45ca32b-4b29-424a-97a0-5404ba0729cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:20.180762 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ca32b-4b29-424a-97a0-5404ba0729cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:20.182318 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45ca32b-4b29-424a-97a0-5404ba0729cb service placement] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:20.192444 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1406/2812] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:41:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:41:28.608182 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6866900-9aa9-43bf-ab4d-e67bb9dea540 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:28.667202 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6866900-9aa9-43bf-ab4d-e67bb9dea540 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:28.671774 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f5d3c-b542-472c-a2eb-3505336958b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:28.672525 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f5d3c-b542-472c-a2eb-3505336958b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:28.672798 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f5d3c-b542-472c-a2eb-3505336958b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:28.673066 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f5d3c-b542-472c-a2eb-3505336958b2 admin admin] PATH_INFO: `/v3/users/06f239454be64bee8f08d5742a89395c` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:28.674286 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f5d3c-b542-472c-a2eb-3505336958b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06f239454be64bee8f08d5742a89395c)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:28.676194 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f5d3c-b542-472c-a2eb-3505336958b2 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:28.724243 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-fa4f5d3c-b542-472c-a2eb-3505336958b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06f239454be64bee8f08d5742a89395c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:28.731472 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-fa4f5d3c-b542-472c-a2eb-3505336958b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06f239454be64bee8f08d5742a89395c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:28.743397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-fa4f5d3c-b542-472c-a2eb-3505336958b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06f239454be64bee8f08d5742a89395c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:28.744093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-fa4f5d3c-b542-472c-a2eb-3505336958b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06f239454be64bee8f08d5742a89395c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:28.744696 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-fa4f5d3c-b542-472c-a2eb-3505336958b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06f239454be64bee8f08d5742a89395c'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:28.758592 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1407/2813] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:41:28 2022] DELETE /identity/v3/users/06f239454be64bee8f08d5742a89395c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:41:28.764076 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fa7f8-f383-4437-8561-7847a8ce597c None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:28.764589 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fa7f8-f383-4437-8561-7847a8ce597c None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:28.764720 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fa7f8-f383-4437-8561-7847a8ce597c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:28.786635 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-3d7fa7f8-f383-4437-8561-7847a8ce597c None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:41:28.786874 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3d7fa7f8-f383-4437-8561-7847a8ce597c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:28.844663 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1407/2814] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:41:28.854275 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f5d3c-b542-472c-a2eb-3505336958b2 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:28.856173 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-fa4f5d3c-b542-472c-a2eb-3505336958b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:28.910343 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f5d3c-b542-472c-a2eb-3505336958b2 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:28.914542 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3260d-46cc-46f5-af03-1035eef7dd44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:28.915169 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3260d-46cc-46f5-af03-1035eef7dd44 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:28.915450 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3260d-46cc-46f5-af03-1035eef7dd44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:28.915744 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3260d-46cc-46f5-af03-1035eef7dd44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:28.925056 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3260d-46cc-46f5-af03-1035eef7dd44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:28.926518 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3260d-46cc-46f5-af03-1035eef7dd44 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:28.936237 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1408/2815] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:41:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:41:29.438557 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fa7f8-f383-4437-8561-7847a8ce597c None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:29.440202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-3d7fa7f8-f383-4437-8561-7847a8ce597c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:29.453662 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fa7f8-f383-4437-8561-7847a8ce597c None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:29.458295 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e7afa-6eb3-43f7-aed9-090b46b2035b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:29.459140 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e7afa-6eb3-43f7-aed9-090b46b2035b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:29.459422 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e7afa-6eb3-43f7-aed9-090b46b2035b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:29.459697 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e7afa-6eb3-43f7-aed9-090b46b2035b admin admin] PATH_INFO: `/v3/projects/21d5f7ee775d41109f8b5ab2bc21a1d4` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:29.460869 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e7afa-6eb3-43f7-aed9-090b46b2035b admin admin] RBAC: Authorizing `identity:delete_project(project_id=21d5f7ee775d41109f8b5ab2bc21a1d4)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:29.462891 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e7afa-6eb3-43f7-aed9-090b46b2035b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:29.508339 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-477e7afa-6eb3-43f7-aed9-090b46b2035b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21d5f7ee775d41109f8b5ab2bc21a1d4', 'request_id': 'req-477e7afa-6eb3-43f7-aed9-090b46b2035b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:29.515800 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-477e7afa-6eb3-43f7-aed9-090b46b2035b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21d5f7ee775d41109f8b5ab2bc21a1d4', 'request_id': 'req-477e7afa-6eb3-43f7-aed9-090b46b2035b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:29.521032 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-477e7afa-6eb3-43f7-aed9-090b46b2035b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21d5f7ee775d41109f8b5ab2bc21a1d4', 'request_id': 'req-477e7afa-6eb3-43f7-aed9-090b46b2035b'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:29.531883 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-477e7afa-6eb3-43f7-aed9-090b46b2035b admin admin] The token cache is being invalidate because project 21d5f7ee775d41109f8b5ab2bc21a1d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:41:29.532162 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-477e7afa-6eb3-43f7-aed9-090b46b2035b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:29.532776 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-477e7afa-6eb3-43f7-aed9-090b46b2035b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:41:29.534302 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1408/2816] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:41:29 2022] DELETE /identity/v3/projects/21d5f7ee775d41109f8b5ab2bc21a1d4 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:41:29.539495 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96673d03-89a6-40b1-a42f-4ed45864e962 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:29.539775 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96673d03-89a6-40b1-a42f-4ed45864e962 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:29.540044 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96673d03-89a6-40b1-a42f-4ed45864e962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:29.557614 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-96673d03-89a6-40b1-a42f-4ed45864e962 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:41:29.558736 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-96673d03-89a6-40b1-a42f-4ed45864e962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:29.614086 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1409/2817] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:41:29.621724 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88c268-6f3a-4815-b332-416df1ea6cf5 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:29.622012 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88c268-6f3a-4815-b332-416df1ea6cf5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:29.622291 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88c268-6f3a-4815-b332-416df1ea6cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:29.640405 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-1c88c268-6f3a-4815-b332-416df1ea6cf5 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:41:29.641628 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-1c88c268-6f3a-4815-b332-416df1ea6cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:29.649399 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1409/2818] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:41:29.654019 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96673d03-89a6-40b1-a42f-4ed45864e962 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:29.663683 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96673d03-89a6-40b1-a42f-4ed45864e962 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:29.668357 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45411a62-64c2-4162-9846-4b782f81c64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:29.669005 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45411a62-64c2-4162-9846-4b782f81c64b admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:29.669316 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45411a62-64c2-4162-9846-4b782f81c64b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:29.669597 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45411a62-64c2-4162-9846-4b782f81c64b admin admin] PATH_INFO: `/v3/domains` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:29.670322 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45411a62-64c2-4162-9846-4b782f81c64b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79198) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:41:29.670628 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45411a62-64c2-4162-9846-4b782f81c64b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:29.672234 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45411a62-64c2-4162-9846-4b782f81c64b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:29.683614 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1410/2819] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:41:29.687869 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88c268-6f3a-4815-b332-416df1ea6cf5 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:29.696734 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88c268-6f3a-4815-b332-416df1ea6cf5 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:29.701900 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0287d-9409-4712-a096-b14a7d4a14d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:29.702527 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0287d-9409-4712-a096-b14a7d4a14d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:29.702805 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0287d-9409-4712-a096-b14a7d4a14d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:29.703078 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0287d-9409-4712-a096-b14a7d4a14d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:29.703754 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0287d-9409-4712-a096-b14a7d4a14d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:29.705692 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0287d-9409-4712-a096-b14a7d4a14d3 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:29.730472 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1410/2820] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:41:29 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:41:29.734772 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45411a62-64c2-4162-9846-4b782f81c64b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:29.744501 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45411a62-64c2-4162-9846-4b782f81c64b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:29.798160 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e7adf-5655-4c42-b260-425ea20a9282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:29.798817 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e7adf-5655-4c42-b260-425ea20a9282 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:29.799094 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e7adf-5655-4c42-b260-425ea20a9282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:29.799362 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e7adf-5655-4c42-b260-425ea20a9282 admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:29.800041 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e7adf-5655-4c42-b260-425ea20a9282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:29.802021 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e7adf-5655-4c42-b260-425ea20a9282 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:29.819928 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1411/2821] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:41:29 2022] POST /identity/v3/users => generated 291 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:41:29.824072 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0287d-9409-4712-a096-b14a7d4a14d3 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:29.834574 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0287d-9409-4712-a096-b14a7d4a14d3 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:29.839202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc054aa-70ea-4d97-8f22-23584652ae37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:29.839832 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc054aa-70ea-4d97-8f22-23584652ae37 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:29.840690 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc054aa-70ea-4d97-8f22-23584652ae37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:29.840966 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc054aa-70ea-4d97-8f22-23584652ae37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:29.841734 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc054aa-70ea-4d97-8f22-23584652ae37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:29.843340 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc054aa-70ea-4d97-8f22-23584652ae37 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:29.853202 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1411/2822] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:41:29.857076 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e7adf-5655-4c42-b260-425ea20a9282 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:29.866763 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e7adf-5655-4c42-b260-425ea20a9282 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:29.871353 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4a269-4351-4c58-9df2-4a3bacf32c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:29.871986 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4a269-4351-4c58-9df2-4a3bacf32c5f admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:29.872267 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4a269-4351-4c58-9df2-4a3bacf32c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:29.872538 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4a269-4351-4c58-9df2-4a3bacf32c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:29.873249 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4a269-4351-4c58-9df2-4a3bacf32c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:29.874858 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4a269-4351-4c58-9df2-4a3bacf32c5f admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:29.884264 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1412/2823] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:41:29.888648 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc054aa-70ea-4d97-8f22-23584652ae37 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:29.898195 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc054aa-70ea-4d97-8f22-23584652ae37 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:29.903744 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bb319-2db6-4802-9655-561ca9f52a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:29.904596 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bb319-2db6-4802-9655-561ca9f52a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:29.904905 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bb319-2db6-4802-9655-561ca9f52a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:29.905180 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bb319-2db6-4802-9655-561ca9f52a4b admin admin] PATH_INFO: `/v3/projects/ba122c4197da463faf4c622f2ba7087c/users/584d2cb873f74a1094a192f8de8f0451/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:29.919898 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bb319-2db6-4802-9655-561ca9f52a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba122c4197da463faf4c622f2ba7087c, user_id=584d2cb873f74a1094a192f8de8f0451, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:29.922707 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7bb319-2db6-4802-9655-561ca9f52a4b admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:29.935881 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1412/2824] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:41:29 2022] PUT /identity/v3/projects/ba122c4197da463faf4c622f2ba7087c/users/584d2cb873f74a1094a192f8de8f0451/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:41:29.940783 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9883b9b-4e30-4c73-a2f6-98038a0e9ae7 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:29.941067 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9883b9b-4e30-4c73-a2f6-98038a0e9ae7 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:29.941386 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9883b9b-4e30-4c73-a2f6-98038a0e9ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:29.959390 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-e9883b9b-4e30-4c73-a2f6-98038a0e9ae7 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:41:29.960590 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e9883b9b-4e30-4c73-a2f6-98038a0e9ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:30.018161 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1413/2825] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:41:30.027518 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bb319-2db6-4802-9655-561ca9f52a4b admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:30.029183 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-aa7bb319-2db6-4802-9655-561ca9f52a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:30.086094 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bb319-2db6-4802-9655-561ca9f52a4b admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:30.089643 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146dd6f-2199-4f89-8fc8-1379d1797bd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:30.090270 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146dd6f-2199-4f89-8fc8-1379d1797bd0 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:30.090552 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146dd6f-2199-4f89-8fc8-1379d1797bd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:30.090823 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146dd6f-2199-4f89-8fc8-1379d1797bd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:30.099427 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146dd6f-2199-4f89-8fc8-1379d1797bd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:30.100857 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146dd6f-2199-4f89-8fc8-1379d1797bd0 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:30.110111 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1413/2826] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:41:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:41:34.077418 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8de324-ef08-4538-9227-14e01f35e41e None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:34.077946 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8de324-ef08-4538-9227-14e01f35e41e None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:34.078109 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8de324-ef08-4538-9227-14e01f35e41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:34.120020 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-ae8de324-ef08-4538-9227-14e01f35e41e None None] MFA Rules not processed for user `584d2cb873f74a1094a192f8de8f0451`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:41:34.122213 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-ae8de324-ef08-4538-9227-14e01f35e41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:34.256255 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1414/2827] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:41:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:41:34.260769 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146dd6f-2199-4f89-8fc8-1379d1797bd0 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:34.274652 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146dd6f-2199-4f89-8fc8-1379d1797bd0 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:34.290739 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba02d1-83a3-482f-abbd-e50c576d7366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:34.290739 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba02d1-83a3-482f-abbd-e50c576d7366 admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:34.290739 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba02d1-83a3-482f-abbd-e50c576d7366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:34.290739 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba02d1-83a3-482f-abbd-e50c576d7366 admin admin] PATH_INFO: `/v3/projects` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:34.291366 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba02d1-83a3-482f-abbd-e50c576d7366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:34.293550 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba02d1-83a3-482f-abbd-e50c576d7366 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:34.339196 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1414/2828] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:41:34 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:41:34.343883 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8de324-ef08-4538-9227-14e01f35e41e None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:34.360626 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8de324-ef08-4538-9227-14e01f35e41e None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:34.455552 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9113dd-095d-4267-9430-0a735ec7d32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:34.456514 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9113dd-095d-4267-9430-0a735ec7d32b admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:34.457246 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9113dd-095d-4267-9430-0a735ec7d32b admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:34.461694 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9113dd-095d-4267-9430-0a735ec7d32b admin admin] PATH_INFO: `/v3/users` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:34.462439 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9113dd-095d-4267-9430-0a735ec7d32b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:34.464417 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9113dd-095d-4267-9430-0a735ec7d32b admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:34.492316 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1415/2829] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:41:34 2022] POST /identity/v3/users => generated 299 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:41:34.493516 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba02d1-83a3-482f-abbd-e50c576d7366 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:34.518505 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba02d1-83a3-482f-abbd-e50c576d7366 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:34.523491 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a6bf4-ccf1-4363-a98e-7647e74779b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:34.524460 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a6bf4-ccf1-4363-a98e-7647e74779b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:34.524846 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a6bf4-ccf1-4363-a98e-7647e74779b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:34.525834 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a6bf4-ccf1-4363-a98e-7647e74779b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:34.526689 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a6bf4-ccf1-4363-a98e-7647e74779b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:34.528430 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a6bf4-ccf1-4363-a98e-7647e74779b1 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:34.540453 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1415/2830] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:41:34.544770 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9113dd-095d-4267-9430-0a735ec7d32b admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:34.557321 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9113dd-095d-4267-9430-0a735ec7d32b admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:34.562775 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314426db-5508-4d03-b4da-445677c89e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:34.563660 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314426db-5508-4d03-b4da-445677c89e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:34.563937 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314426db-5508-4d03-b4da-445677c89e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:34.564209 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314426db-5508-4d03-b4da-445677c89e20 admin admin] PATH_INFO: `/v3/projects/e59fd9d8b19f4a2d825d19e5a6ed8a08/users/1de4df1c3d994b1a9e273b225f9cac2e/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:34.581252 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314426db-5508-4d03-b4da-445677c89e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59fd9d8b19f4a2d825d19e5a6ed8a08, user_id=1de4df1c3d994b1a9e273b225f9cac2e, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:34.583967 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314426db-5508-4d03-b4da-445677c89e20 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:34.596864 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1416/2831] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:41:34 2022] PUT /identity/v3/projects/e59fd9d8b19f4a2d825d19e5a6ed8a08/users/1de4df1c3d994b1a9e273b225f9cac2e/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:41:34.602475 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a6bf4-ccf1-4363-a98e-7647e74779b1 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:34.612837 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a6bf4-ccf1-4363-a98e-7647e74779b1 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:34.675036 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574d902-b2ca-4aa1-a644-d4a482e9a994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:34.675790 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574d902-b2ca-4aa1-a644-d4a482e9a994 admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:34.676282 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574d902-b2ca-4aa1-a644-d4a482e9a994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:34.676554 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574d902-b2ca-4aa1-a644-d4a482e9a994 admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:34.677316 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574d902-b2ca-4aa1-a644-d4a482e9a994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:34.678938 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574d902-b2ca-4aa1-a644-d4a482e9a994 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:34.690096 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1416/2832] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:41:34.694174 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314426db-5508-4d03-b4da-445677c89e20 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:34.705311 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314426db-5508-4d03-b4da-445677c89e20 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:34.710139 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd797a-4b7d-4034-aa29-ba805a207383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:34.711465 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd797a-4b7d-4034-aa29-ba805a207383 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:34.711465 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd797a-4b7d-4034-aa29-ba805a207383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:34.711661 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dd797a-4b7d-4034-aa29-ba805a207383 admin admin] PATH_INFO: `/v3/projects/e59fd9d8b19f4a2d825d19e5a6ed8a08/users/1de4df1c3d994b1a9e273b225f9cac2e/roles/9ba4a5967ed243178927661616f08901` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:34.722459 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd797a-4b7d-4034-aa29-ba805a207383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e59fd9d8b19f4a2d825d19e5a6ed8a08, user_id=1de4df1c3d994b1a9e273b225f9cac2e, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:34.731411 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dd797a-4b7d-4034-aa29-ba805a207383 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:34.758703 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1417/2833] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:41:34 2022] PUT /identity/v3/projects/e59fd9d8b19f4a2d825d19e5a6ed8a08/users/1de4df1c3d994b1a9e273b225f9cac2e/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:41:39.794961 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e82747-59c7-48ef-a8f2-d17f59028172 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:39.795857 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e82747-59c7-48ef-a8f2-d17f59028172 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:39.796296 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e82747-59c7-48ef-a8f2-d17f59028172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:39.840746 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-72e82747-59c7-48ef-a8f2-d17f59028172 None None] MFA Rules not processed for user `1de4df1c3d994b1a9e273b225f9cac2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:41:39.842256 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-72e82747-59c7-48ef-a8f2-d17f59028172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:39.919103 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1417/2834] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:41:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:41:39.930857 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd797a-4b7d-4034-aa29-ba805a207383 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:39.933103 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-76dd797a-4b7d-4034-aa29-ba805a207383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:39.997492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dd797a-4b7d-4034-aa29-ba805a207383 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:40.002152 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ea0cd-1658-448c-b40c-59781c4fd301 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba8e4a7763524f4190c5cd66e27b5910', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:40.002941 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ea0cd-1658-448c-b40c-59781c4fd301 service glance] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:40.003540 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ea0cd-1658-448c-b40c-59781c4fd301 service glance] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:40.003923 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ea0cd-1658-448c-b40c-59781c4fd301 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:40.094533 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ea0cd-1658-448c-b40c-59781c4fd301 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:40.095945 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ea0cd-1658-448c-b40c-59781c4fd301 service glance] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:40.105365 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1418/2835] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:41:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:41:40.218590 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691001dc-2234-49df-889e-8c7e04c4bea3 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:40.218909 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691001dc-2234-49df-889e-8c7e04c4bea3 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:40.219256 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691001dc-2234-49df-889e-8c7e04c4bea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:40.245240 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-691001dc-2234-49df-889e-8c7e04c4bea3 None None] MFA Rules not processed for user `4d22345d2e2646cc99c74a2f9692b648`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:41:40.246542 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-691001dc-2234-49df-889e-8c7e04c4bea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:40.310680 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1418/2836] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Feb 16 05:41:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:41:40.367043 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ea0cd-1658-448c-b40c-59781c4fd301 service glance] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:40.370431 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-d94ea0cd-1658-448c-b40c-59781c4fd301 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:40.448955 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ea0cd-1658-448c-b40c-59781c4fd301 service glance] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:40.455469 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e1f46-a66f-42db-9c14-ffd5a700703e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eb49cac0c94e73a70361831dd789b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:40.456478 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e1f46-a66f-42db-9c14-ffd5a700703e service swift] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:40.457084 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e1f46-a66f-42db-9c14-ffd5a700703e service swift] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:40.457609 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e1f46-a66f-42db-9c14-ffd5a700703e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:40.467604 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e1f46-a66f-42db-9c14-ffd5a700703e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:40.469591 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e1f46-a66f-42db-9c14-ffd5a700703e service swift] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:40.479719 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1419/2837] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Feb 16 05:41:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:41:50.537019 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566fb27-1c3a-41d5-bf34-6a7a01b3bd13 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:50.537581 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566fb27-1c3a-41d5-bf34-6a7a01b3bd13 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:50.537679 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566fb27-1c3a-41d5-bf34-6a7a01b3bd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:50.556285 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-2566fb27-1c3a-41d5-bf34-6a7a01b3bd13 None None] MFA Rules not processed for user `584d2cb873f74a1094a192f8de8f0451`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:41:50.557509 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2566fb27-1c3a-41d5-bf34-6a7a01b3bd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:50.564894 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1419/2838] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:41:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:41:52.338526 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c6b4f-82ab-4b0c-9683-8fd952c83fe2 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:52.339042 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c6b4f-82ab-4b0c-9683-8fd952c83fe2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:52.339157 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c6b4f-82ab-4b0c-9683-8fd952c83fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:52.357020 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-3b3c6b4f-82ab-4b0c-9683-8fd952c83fe2 None None] MFA Rules not processed for user `4d22345d2e2646cc99c74a2f9692b648`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:41:52.358271 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-3b3c6b4f-82ab-4b0c-9683-8fd952c83fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:41:52.365423 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1420/2839] 10.222.0.75 () {58 vars in 1009 bytes} [Wed Feb 16 05:41:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:41:52.378010 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566fb27-1c3a-41d5-bf34-6a7a01b3bd13 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:41:52.389422 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566fb27-1c3a-41d5-bf34-6a7a01b3bd13 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:41:52.394489 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8776b898-de82-40bc-b953-4cf4327011a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eb49cac0c94e73a70361831dd789b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:41:52.395130 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776b898-de82-40bc-b953-4cf4327011a0 service swift] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:41:52.395409 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776b898-de82-40bc-b953-4cf4327011a0 service swift] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:41:52.395681 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8776b898-de82-40bc-b953-4cf4327011a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:41:52.404003 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776b898-de82-40bc-b953-4cf4327011a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:41:52.405634 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8776b898-de82-40bc-b953-4cf4327011a0 service swift] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:41:52.413892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1420/2840] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Feb 16 05:41:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:42:21.104753 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c6b4f-82ab-4b0c-9683-8fd952c83fe2 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:42:21.155101 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c6b4f-82ab-4b0c-9683-8fd952c83fe2 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:42:21.159139 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe98ecb-ce15-417c-958a-91af951b4a1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:42:21.159757 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe98ecb-ce15-417c-958a-91af951b4a1b service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:42:21.160034 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe98ecb-ce15-417c-958a-91af951b4a1b service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:42:21.160304 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe98ecb-ce15-417c-958a-91af951b4a1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:42:21.169250 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe98ecb-ce15-417c-958a-91af951b4a1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:42:21.170696 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe98ecb-ce15-417c-958a-91af951b4a1b service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:42:21.180402 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1421/2841] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:42:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:43:28.402875 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa7662-723e-4503-92e9-771a5cfe4815 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:28.403416 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa7662-723e-4503-92e9-771a5cfe4815 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:28.403416 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa7662-723e-4503-92e9-771a5cfe4815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:28.421857 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-bbfa7662-723e-4503-92e9-771a5cfe4815 None None] MFA Rules not processed for user `87279464d1b74c0d88c95f4dec9871ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:43:28.423040 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-bbfa7662-723e-4503-92e9-771a5cfe4815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:43:28.475812 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1421/2842] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:43:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:43:28.508227 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe98ecb-ce15-417c-958a-91af951b4a1b service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:28.509749 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-dfe98ecb-ce15-417c-958a-91af951b4a1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:43:28.564826 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe98ecb-ce15-417c-958a-91af951b4a1b service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:28.568330 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdda53-01b5-4803-adf1-8d240230b594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff019ca0eef8455ba680191b8ae1fdba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:28.569157 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdda53-01b5-4803-adf1-8d240230b594 service cinder] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:28.569466 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdda53-01b5-4803-adf1-8d240230b594 service cinder] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:28.569739 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdda53-01b5-4803-adf1-8d240230b594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:28.571486 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e4cdda53-01b5-4803-adf1-8d240230b594 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:43:28.643076 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdda53-01b5-4803-adf1-8d240230b594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:28.644531 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdda53-01b5-4803-adf1-8d240230b594 service cinder] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:28.656459 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1422/2843] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:43:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:43:28.945839 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa7662-723e-4503-92e9-771a5cfe4815 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:28.947218 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-bbfa7662-723e-4503-92e9-771a5cfe4815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:43:28.959579 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa7662-723e-4503-92e9-771a5cfe4815 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:28.963212 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e07c08-6194-49fa-8148-3413521f99e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:28.963839 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e07c08-6194-49fa-8148-3413521f99e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:28.964116 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e07c08-6194-49fa-8148-3413521f99e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:28.964386 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e07c08-6194-49fa-8148-3413521f99e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:28.966118 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e9e07c08-6194-49fa-8148-3413521f99e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:43:28.975165 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e07c08-6194-49fa-8148-3413521f99e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:28.976587 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e07c08-6194-49fa-8148-3413521f99e4 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:28.984486 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1422/2844] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:43:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:43:29.431342 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdda53-01b5-4803-adf1-8d240230b594 service cinder] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:29.432744 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e4cdda53-01b5-4803-adf1-8d240230b594 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:43:29.450991 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e07c08-6194-49fa-8148-3413521f99e4 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:29.461232 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e07c08-6194-49fa-8148-3413521f99e4 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:29.465022 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784ff8d-44ed-4d9f-ac04-48552bfaf314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:29.465758 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784ff8d-44ed-4d9f-ac04-48552bfaf314 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:29.466106 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784ff8d-44ed-4d9f-ac04-48552bfaf314 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:29.466452 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784ff8d-44ed-4d9f-ac04-48552bfaf314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:29.468357 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9784ff8d-44ed-4d9f-ac04-48552bfaf314 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:43:29.483345 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784ff8d-44ed-4d9f-ac04-48552bfaf314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:29.484790 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784ff8d-44ed-4d9f-ac04-48552bfaf314 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:29.495529 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1423/2845] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:43:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:43:29.503023 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdda53-01b5-4803-adf1-8d240230b594 service cinder] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:29.508012 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf731aa0-e4ac-497a-a0d0-148f32001f3c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc233f62146a49099216c6236fb2ee2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:29.508657 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf731aa0-e4ac-497a-a0d0-148f32001f3c service placement] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:29.509206 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf731aa0-e4ac-497a-a0d0-148f32001f3c service placement] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:29.509206 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf731aa0-e4ac-497a-a0d0-148f32001f3c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:29.511018 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-bf731aa0-e4ac-497a-a0d0-148f32001f3c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:43:29.523242 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf731aa0-e4ac-497a-a0d0-148f32001f3c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:29.524841 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf731aa0-e4ac-497a-a0d0-148f32001f3c service placement] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:29.535134 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1423/2846] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:43:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:43:31.219181 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784ff8d-44ed-4d9f-ac04-48552bfaf314 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:31.228891 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784ff8d-44ed-4d9f-ac04-48552bfaf314 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:31.236380 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1266861-f4cd-4a78-bfef-1a6c9a372fee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:31.237188 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1266861-f4cd-4a78-bfef-1a6c9a372fee service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:31.237558 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1266861-f4cd-4a78-bfef-1a6c9a372fee service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:31.237831 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1266861-f4cd-4a78-bfef-1a6c9a372fee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:31.240294 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-a1266861-f4cd-4a78-bfef-1a6c9a372fee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:43:31.251795 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1266861-f4cd-4a78-bfef-1a6c9a372fee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:31.253620 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1266861-f4cd-4a78-bfef-1a6c9a372fee service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:31.262177 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1424/2847] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:43:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 16 05:43:35.249874 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf731aa0-e4ac-497a-a0d0-148f32001f3c service placement] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:35.251398 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-bf731aa0-e4ac-497a-a0d0-148f32001f3c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:43:35.266816 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf731aa0-e4ac-497a-a0d0-148f32001f3c service placement] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:35.272227 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a580d-e453-4c22-aceb-29a76b26d5d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:35.272851 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a580d-e453-4c22-aceb-29a76b26d5d1 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:35.273135 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a580d-e453-4c22-aceb-29a76b26d5d1 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:35.273447 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a580d-e453-4c22-aceb-29a76b26d5d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:35.275140 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e20a580d-e453-4c22-aceb-29a76b26d5d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:43:35.285624 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a580d-e453-4c22-aceb-29a76b26d5d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:35.287478 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a580d-e453-4c22-aceb-29a76b26d5d1 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:35.296320 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1424/2848] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:43:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:43:37.770343 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1266861-f4cd-4a78-bfef-1a6c9a372fee service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:37.795778 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1266861-f4cd-4a78-bfef-1a6c9a372fee service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:37.802513 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca77ab-dbea-4898-940b-72df37484d9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:37.803238 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca77ab-dbea-4898-940b-72df37484d9d service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:37.803591 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca77ab-dbea-4898-940b-72df37484d9d service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:37.803933 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca77ab-dbea-4898-940b-72df37484d9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:37.806113 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-fdca77ab-dbea-4898-940b-72df37484d9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:43:37.823450 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca77ab-dbea-4898-940b-72df37484d9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:37.825362 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca77ab-dbea-4898-940b-72df37484d9d service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:37.852112 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1425/2849] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:43:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:43:42.989093 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a580d-e453-4c22-aceb-29a76b26d5d1 service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:42.991322 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-e20a580d-e453-4c22-aceb-29a76b26d5d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:43:43.016769 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a580d-e453-4c22-aceb-29a76b26d5d1 service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:43.024843 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4511c-7bfa-4ef4-a287-66ba4ee36591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:43.026123 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4511c-7bfa-4ef4-a287-66ba4ee36591 service nova] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:43.026589 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4511c-7bfa-4ef4-a287-66ba4ee36591 service nova] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:43.027037 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4511c-7bfa-4ef4-a287-66ba4ee36591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:43.029187 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-69c4511c-7bfa-4ef4-a287-66ba4ee36591 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:43:43.045510 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4511c-7bfa-4ef4-a287-66ba4ee36591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:43.050351 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4511c-7bfa-4ef4-a287-66ba4ee36591 service nova] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:43.069474 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1425/2850] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:43:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:43:45.489105 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a195a42-1f9f-41a4-8526-74a0018571d8 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:45.489959 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a195a42-1f9f-41a4-8526-74a0018571d8 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:45.490238 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a195a42-1f9f-41a4-8526-74a0018571d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:45.508242 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-9a195a42-1f9f-41a4-8526-74a0018571d8 None None] MFA Rules not processed for user `4d22345d2e2646cc99c74a2f9692b648`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:43:45.509481 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9a195a42-1f9f-41a4-8526-74a0018571d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:43:45.516699 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1426/2851] 10.222.0.75 () {58 vars in 967 bytes} [Wed Feb 16 05:43:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:43:45.559203 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4511c-7bfa-4ef4-a287-66ba4ee36591 service nova] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:45.570783 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4511c-7bfa-4ef4-a287-66ba4ee36591 service nova] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:45.575945 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f754a-2479-4e2e-aba0-382016588a05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92eb49cac0c94e73a70361831dd789b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:45.577168 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f754a-2479-4e2e-aba0-382016588a05 service swift] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:45.577553 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f754a-2479-4e2e-aba0-382016588a05 service swift] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:45.577828 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f754a-2479-4e2e-aba0-382016588a05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:45.587577 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f754a-2479-4e2e-aba0-382016588a05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:45.589161 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f754a-2479-4e2e-aba0-382016588a05 service swift] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:45.597969 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1426/2852] 10.222.0.75 () {60 vars in 1384 bytes} [Wed Feb 16 05:43:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 16 05:43:52.275564 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a195a42-1f9f-41a4-8526-74a0018571d8 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:52.346974 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a195a42-1f9f-41a4-8526-74a0018571d8 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:52.351500 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c2c76-ac2b-49d1-b6d2-f503ffdb9e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:52.352295 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c2c76-ac2b-49d1-b6d2-f503ffdb9e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:52.352568 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c2c76-ac2b-49d1-b6d2-f503ffdb9e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:52.352834 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c2c76-ac2b-49d1-b6d2-f503ffdb9e97 admin admin] PATH_INFO: `/v3/users/584d2cb873f74a1094a192f8de8f0451` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:52.354044 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c2c76-ac2b-49d1-b6d2-f503ffdb9e97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=584d2cb873f74a1094a192f8de8f0451)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:52.355972 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c2c76-ac2b-49d1-b6d2-f503ffdb9e97 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:52.399499 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-316c2c76-ac2b-49d1-b6d2-f503ffdb9e97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '584d2cb873f74a1094a192f8de8f0451'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:43:52.411558 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-316c2c76-ac2b-49d1-b6d2-f503ffdb9e97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '584d2cb873f74a1094a192f8de8f0451'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:43:52.412220 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-316c2c76-ac2b-49d1-b6d2-f503ffdb9e97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '584d2cb873f74a1094a192f8de8f0451'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:43:52.412818 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-316c2c76-ac2b-49d1-b6d2-f503ffdb9e97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '584d2cb873f74a1094a192f8de8f0451'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:43:52.419986 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-316c2c76-ac2b-49d1-b6d2-f503ffdb9e97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '584d2cb873f74a1094a192f8de8f0451'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:43:52.431845 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1427/2853] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:43:52 2022] DELETE /identity/v3/users/584d2cb873f74a1094a192f8de8f0451 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:43:52.595573 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f754a-2479-4e2e-aba0-382016588a05 service swift] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:52.611339 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f754a-2479-4e2e-aba0-382016588a05 service swift] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:52.665815 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd795211-11e9-4ca3-af46-7a2075ac09d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:52.666654 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd795211-11e9-4ca3-af46-7a2075ac09d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:52.666929 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd795211-11e9-4ca3-af46-7a2075ac09d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:52.667199 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd795211-11e9-4ca3-af46-7a2075ac09d3 admin admin] PATH_INFO: `/v3/projects/ba122c4197da463faf4c622f2ba7087c` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:52.668373 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd795211-11e9-4ca3-af46-7a2075ac09d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba122c4197da463faf4c622f2ba7087c)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:52.670366 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd795211-11e9-4ca3-af46-7a2075ac09d3 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:52.715431 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-cd795211-11e9-4ca3-af46-7a2075ac09d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba122c4197da463faf4c622f2ba7087c', 'request_id': 'req-cd795211-11e9-4ca3-af46-7a2075ac09d3'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:43:52.721884 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-cd795211-11e9-4ca3-af46-7a2075ac09d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba122c4197da463faf4c622f2ba7087c', 'request_id': 'req-cd795211-11e9-4ca3-af46-7a2075ac09d3'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:43:52.727179 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-cd795211-11e9-4ca3-af46-7a2075ac09d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba122c4197da463faf4c622f2ba7087c', 'request_id': 'req-cd795211-11e9-4ca3-af46-7a2075ac09d3'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:43:52.737892 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-cd795211-11e9-4ca3-af46-7a2075ac09d3 admin admin] The token cache is being invalidate because project ba122c4197da463faf4c622f2ba7087c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:43:52.738177 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-cd795211-11e9-4ca3-af46-7a2075ac09d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:43:52.738801 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-cd795211-11e9-4ca3-af46-7a2075ac09d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:43:52.740322 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1427/2854] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:43:52 2022] DELETE /identity/v3/projects/ba122c4197da463faf4c622f2ba7087c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:43:52.744520 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c2c76-ac2b-49d1-b6d2-f503ffdb9e97 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:52.745974 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-316c2c76-ac2b-49d1-b6d2-f503ffdb9e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:43:52.759249 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c2c76-ac2b-49d1-b6d2-f503ffdb9e97 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:52.812390 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89515d5e-901a-4c77-97e3-537c7f88ff74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:52.813233 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89515d5e-901a-4c77-97e3-537c7f88ff74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:52.813660 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89515d5e-901a-4c77-97e3-537c7f88ff74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:52.813932 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89515d5e-901a-4c77-97e3-537c7f88ff74 admin admin] PATH_INFO: `/v3/users/1de4df1c3d994b1a9e273b225f9cac2e` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:52.815089 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89515d5e-901a-4c77-97e3-537c7f88ff74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1de4df1c3d994b1a9e273b225f9cac2e)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:52.817006 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89515d5e-901a-4c77-97e3-537c7f88ff74 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:52.860159 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-89515d5e-901a-4c77-97e3-537c7f88ff74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1de4df1c3d994b1a9e273b225f9cac2e'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:43:52.871278 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-89515d5e-901a-4c77-97e3-537c7f88ff74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1de4df1c3d994b1a9e273b225f9cac2e'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:43:52.871923 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-89515d5e-901a-4c77-97e3-537c7f88ff74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1de4df1c3d994b1a9e273b225f9cac2e'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:43:52.872521 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-89515d5e-901a-4c77-97e3-537c7f88ff74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1de4df1c3d994b1a9e273b225f9cac2e'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:43:52.879836 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-89515d5e-901a-4c77-97e3-537c7f88ff74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1de4df1c3d994b1a9e273b225f9cac2e'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:43:52.892008 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1428/2855] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:43:52 2022] DELETE /identity/v3/users/1de4df1c3d994b1a9e273b225f9cac2e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:43:53.058327 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd795211-11e9-4ca3-af46-7a2075ac09d3 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:53.059878 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-cd795211-11e9-4ca3-af46-7a2075ac09d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:43:53.073797 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd795211-11e9-4ca3-af46-7a2075ac09d3 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:53.129017 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0770a-6d15-4d37-a975-02103d2c97dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:53.129841 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0770a-6d15-4d37-a975-02103d2c97dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:53.130122 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0770a-6d15-4d37-a975-02103d2c97dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:53.130396 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0770a-6d15-4d37-a975-02103d2c97dc admin admin] PATH_INFO: `/v3/projects/e59fd9d8b19f4a2d825d19e5a6ed8a08` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:53.131563 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0770a-6d15-4d37-a975-02103d2c97dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e59fd9d8b19f4a2d825d19e5a6ed8a08)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:53.133591 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0770a-6d15-4d37-a975-02103d2c97dc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:53.178847 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-95f0770a-6d15-4d37-a975-02103d2c97dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e59fd9d8b19f4a2d825d19e5a6ed8a08', 'request_id': 'req-95f0770a-6d15-4d37-a975-02103d2c97dc'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:43:53.186669 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-95f0770a-6d15-4d37-a975-02103d2c97dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e59fd9d8b19f4a2d825d19e5a6ed8a08', 'request_id': 'req-95f0770a-6d15-4d37-a975-02103d2c97dc'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:43:53.192027 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-95f0770a-6d15-4d37-a975-02103d2c97dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e59fd9d8b19f4a2d825d19e5a6ed8a08', 'request_id': 'req-95f0770a-6d15-4d37-a975-02103d2c97dc'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:43:53.202600 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-95f0770a-6d15-4d37-a975-02103d2c97dc admin admin] The token cache is being invalidate because project e59fd9d8b19f4a2d825d19e5a6ed8a08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:43:53.202882 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-95f0770a-6d15-4d37-a975-02103d2c97dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:43:53.203513 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-95f0770a-6d15-4d37-a975-02103d2c97dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:43:53.205034 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1428/2856] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:43:53 2022] DELETE /identity/v3/projects/e59fd9d8b19f4a2d825d19e5a6ed8a08 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:43:53.210018 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febf1ac-7857-43cc-acb5-6659819fee85 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:53.210306 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febf1ac-7857-43cc-acb5-6659819fee85 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:53.210577 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febf1ac-7857-43cc-acb5-6659819fee85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:53.227490 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-9febf1ac-7857-43cc-acb5-6659819fee85 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:43:53.228665 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-9febf1ac-7857-43cc-acb5-6659819fee85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:43:53.284288 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1429/2857] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:43:53.292120 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe6a0a-0f3f-40d5-aab1-421873ca0274 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:53.292408 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe6a0a-0f3f-40d5-aab1-421873ca0274 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:53.292711 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe6a0a-0f3f-40d5-aab1-421873ca0274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:53.311984 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-fcfe6a0a-0f3f-40d5-aab1-421873ca0274 None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:43:53.313163 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-fcfe6a0a-0f3f-40d5-aab1-421873ca0274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:43:53.320970 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1429/2858] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:43:53.325112 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febf1ac-7857-43cc-acb5-6659819fee85 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:53.335094 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febf1ac-7857-43cc-acb5-6659819fee85 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:53.339570 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebaea4-7a2b-4491-9e43-d0615a7249de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:53.340204 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebaea4-7a2b-4491-9e43-d0615a7249de admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:53.340480 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebaea4-7a2b-4491-9e43-d0615a7249de admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:53.340749 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebaea4-7a2b-4491-9e43-d0615a7249de admin admin] PATH_INFO: `/v3/domains` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:53.341513 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebaea4-7a2b-4491-9e43-d0615a7249de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79197) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 16 05:43:53.341794 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebaea4-7a2b-4491-9e43-d0615a7249de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:53.344059 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cebaea4-7a2b-4491-9e43-d0615a7249de admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:53.354947 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1430/2859] 10.222.0.75 () {58 vars in 1152 bytes} [Wed Feb 16 05:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 16 05:43:53.359040 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe6a0a-0f3f-40d5-aab1-421873ca0274 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:53.368174 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe6a0a-0f3f-40d5-aab1-421873ca0274 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:53.372942 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7fc26-5822-4894-84d1-06ef5ee1b6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:53.373611 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7fc26-5822-4894-84d1-06ef5ee1b6ac admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:53.373893 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7fc26-5822-4894-84d1-06ef5ee1b6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:53.374162 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7fc26-5822-4894-84d1-06ef5ee1b6ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:53.374871 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7fc26-5822-4894-84d1-06ef5ee1b6ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:53.376790 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7fc26-5822-4894-84d1-06ef5ee1b6ac admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:53.401975 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1430/2860] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:43:53 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:43:53.406444 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebaea4-7a2b-4491-9e43-d0615a7249de admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:53.416384 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebaea4-7a2b-4491-9e43-d0615a7249de admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:53.468490 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66299195-5e3b-47ee-a522-263297d63e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:53.469128 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66299195-5e3b-47ee-a522-263297d63e3f admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:53.469439 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66299195-5e3b-47ee-a522-263297d63e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:53.469709 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66299195-5e3b-47ee-a522-263297d63e3f admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:53.470372 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66299195-5e3b-47ee-a522-263297d63e3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:53.472319 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66299195-5e3b-47ee-a522-263297d63e3f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:53.491093 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1431/2861] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:43:53 2022] POST /identity/v3/users => generated 287 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:43:53.495082 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7fc26-5822-4894-84d1-06ef5ee1b6ac admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:53.506666 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7fc26-5822-4894-84d1-06ef5ee1b6ac admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:53.511255 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3e4d7-7f04-40ee-9991-da3ea9b89dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:53.511899 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3e4d7-7f04-40ee-9991-da3ea9b89dbc admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:53.512179 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3e4d7-7f04-40ee-9991-da3ea9b89dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:53.512450 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3e4d7-7f04-40ee-9991-da3ea9b89dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:53.513166 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3e4d7-7f04-40ee-9991-da3ea9b89dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:53.515402 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3e4d7-7f04-40ee-9991-da3ea9b89dbc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:53.525492 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1431/2862] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:43:53.529298 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66299195-5e3b-47ee-a522-263297d63e3f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:53.539445 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66299195-5e3b-47ee-a522-263297d63e3f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:53.544086 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c0af6-9f6a-4e35-92de-72953c742dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:53.544733 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c0af6-9f6a-4e35-92de-72953c742dfe admin admin] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:53.545014 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c0af6-9f6a-4e35-92de-72953c742dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:53.545323 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c0af6-9f6a-4e35-92de-72953c742dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:53.546050 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c0af6-9f6a-4e35-92de-72953c742dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:53.547651 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c0af6-9f6a-4e35-92de-72953c742dfe admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:53.557154 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1432/2863] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 16 05:43:53.561399 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3e4d7-7f04-40ee-9991-da3ea9b89dbc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:53.571344 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3e4d7-7f04-40ee-9991-da3ea9b89dbc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:53.575887 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e3c90-71b4-4205-bc92-891a94aa6383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:53.577432 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e3c90-71b4-4205-bc92-891a94aa6383 admin admin] REQUEST_METHOD: `PUT` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:53.577707 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e3c90-71b4-4205-bc92-891a94aa6383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:53.577973 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e3c90-71b4-4205-bc92-891a94aa6383 admin admin] PATH_INFO: `/v3/projects/563c1c32061d4b78be6a20b84fd3ae39/users/966870646c4241a2a1de22777b413f59/roles/3bbfe5a5163345b2b0d0cee3ea713919` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:53.591647 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e3c90-71b4-4205-bc92-891a94aa6383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=563c1c32061d4b78be6a20b84fd3ae39, user_id=966870646c4241a2a1de22777b413f59, role_id=3bbfe5a5163345b2b0d0cee3ea713919)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:53.594315 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e3c90-71b4-4205-bc92-891a94aa6383 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:53.606646 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1432/2864] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:43:53 2022] PUT /identity/v3/projects/563c1c32061d4b78be6a20b84fd3ae39/users/966870646c4241a2a1de22777b413f59/roles/3bbfe5a5163345b2b0d0cee3ea713919 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:43:53.611621 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efbe9a-5eee-4d45-a243-70b57d5d734d None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:53.611927 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efbe9a-5eee-4d45-a243-70b57d5d734d None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:53.612207 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efbe9a-5eee-4d45-a243-70b57d5d734d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:53.630049 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-29efbe9a-5eee-4d45-a243-70b57d5d734d None None] MFA Rules not processed for user `45cb725950b24d83bf85741c6aa46ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:43:53.631256 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-29efbe9a-5eee-4d45-a243-70b57d5d734d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:43:53.688240 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1433/2865] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:43:53.697741 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e3c90-71b4-4205-bc92-891a94aa6383 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:53.699516 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-9e3e3c90-71b4-4205-bc92-891a94aa6383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:43:53.756386 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e3c90-71b4-4205-bc92-891a94aa6383 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:53.760037 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be819e-285f-4953-92d1-5eb96c691eff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:53.760669 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be819e-285f-4953-92d1-5eb96c691eff service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:53.760948 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be819e-285f-4953-92d1-5eb96c691eff service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:53.761220 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be819e-285f-4953-92d1-5eb96c691eff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:53.770723 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be819e-285f-4953-92d1-5eb96c691eff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:53.772141 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be819e-285f-4953-92d1-5eb96c691eff service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:53.781361 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1433/2866] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:43:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:43:57.634435 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d3d4a-d588-4d89-8b1e-1cbcb0e9baa5 None None] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:57.634938 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d3d4a-d588-4d89-8b1e-1cbcb0e9baa5 None None] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:57.635040 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d3d4a-d588-4d89-8b1e-1cbcb0e9baa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:57.668887 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.auth.core [None req-c74d3d4a-d588-4d89-8b1e-1cbcb0e9baa5 None None] MFA Rules not processed for user `966870646c4241a2a1de22777b413f59`. Rule list: `[]` (Enabled: `True`). {{(pid=79197) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:43:57.670073 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-c74d3d4a-d588-4d89-8b1e-1cbcb0e9baa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:43:57.733002 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1434/2867] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:43:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:43:57.737589 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be819e-285f-4953-92d1-5eb96c691eff service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:57.748189 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be819e-285f-4953-92d1-5eb96c691eff service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:57.753199 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bddb1-eed7-48a1-9ebf-552bea772985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:57.753886 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bddb1-eed7-48a1-9ebf-552bea772985 admin admin] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:57.754169 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bddb1-eed7-48a1-9ebf-552bea772985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:57.754445 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160bddb1-eed7-48a1-9ebf-552bea772985 admin admin] PATH_INFO: `/v3/projects` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:57.755153 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160bddb1-eed7-48a1-9ebf-552bea772985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:57.757092 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160bddb1-eed7-48a1-9ebf-552bea772985 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:57.784734 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1434/2868] 10.222.0.75 () {60 vars in 1152 bytes} [Wed Feb 16 05:43:57 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:43:57.788890 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d3d4a-d588-4d89-8b1e-1cbcb0e9baa5 None None] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:57.800097 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d3d4a-d588-4d89-8b1e-1cbcb0e9baa5 None None] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:57.859384 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358913b-b8c7-45bb-bf69-95246688f6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:57.860232 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358913b-b8c7-45bb-bf69-95246688f6ef admin admin] REQUEST_METHOD: `POST` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:57.860518 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358913b-b8c7-45bb-bf69-95246688f6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:57.861363 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358913b-b8c7-45bb-bf69-95246688f6ef admin admin] PATH_INFO: `/v3/users` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:57.862226 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358913b-b8c7-45bb-bf69-95246688f6ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:57.864328 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358913b-b8c7-45bb-bf69-95246688f6ef admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:57.888265 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1435/2869] 10.222.0.75 () {60 vars in 1143 bytes} [Wed Feb 16 05:43:57 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 16 05:43:57.889635 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bddb1-eed7-48a1-9ebf-552bea772985 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:57.900219 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160bddb1-eed7-48a1-9ebf-552bea772985 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:57.905808 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8f564-8795-447e-acd0-d28a089752e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:57.906547 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8f564-8795-447e-acd0-d28a089752e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:57.906901 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8f564-8795-447e-acd0-d28a089752e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:57.907250 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8f564-8795-447e-acd0-d28a089752e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:57.908236 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8f564-8795-447e-acd0-d28a089752e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:57.910127 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8f564-8795-447e-acd0-d28a089752e6 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:57.927945 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1435/2870] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:43:57.932099 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358913b-b8c7-45bb-bf69-95246688f6ef admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:57.947148 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358913b-b8c7-45bb-bf69-95246688f6ef admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:57.952923 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe1e97-187a-4bab-b613-862c16464340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:57.953860 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe1e97-187a-4bab-b613-862c16464340 admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:57.954139 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe1e97-187a-4bab-b613-862c16464340 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:57.954413 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe1e97-187a-4bab-b613-862c16464340 admin admin] PATH_INFO: `/v3/projects/2907a2767bf740fd8ca946c75f1ca474/users/efc1bd45f7cf400982d229d4b0eba6b2/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:57.971341 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe1e97-187a-4bab-b613-862c16464340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2907a2767bf740fd8ca946c75f1ca474, user_id=efc1bd45f7cf400982d229d4b0eba6b2, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:57.974327 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe1e97-187a-4bab-b613-862c16464340 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:57.988454 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1436/2871] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:43:57 2022] PUT /identity/v3/projects/2907a2767bf740fd8ca946c75f1ca474/users/efc1bd45f7cf400982d229d4b0eba6b2/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:43:57.992389 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8f564-8795-447e-acd0-d28a089752e6 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:58.003206 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8f564-8795-447e-acd0-d28a089752e6 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:58.060516 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f476f-bc06-47a0-a16d-2ab5c7f35aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:58.061807 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f476f-bc06-47a0-a16d-2ab5c7f35aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:58.062033 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f476f-bc06-47a0-a16d-2ab5c7f35aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:58.062307 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f476f-bc06-47a0-a16d-2ab5c7f35aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:58.063037 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f476f-bc06-47a0-a16d-2ab5c7f35aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:58.064648 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f476f-bc06-47a0-a16d-2ab5c7f35aa0 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:58.074531 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1436/2872] 10.222.0.75 () {58 vars in 1121 bytes} [Wed Feb 16 05:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 16 05:43:58.079596 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe1e97-187a-4bab-b613-862c16464340 admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:43:58.090116 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe1e97-187a-4bab-b613-862c16464340 admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:43:58.095082 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc6be8-7db7-4900-87cd-9efac1a2275f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:43:58.095967 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc6be8-7db7-4900-87cd-9efac1a2275f admin admin] REQUEST_METHOD: `PUT` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:43:58.096248 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc6be8-7db7-4900-87cd-9efac1a2275f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:43:58.104656 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc6be8-7db7-4900-87cd-9efac1a2275f admin admin] PATH_INFO: `/v3/projects/2907a2767bf740fd8ca946c75f1ca474/users/efc1bd45f7cf400982d229d4b0eba6b2/roles/9ba4a5967ed243178927661616f08901` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:43:58.106364 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc6be8-7db7-4900-87cd-9efac1a2275f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2907a2767bf740fd8ca946c75f1ca474, user_id=efc1bd45f7cf400982d229d4b0eba6b2, role_id=9ba4a5967ed243178927661616f08901)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:43:58.109114 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc6be8-7db7-4900-87cd-9efac1a2275f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:43:58.122391 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1437/2873] 10.222.0.75 () {60 vars in 1482 bytes} [Wed Feb 16 05:43:58 2022] PUT /identity/v3/projects/2907a2767bf740fd8ca946c75f1ca474/users/efc1bd45f7cf400982d229d4b0eba6b2/roles/9ba4a5967ed243178927661616f08901 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:44:02.778068 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841628ff-5f00-4a25-9f60-9696c16397e7 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:44:02.778871 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841628ff-5f00-4a25-9f60-9696c16397e7 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:44:02.779151 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841628ff-5f00-4a25-9f60-9696c16397e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:44:02.809811 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-841628ff-5f00-4a25-9f60-9696c16397e7 None None] MFA Rules not processed for user `efc1bd45f7cf400982d229d4b0eba6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:44:02.811078 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-841628ff-5f00-4a25-9f60-9696c16397e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:44:02.891258 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1437/2874] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:44:02 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:44:02.902704 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc6be8-7db7-4900-87cd-9efac1a2275f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:44:02.905217 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-e4bc6be8-7db7-4900-87cd-9efac1a2275f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:44:03.012522 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc6be8-7db7-4900-87cd-9efac1a2275f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:44:03.022915 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db8b67-3759-4249-a3e6-5d44327fa796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:44:03.023583 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db8b67-3759-4249-a3e6-5d44327fa796 service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:44:03.023842 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db8b67-3759-4249-a3e6-5d44327fa796 service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:44:03.024287 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db8b67-3759-4249-a3e6-5d44327fa796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:44:03.095979 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db8b67-3759-4249-a3e6-5d44327fa796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:44:03.097643 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db8b67-3759-4249-a3e6-5d44327fa796 service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:44:03.109329 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1438/2875] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:44:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:44:04.221047 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af92cc-6ab9-4507-938e-f3746a6494b2 None None] REQUEST_METHOD: `POST` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:44:04.221632 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af92cc-6ab9-4507-938e-f3746a6494b2 None None] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:44:04.221758 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af92cc-6ab9-4507-938e-f3746a6494b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:44:04.240253 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.auth.core [None req-12af92cc-6ab9-4507-938e-f3746a6494b2 None None] MFA Rules not processed for user `966870646c4241a2a1de22777b413f59`. Rule list: `[]` (Enabled: `True`). {{(pid=79198) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 16 05:44:04.241617 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-12af92cc-6ab9-4507-938e-f3746a6494b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:44:04.248632 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1438/2876] 10.222.0.75 () {58 vars in 957 bytes} [Wed Feb 16 05:44:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 16 05:44:19.921900 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db8b67-3759-4249-a3e6-5d44327fa796 service nova] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:44:19.973224 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db8b67-3759-4249-a3e6-5d44327fa796 service nova] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:44:19.976850 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0e1ba-ec65-4502-a159-9836d2442482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:44:19.977509 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0e1ba-ec65-4502-a159-9836d2442482 service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:44:19.977787 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0e1ba-ec65-4502-a159-9836d2442482 service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:44:19.978054 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0e1ba-ec65-4502-a159-9836d2442482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:44:19.979786 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-bad0e1ba-ec65-4502-a159-9836d2442482 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:44:19.989129 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0e1ba-ec65-4502-a159-9836d2442482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:44:19.990585 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0e1ba-ec65-4502-a159-9836d2442482 service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:44:19.998756 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1439/2877] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:44:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:44:41.204778 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af92cc-6ab9-4507-938e-f3746a6494b2 None None] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:44:41.214247 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af92cc-6ab9-4507-938e-f3746a6494b2 None None] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:44:41.218489 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7928aa4-a276-48f1-90cb-63c5b16dc877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:44:41.219062 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7928aa4-a276-48f1-90cb-63c5b16dc877 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:44:41.219343 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7928aa4-a276-48f1-90cb-63c5b16dc877 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:44:41.219616 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7928aa4-a276-48f1-90cb-63c5b16dc877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:44:41.228478 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7928aa4-a276-48f1-90cb-63c5b16dc877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:44:41.230044 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7928aa4-a276-48f1-90cb-63c5b16dc877 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:44:41.239721 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1439/2878] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:44:41 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:45:16.852546 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0e1ba-ec65-4502-a159-9836d2442482 service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:45:16.854132 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-bad0e1ba-ec65-4502-a159-9836d2442482 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:45:16.871391 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0e1ba-ec65-4502-a159-9836d2442482 service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:45:16.878936 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca266da-0756-4e7f-8de2-68dd78f96c0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6522d231532a48ad8dbc9c9e79a021dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:45:16.880079 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca266da-0756-4e7f-8de2-68dd78f96c0c service nova] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:45:16.880438 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca266da-0756-4e7f-8de2-68dd78f96c0c service nova] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:45:16.880892 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca266da-0756-4e7f-8de2-68dd78f96c0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:45:16.882916 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6ca266da-0756-4e7f-8de2-68dd78f96c0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:45:16.897241 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca266da-0756-4e7f-8de2-68dd78f96c0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:45:16.899139 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca266da-0756-4e7f-8de2-68dd78f96c0c service nova] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:45:16.912173 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1440/2879] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:45:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:45:29.479730 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7928aa4-a276-48f1-90cb-63c5b16dc877 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:45:29.481184 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-c7928aa4-a276-48f1-90cb-63c5b16dc877 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:45:29.492031 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7928aa4-a276-48f1-90cb-63c5b16dc877 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:45:29.495542 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d5de4-0bf6-4b11-8cf4-60960930e560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:45:29.496159 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d5de4-0bf6-4b11-8cf4-60960930e560 service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:45:29.496435 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d5de4-0bf6-4b11-8cf4-60960930e560 service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:45:29.496704 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d5de4-0bf6-4b11-8cf4-60960930e560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:45:29.498950 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-4e4d5de4-0bf6-4b11-8cf4-60960930e560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:45:29.560458 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d5de4-0bf6-4b11-8cf4-60960930e560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:45:29.561928 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d5de4-0bf6-4b11-8cf4-60960930e560 service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:45:29.571381 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1440/2880] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:45:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:45:35.675411 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca266da-0756-4e7f-8de2-68dd78f96c0c service nova] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:45:35.677589 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-6ca266da-0756-4e7f-8de2-68dd78f96c0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:45:35.742073 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca266da-0756-4e7f-8de2-68dd78f96c0c service nova] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:45:35.746603 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bda67e-afc3-46ee-a5c9-e57d5c6594ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:45:35.748003 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bda67e-afc3-46ee-a5c9-e57d5c6594ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:45:35.748275 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bda67e-afc3-46ee-a5c9-e57d5c6594ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:45:35.748542 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bda67e-afc3-46ee-a5c9-e57d5c6594ee admin admin] PATH_INFO: `/v3/users/87279464d1b74c0d88c95f4dec9871ae` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:45:35.749749 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bda67e-afc3-46ee-a5c9-e57d5c6594ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=87279464d1b74c0d88c95f4dec9871ae)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:45:35.751671 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bda67e-afc3-46ee-a5c9-e57d5c6594ee admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:45:35.796299 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f7bda67e-afc3-46ee-a5c9-e57d5c6594ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87279464d1b74c0d88c95f4dec9871ae'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:45:35.807371 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f7bda67e-afc3-46ee-a5c9-e57d5c6594ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87279464d1b74c0d88c95f4dec9871ae'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:45:35.808037 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f7bda67e-afc3-46ee-a5c9-e57d5c6594ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87279464d1b74c0d88c95f4dec9871ae'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:45:35.808643 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f7bda67e-afc3-46ee-a5c9-e57d5c6594ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87279464d1b74c0d88c95f4dec9871ae'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:45:35.816197 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-f7bda67e-afc3-46ee-a5c9-e57d5c6594ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87279464d1b74c0d88c95f4dec9871ae'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:45:35.827889 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1441/2881] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:45:35 2022] DELETE /identity/v3/users/87279464d1b74c0d88c95f4dec9871ae => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:45:36.003396 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d5de4-0bf6-4b11-8cf4-60960930e560 service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:45:36.042175 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d5de4-0bf6-4b11-8cf4-60960930e560 service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:45:36.097309 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0818ef-f76d-4cd9-b0aa-141857aa0941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:45:36.098155 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0818ef-f76d-4cd9-b0aa-141857aa0941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:45:36.098435 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0818ef-f76d-4cd9-b0aa-141857aa0941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:45:36.098702 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0818ef-f76d-4cd9-b0aa-141857aa0941 admin admin] PATH_INFO: `/v3/projects/7e5222e96e134b27b8a588f1309a0097` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:45:36.099867 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0818ef-f76d-4cd9-b0aa-141857aa0941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e5222e96e134b27b8a588f1309a0097)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:45:36.101794 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0818ef-f76d-4cd9-b0aa-141857aa0941 admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:45:36.145458 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5e0818ef-f76d-4cd9-b0aa-141857aa0941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e5222e96e134b27b8a588f1309a0097', 'request_id': 'req-5e0818ef-f76d-4cd9-b0aa-141857aa0941'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:45:36.152397 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5e0818ef-f76d-4cd9-b0aa-141857aa0941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e5222e96e134b27b8a588f1309a0097', 'request_id': 'req-5e0818ef-f76d-4cd9-b0aa-141857aa0941'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:45:36.158210 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5e0818ef-f76d-4cd9-b0aa-141857aa0941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e5222e96e134b27b8a588f1309a0097', 'request_id': 'req-5e0818ef-f76d-4cd9-b0aa-141857aa0941'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:45:36.169830 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5e0818ef-f76d-4cd9-b0aa-141857aa0941 admin admin] The token cache is being invalidate because project 7e5222e96e134b27b8a588f1309a0097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:45:36.170143 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5e0818ef-f76d-4cd9-b0aa-141857aa0941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:45:36.170773 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-5e0818ef-f76d-4cd9-b0aa-141857aa0941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:45:36.172283 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1441/2882] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:45:36 2022] DELETE /identity/v3/projects/7e5222e96e134b27b8a588f1309a0097 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:45:36.176362 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bda67e-afc3-46ee-a5c9-e57d5c6594ee admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:45:36.177775 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f7bda67e-afc3-46ee-a5c9-e57d5c6594ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:45:36.190553 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bda67e-afc3-46ee-a5c9-e57d5c6594ee admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:45:36.244238 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734e45a-149e-44e3-bc06-b325ea05c71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:45:36.245109 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734e45a-149e-44e3-bc06-b325ea05c71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:45:36.245421 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734e45a-149e-44e3-bc06-b325ea05c71a admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:45:36.245718 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734e45a-149e-44e3-bc06-b325ea05c71a admin admin] PATH_INFO: `/v3/users/a45793cbaf304d7f97a3a501d9822392` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:45:36.246884 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734e45a-149e-44e3-bc06-b325ea05c71a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a45793cbaf304d7f97a3a501d9822392)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:45:36.248820 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734e45a-149e-44e3-bc06-b325ea05c71a admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:45:36.292360 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2734e45a-149e-44e3-bc06-b325ea05c71a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a45793cbaf304d7f97a3a501d9822392'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:45:36.304462 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2734e45a-149e-44e3-bc06-b325ea05c71a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a45793cbaf304d7f97a3a501d9822392'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:45:36.305122 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2734e45a-149e-44e3-bc06-b325ea05c71a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a45793cbaf304d7f97a3a501d9822392'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:45:36.305761 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2734e45a-149e-44e3-bc06-b325ea05c71a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a45793cbaf304d7f97a3a501d9822392'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:45:36.312827 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-2734e45a-149e-44e3-bc06-b325ea05c71a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a45793cbaf304d7f97a3a501d9822392'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:45:36.324341 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1442/2883] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:45:36 2022] DELETE /identity/v3/users/a45793cbaf304d7f97a3a501d9822392 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:45:36.488891 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0818ef-f76d-4cd9-b0aa-141857aa0941 admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:45:36.490417 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-5e0818ef-f76d-4cd9-b0aa-141857aa0941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:45:36.502984 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0818ef-f76d-4cd9-b0aa-141857aa0941 admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:45:36.559131 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7469c-80af-4759-93e3-10253350700e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:45:36.560027 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7469c-80af-4759-93e3-10253350700e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:45:36.560307 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7469c-80af-4759-93e3-10253350700e admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:45:36.560579 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7469c-80af-4759-93e3-10253350700e admin admin] PATH_INFO: `/v3/projects/ce46f124ede2450ba8a7d3c4c8c78566` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:45:36.561776 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7469c-80af-4759-93e3-10253350700e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce46f124ede2450ba8a7d3c4c8c78566)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:45:36.563649 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7469c-80af-4759-93e3-10253350700e admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:45:36.607516 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-73a7469c-80af-4759-93e3-10253350700e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce46f124ede2450ba8a7d3c4c8c78566', 'request_id': 'req-73a7469c-80af-4759-93e3-10253350700e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:45:36.613729 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-73a7469c-80af-4759-93e3-10253350700e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce46f124ede2450ba8a7d3c4c8c78566', 'request_id': 'req-73a7469c-80af-4759-93e3-10253350700e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:45:36.619092 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-73a7469c-80af-4759-93e3-10253350700e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce46f124ede2450ba8a7d3c4c8c78566', 'request_id': 'req-73a7469c-80af-4759-93e3-10253350700e'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:45:36.629429 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-73a7469c-80af-4759-93e3-10253350700e admin admin] The token cache is being invalidate because project ce46f124ede2450ba8a7d3c4c8c78566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79198) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:45:36.629712 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-73a7469c-80af-4759-93e3-10253350700e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:45:36.630332 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-73a7469c-80af-4759-93e3-10253350700e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:45:36.631823 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1442/2884] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:45:36 2022] DELETE /identity/v3/projects/ce46f124ede2450ba8a7d3c4c8c78566 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:46:19.924974 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734e45a-149e-44e3-bc06-b325ea05c71a admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:46:19.926334 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-2734e45a-149e-44e3-bc06-b325ea05c71a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:46:20.027581 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734e45a-149e-44e3-bc06-b325ea05c71a admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:46:20.084405 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d61fb-d728-4e90-9a7a-762eed497906 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc233f62146a49099216c6236fb2ee2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:46:20.085035 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d61fb-d728-4e90-9a7a-762eed497906 service placement] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:46:20.085454 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d61fb-d728-4e90-9a7a-762eed497906 service placement] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:46:20.085761 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d61fb-d728-4e90-9a7a-762eed497906 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:46:20.087515 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-f40d61fb-d728-4e90-9a7a-762eed497906 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:46:20.098201 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d61fb-d728-4e90-9a7a-762eed497906 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:46:20.099759 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d61fb-d728-4e90-9a7a-762eed497906 service placement] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:46:20.109707 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1443/2885] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:46:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:46:51.258747 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7469c-80af-4759-93e3-10253350700e admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:46:51.260252 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-73a7469c-80af-4759-93e3-10253350700e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:46:51.347333 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7469c-80af-4759-93e3-10253350700e admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:46:51.351877 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843740d-0a77-4900-bd86-69476de1af3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:46:51.352547 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843740d-0a77-4900-bd86-69476de1af3b service neutron] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:46:51.352824 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843740d-0a77-4900-bd86-69476de1af3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:46:51.353094 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843740d-0a77-4900-bd86-69476de1af3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:46:51.355166 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1843740d-0a77-4900-bd86-69476de1af3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:46:51.367479 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843740d-0a77-4900-bd86-69476de1af3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:46:51.369207 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843740d-0a77-4900-bd86-69476de1af3b service neutron] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:46:51.380518 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1443/2886] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:46:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:46:51.479480 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d61fb-d728-4e90-9a7a-762eed497906 service placement] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:46:51.488653 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d61fb-d728-4e90-9a7a-762eed497906 service placement] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:46:51.492346 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12266996-5cdd-4264-a5aa-4ca2b5a8907d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd4eac62484c47988657d2a730f2d056', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:46:51.492969 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12266996-5cdd-4264-a5aa-4ca2b5a8907d service neutron] REQUEST_METHOD: `GET` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:46:51.493250 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12266996-5cdd-4264-a5aa-4ca2b5a8907d service neutron] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:46:51.493591 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12266996-5cdd-4264-a5aa-4ca2b5a8907d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:46:51.495356 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-12266996-5cdd-4264-a5aa-4ca2b5a8907d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:46:51.580090 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12266996-5cdd-4264-a5aa-4ca2b5a8907d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:46:51.581555 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12266996-5cdd-4264-a5aa-4ca2b5a8907d service neutron] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:46:51.601250 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1444/2887] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:46:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 16 05:48:28.770323 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843740d-0a77-4900-bd86-69476de1af3b service neutron] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:48:28.771834 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-1843740d-0a77-4900-bd86-69476de1af3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:48:28.863524 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843740d-0a77-4900-bd86-69476de1af3b service neutron] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:48:28.868091 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210bdc9-e4cd-47a5-b5dd-2a460eca23dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:48:28.868945 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210bdc9-e4cd-47a5-b5dd-2a460eca23dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:48:28.869232 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210bdc9-e4cd-47a5-b5dd-2a460eca23dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:48:28.869536 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210bdc9-e4cd-47a5-b5dd-2a460eca23dc admin admin] PATH_INFO: `/v3/users/966870646c4241a2a1de22777b413f59` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:48:28.870724 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210bdc9-e4cd-47a5-b5dd-2a460eca23dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=966870646c4241a2a1de22777b413f59)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:48:28.872641 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210bdc9-e4cd-47a5-b5dd-2a460eca23dc admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:48:28.917087 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8210bdc9-e4cd-47a5-b5dd-2a460eca23dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966870646c4241a2a1de22777b413f59'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:48:28.923814 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8210bdc9-e4cd-47a5-b5dd-2a460eca23dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966870646c4241a2a1de22777b413f59'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:48:28.934909 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8210bdc9-e4cd-47a5-b5dd-2a460eca23dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966870646c4241a2a1de22777b413f59'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:48:28.935588 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8210bdc9-e4cd-47a5-b5dd-2a460eca23dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966870646c4241a2a1de22777b413f59'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:48:28.936187 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-8210bdc9-e4cd-47a5-b5dd-2a460eca23dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966870646c4241a2a1de22777b413f59'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:48:28.948444 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1444/2888] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:48:28 2022] DELETE /identity/v3/users/966870646c4241a2a1de22777b413f59 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:48:29.117008 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12266996-5cdd-4264-a5aa-4ca2b5a8907d service neutron] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:48:29.128763 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12266996-5cdd-4264-a5aa-4ca2b5a8907d service neutron] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:48:29.185383 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa81493-c28d-4699-b339-f2e8306c606f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:48:29.186228 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa81493-c28d-4699-b339-f2e8306c606f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:48:29.186508 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa81493-c28d-4699-b339-f2e8306c606f admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:48:29.186777 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa81493-c28d-4699-b339-f2e8306c606f admin admin] PATH_INFO: `/v3/projects/563c1c32061d4b78be6a20b84fd3ae39` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:48:29.187948 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa81493-c28d-4699-b339-f2e8306c606f admin admin] RBAC: Authorizing `identity:delete_project(project_id=563c1c32061d4b78be6a20b84fd3ae39)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:48:29.190426 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa81493-c28d-4699-b339-f2e8306c606f admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:48:29.234669 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-caa81493-c28d-4699-b339-f2e8306c606f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '563c1c32061d4b78be6a20b84fd3ae39', 'request_id': 'req-caa81493-c28d-4699-b339-f2e8306c606f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:48:29.242110 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-caa81493-c28d-4699-b339-f2e8306c606f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '563c1c32061d4b78be6a20b84fd3ae39', 'request_id': 'req-caa81493-c28d-4699-b339-f2e8306c606f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:48:29.247344 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-caa81493-c28d-4699-b339-f2e8306c606f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '563c1c32061d4b78be6a20b84fd3ae39', 'request_id': 'req-caa81493-c28d-4699-b339-f2e8306c606f'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:48:29.258325 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-caa81493-c28d-4699-b339-f2e8306c606f admin admin] The token cache is being invalidate because project 563c1c32061d4b78be6a20b84fd3ae39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:48:29.258610 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-caa81493-c28d-4699-b339-f2e8306c606f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:48:29.259236 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-caa81493-c28d-4699-b339-f2e8306c606f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:48:29.260741 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1445/2889] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:48:29 2022] DELETE /identity/v3/projects/563c1c32061d4b78be6a20b84fd3ae39 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:48:29.264746 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210bdc9-e4cd-47a5-b5dd-2a460eca23dc admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:48:29.266159 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-8210bdc9-e4cd-47a5-b5dd-2a460eca23dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:48:29.280122 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210bdc9-e4cd-47a5-b5dd-2a460eca23dc admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:48:29.334135 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9959dc-98f0-4d1a-b2cb-bdb77fb0d44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:48:29.335135 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9959dc-98f0-4d1a-b2cb-bdb77fb0d44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:48:29.335420 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9959dc-98f0-4d1a-b2cb-bdb77fb0d44c admin admin] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:48:29.335696 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9959dc-98f0-4d1a-b2cb-bdb77fb0d44c admin admin] PATH_INFO: `/v3/users/efc1bd45f7cf400982d229d4b0eba6b2` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:48:29.336873 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9959dc-98f0-4d1a-b2cb-bdb77fb0d44c admin admin] RBAC: Authorizing `identity:delete_user(user_id=efc1bd45f7cf400982d229d4b0eba6b2)` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:48:29.338836 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9959dc-98f0-4d1a-b2cb-bdb77fb0d44c admin admin] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:48:29.383146 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-fd9959dc-98f0-4d1a-b2cb-bdb77fb0d44c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efc1bd45f7cf400982d229d4b0eba6b2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:48:29.389681 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-fd9959dc-98f0-4d1a-b2cb-bdb77fb0d44c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efc1bd45f7cf400982d229d4b0eba6b2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:48:29.401762 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-fd9959dc-98f0-4d1a-b2cb-bdb77fb0d44c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efc1bd45f7cf400982d229d4b0eba6b2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:48:29.402431 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-fd9959dc-98f0-4d1a-b2cb-bdb77fb0d44c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efc1bd45f7cf400982d229d4b0eba6b2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:48:29.403477 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.notifications [None req-fd9959dc-98f0-4d1a-b2cb-bdb77fb0d44c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efc1bd45f7cf400982d229d4b0eba6b2'} {{(pid=79198) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:48:29.415889 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1445/2890] 10.222.0.75 () {58 vars in 1223 bytes} [Wed Feb 16 05:48:29 2022] DELETE /identity/v3/users/efc1bd45f7cf400982d229d4b0eba6b2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 16 05:48:29.584449 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa81493-c28d-4699-b339-f2e8306c606f admin admin] Authenticating user token {{(pid=79197) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:48:29.585908 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.fernet_utils [None req-caa81493-c28d-4699-b339-f2e8306c606f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79197) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:48:29.603742 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa81493-c28d-4699-b339-f2e8306c606f admin admin] Validating token access rules against request {{(pid=79197) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:48:29.660248 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d75f9-7956-4750-b052-a82226bda948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45cb725950b24d83bf85741c6aa46ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b93c4f51f61141d6b4554752db1f615b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79197) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:48:29.661095 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d75f9-7956-4750-b052-a82226bda948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:48:29.661412 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d75f9-7956-4750-b052-a82226bda948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:48:29.661687 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d75f9-7956-4750-b052-a82226bda948 admin admin] PATH_INFO: `/v3/projects/2907a2767bf740fd8ca946c75f1ca474` {{(pid=79197) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:48:29.662868 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d75f9-7956-4750-b052-a82226bda948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2907a2767bf740fd8ca946c75f1ca474)` {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:48:29.664802 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d75f9-7956-4750-b052-a82226bda948 admin admin] RBAC: Authorization granted {{(pid=79197) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:48:29.709591 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-926d75f9-7956-4750-b052-a82226bda948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2907a2767bf740fd8ca946c75f1ca474', 'request_id': 'req-926d75f9-7956-4750-b052-a82226bda948'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:48:29.716658 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-926d75f9-7956-4750-b052-a82226bda948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2907a2767bf740fd8ca946c75f1ca474', 'request_id': 'req-926d75f9-7956-4750-b052-a82226bda948'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:48:29.722274 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-926d75f9-7956-4750-b052-a82226bda948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2907a2767bf740fd8ca946c75f1ca474', 'request_id': 'req-926d75f9-7956-4750-b052-a82226bda948'} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:48:29.732767 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-926d75f9-7956-4750-b052-a82226bda948 admin admin] The token cache is being invalidate because project 2907a2767bf740fd8ca946c75f1ca474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79197) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 16 05:48:29.733045 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-926d75f9-7956-4750-b052-a82226bda948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:48:29.733683 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: DEBUG keystone.notifications [None req-926d75f9-7956-4750-b052-a82226bda948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79197) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 16 05:48:29.735216 dv-cinder-829473-2-iscsi devstack@keystone.service[79197]: [pid: 79197|app: 0|req: 1446/2891] 10.222.0.75 () {58 vars in 1232 bytes} [Wed Feb 16 05:48:29 2022] DELETE /identity/v3/projects/2907a2767bf740fd8ca946c75f1ca474 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 16 05:51:25.931565 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9959dc-98f0-4d1a-b2cb-bdb77fb0d44c admin admin] Authenticating user token {{(pid=79198) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 16 05:51:25.932940 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-fd9959dc-98f0-4d1a-b2cb-bdb77fb0d44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:51:25.999203 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9959dc-98f0-4d1a-b2cb-bdb77fb0d44c admin admin] Validating token access rules against request {{(pid=79198) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 16 05:51:26.055569 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412dd614-30e8-43b3-ab59-11ea9e87dc28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc233f62146a49099216c6236fb2ee2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4d0b5a3f7d4542a47a26e623500b4f', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79198) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 16 05:51:26.056197 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412dd614-30e8-43b3-ab59-11ea9e87dc28 service placement] REQUEST_METHOD: `GET` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 16 05:51:26.056474 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412dd614-30e8-43b3-ab59-11ea9e87dc28 service placement] SCRIPT_NAME: `/identity` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 16 05:51:26.056743 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412dd614-30e8-43b3-ab59-11ea9e87dc28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79198) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 16 05:51:26.058488 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.fernet_utils [None req-412dd614-30e8-43b3-ab59-11ea9e87dc28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79198) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 16 05:51:26.069826 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412dd614-30e8-43b3-ab59-11ea9e87dc28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 16 05:51:26.071380 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412dd614-30e8-43b3-ab59-11ea9e87dc28 service placement] RBAC: Authorization granted {{(pid=79198) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 16 05:51:26.080868 dv-cinder-829473-2-iscsi devstack@keystone.service[79198]: [pid: 79198|app: 0|req: 1446/2892] 10.222.0.75 () {60 vars in 1365 bytes} [Wed Feb 16 05:51:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)